[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:56:06.483419   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33499
I20260709 12:56:06.484963   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:56:06.485944   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:06.505448   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:06.505471   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:06.505810   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:06.508446   431 server_base.cc:1061] running on GCE node
I20260709 12:56:07.821483   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:07.821712   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:07.821864   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601767821847 us; error 0 us; skew 500 ppm
I20260709 12:56:07.822625   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:07.828158   431 webserver.cc:533] Webserver started at http://127.0.107.254:44783/ using document root <none> and password file <none>
I20260709 12:56:07.829028   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:07.829211   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:07.829589   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:07.835104   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/master-0-root/instance:
uuid: "1625f6505f9e4afc8480763169df08a8"
format_stamp: "Formatted at 2026-07-09 12:56:07 on dist-test-slave-73vh"
I20260709 12:56:07.842492   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:56:07.847819   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:07.848930   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:56:07.849277   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/master-0-root
uuid: "1625f6505f9e4afc8480763169df08a8"
format_stamp: "Formatted at 2026-07-09 12:56:07 on dist-test-slave-73vh"
I20260709 12:56:07.849607   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:07.912974   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:07.914958   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:56:07.915498   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:08.091440   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33499
I20260709 12:56:08.091701   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33499 every 8 connection(s)
I20260709 12:56:08.103272   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:08.136806   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8: Bootstrap starting.
I20260709 12:56:08.146863   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:08.150028   498 log.cc:826] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8: Log is configured to *not* fsync() on all Append() calls
I20260709 12:56:08.158429   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8: No bootstrap required, opened a new log
I20260709 12:56:08.180796   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1625f6505f9e4afc8480763169df08a8" member_type: VOTER }
I20260709 12:56:08.181290   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:08.181486   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1625f6505f9e4afc8480763169df08a8, State: Initialized, Role: FOLLOWER
I20260709 12:56:08.182441   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1625f6505f9e4afc8480763169df08a8" member_type: VOTER }
I20260709 12:56:08.182888   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:56:08.183125   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:56:08.183777   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:08.187848   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1625f6505f9e4afc8480763169df08a8" member_type: VOTER }
I20260709 12:56:08.188452   498 leader_election.cc:304] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1625f6505f9e4afc8480763169df08a8; no voters: 
I20260709 12:56:08.190438   498 leader_election.cc:290] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:56:08.190760   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:08.193922   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 1 LEADER]: Becoming Leader. State: Replica: 1625f6505f9e4afc8480763169df08a8, State: Running, Role: LEADER
I20260709 12:56:08.194794   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1625f6505f9e4afc8480763169df08a8" member_type: VOTER }
I20260709 12:56:08.195596   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:56:08.208177   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1625f6505f9e4afc8480763169df08a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1625f6505f9e4afc8480763169df08a8" member_type: VOTER } }
I20260709 12:56:08.209192   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:08.209020   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1625f6505f9e4afc8480763169df08a8. Latest consensus state: current_term: 1 leader_uuid: "1625f6505f9e4afc8480763169df08a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1625f6505f9e4afc8480763169df08a8" member_type: VOTER } }
I20260709 12:56:08.209699   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:08.212883   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:56:08.235716   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:56:08.242479   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:56:08.264394   511 catalog_manager.cc:1383] Generated new cluster ID: 81ff64badbf24747bab82ebb1c3fe333
I20260709 12:56:08.264753   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:56:08.291697   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:56:08.293730   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:56:08.319424   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8: Generated new TSK 0
I20260709 12:56:08.320960   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:56:08.378825   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:08.392256   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:08.395578   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:08.409578   431 server_base.cc:1061] running on GCE node
W20260709 12:56:08.410794   524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:08.411950   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:08.412245   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:08.412467   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601768412449 us; error 0 us; skew 500 ppm
I20260709 12:56:08.413389   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:08.420791   431 webserver.cc:533] Webserver started at http://127.0.107.193:40519/ using document root <none> and password file <none>
I20260709 12:56:08.421698   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:08.422009   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:08.422422   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:08.424341   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-0-root/instance:
uuid: "884f189d876f40caacd6d7ff9132b98a"
format_stamp: "Formatted at 2026-07-09 12:56:08 on dist-test-slave-73vh"
I20260709 12:56:08.434551   431 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:56:08.443584   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:08.444695   431 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.000s	sys 0.006s
I20260709 12:56:08.445145   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "884f189d876f40caacd6d7ff9132b98a"
format_stamp: "Formatted at 2026-07-09 12:56:08 on dist-test-slave-73vh"
I20260709 12:56:08.445634   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:08.485265   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:08.488070   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:08.493724   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:08.502293   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:08.502702   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:08.503047   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:08.503276   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:08.750917   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39913
I20260709 12:56:08.751044   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39913 every 8 connection(s)
I20260709 12:56:08.766031   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:08.782810   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:08.788853   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:08.804474   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:08.806519   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33499
I20260709 12:56:08.807063   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:08.808925   591 heartbeater.cc:507] Master 127.0.107.254:33499 requested a full tablet report, sending...
I20260709 12:56:08.809340   431 server_base.cc:1061] running on GCE node
I20260709 12:56:08.810679   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:08.810967   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:08.811208   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601768811187 us; error 0 us; skew 500 ppm
I20260709 12:56:08.812139   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:08.812505   463 ts_manager.cc:194] Registered new tserver with Master: 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913)
I20260709 12:56:08.815665   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43250
I20260709 12:56:08.815848   431 webserver.cc:533] Webserver started at http://127.0.107.194:36027/ using document root <none> and password file <none>
I20260709 12:56:08.816704   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:08.817075   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:08.817471   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:08.819154   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-1-root/instance:
uuid: "0d739c07675f449f95139625cb0fc14e"
format_stamp: "Formatted at 2026-07-09 12:56:08 on dist-test-slave-73vh"
I20260709 12:56:08.825830   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.004s
I20260709 12:56:08.830264   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:08.831106   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:56:08.831450   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-1-root
uuid: "0d739c07675f449f95139625cb0fc14e"
format_stamp: "Formatted at 2026-07-09 12:56:08 on dist-test-slave-73vh"
I20260709 12:56:08.831828   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:08.852669   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:08.854446   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:08.857769   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:08.862078   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:08.862273   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:08.862604   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:08.862758   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:09.135232   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45483
I20260709 12:56:09.135501   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45483 every 8 connection(s)
I20260709 12:56:09.152451   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:09.169292   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:09.172417   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33499
I20260709 12:56:09.172930   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:09.174538   666 heartbeater.cc:507] Master 127.0.107.254:33499 requested a full tablet report, sending...
W20260709 12:56:09.175534   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:09.178089   463 ts_manager.cc:194] Registered new tserver with Master: 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:09.182240   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43254
W20260709 12:56:09.186604   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:09.191669   431 server_base.cc:1061] running on GCE node
I20260709 12:56:09.193281   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:09.193470   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:09.193660   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601769193628 us; error 0 us; skew 500 ppm
I20260709 12:56:09.194162   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:09.196635   431 webserver.cc:533] Webserver started at http://127.0.107.195:36303/ using document root <none> and password file <none>
I20260709 12:56:09.197227   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:09.197438   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:09.197726   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:09.198694   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-2-root/instance:
uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
format_stamp: "Formatted at 2026-07-09 12:56:09 on dist-test-slave-73vh"
I20260709 12:56:09.203629   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:56:09.207415   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:09.208186   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:56:09.208472   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-2-root
uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
format_stamp: "Formatted at 2026-07-09 12:56:09 on dist-test-slave-73vh"
I20260709 12:56:09.208808   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601766316156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:09.242187   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:09.243556   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:09.246225   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:09.249352   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:09.249571   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:09.249823   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:09.249993   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:09.480978   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38337
I20260709 12:56:09.481997   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38337 every 8 connection(s)
I20260709 12:56:09.510324   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33499
I20260709 12:56:09.510865   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:09.512034   740 heartbeater.cc:507] Master 127.0.107.254:33499 requested a full tablet report, sending...
I20260709 12:56:09.516178   463 ts_manager.cc:194] Registered new tserver with Master: ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:09.517167   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019359582s
I20260709 12:56:09.518252   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43264
I20260709 12:56:09.612128   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43266:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:56:09.617066   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:56:09.798022   629 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd276c7ca7946a5a43ff3489240af63 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:56:09.808624   630 tablet_service.cc:1511] Processing CreateTablet for tablet dc7a7f59fd2746ccbf27920a53270b65 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:56:09.810981   703 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd276c7ca7946a5a43ff3489240af63 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:56:09.812237   631 tablet_service.cc:1511] Processing CreateTablet for tablet 79543b0c13624dabbedf0adc8531472d (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:56:09.822860   591 heartbeater.cc:499] Master 127.0.107.254:33499 was elected leader, sending a full tablet report...
I20260709 12:56:09.822466   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd276c7ca7946a5a43ff3489240af63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.814754   704 tablet_service.cc:1511] Processing CreateTablet for tablet dc7a7f59fd2746ccbf27920a53270b65 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:56:09.818766   702 tablet_service.cc:1511] Processing CreateTablet for tablet d5e9b694fe1949138c4a082e5d237ba7 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:56:09.828333   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79543b0c13624dabbedf0adc8531472d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.829814   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd276c7ca7946a5a43ff3489240af63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.833303   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7a7f59fd2746ccbf27920a53270b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.826179   701 tablet_service.cc:1511] Processing CreateTablet for tablet d36d2b1c59314fc1b1f64fbab5624149 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:56:09.826002   705 tablet_service.cc:1511] Processing CreateTablet for tablet 79543b0c13624dabbedf0adc8531472d (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:56:09.831261   628 tablet_service.cc:1511] Processing CreateTablet for tablet d5e9b694fe1949138c4a082e5d237ba7 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:56:09.835707   556 tablet_service.cc:1511] Processing CreateTablet for tablet 79543b0c13624dabbedf0adc8531472d (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:56:09.855330   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7a7f59fd2746ccbf27920a53270b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.842396   627 tablet_service.cc:1511] Processing CreateTablet for tablet d36d2b1c59314fc1b1f64fbab5624149 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:56:09.847543   554 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd276c7ca7946a5a43ff3489240af63 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:56:09.863361   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79543b0c13624dabbedf0adc8531472d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.858064   553 tablet_service.cc:1511] Processing CreateTablet for tablet d5e9b694fe1949138c4a082e5d237ba7 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:56:09.847944   555 tablet_service.cc:1511] Processing CreateTablet for tablet dc7a7f59fd2746ccbf27920a53270b65 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:56:09.859843   552 tablet_service.cc:1511] Processing CreateTablet for tablet d36d2b1c59314fc1b1f64fbab5624149 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:56:09.864197   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79543b0c13624dabbedf0adc8531472d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.866110   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e9b694fe1949138c4a082e5d237ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.872997   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd276c7ca7946a5a43ff3489240af63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.867411   551 tablet_service.cc:1511] Processing CreateTablet for tablet e5b4b676a1124a0c80ff3c2328af3c3c (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:56:09.871922   626 tablet_service.cc:1511] Processing CreateTablet for tablet e5b4b676a1124a0c80ff3c2328af3c3c (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:56:09.876097   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36d2b1c59314fc1b1f64fbab5624149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.879192   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36d2b1c59314fc1b1f64fbab5624149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.881736   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b4b676a1124a0c80ff3c2328af3c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.883983   700 tablet_service.cc:1511] Processing CreateTablet for tablet e5b4b676a1124a0c80ff3c2328af3c3c (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:56:09.894820   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e9b694fe1949138c4a082e5d237ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.892738   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e9b694fe1949138c4a082e5d237ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.898641   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7a7f59fd2746ccbf27920a53270b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.903908   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b4b676a1124a0c80ff3c2328af3c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.903965   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b4b676a1124a0c80ff3c2328af3c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.914772   550 tablet_service.cc:1511] Processing CreateTablet for tablet a8232805e9d24a72a9319fb99ed000a9 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:56:09.917812   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36d2b1c59314fc1b1f64fbab5624149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.925664   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8232805e9d24a72a9319fb99ed000a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.941278   625 tablet_service.cc:1511] Processing CreateTablet for tablet a8232805e9d24a72a9319fb99ed000a9 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:56:09.953691   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8232805e9d24a72a9319fb99ed000a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.982570   699 tablet_service.cc:1511] Processing CreateTablet for tablet a8232805e9d24a72a9319fb99ed000a9 (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:56:09.994985   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8232805e9d24a72a9319fb99ed000a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:09.994567   549 tablet_service.cc:1511] Processing CreateTablet for tablet 03c3cb16f6c5465880f38e036e782fcb (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:56:10.008670   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c3cb16f6c5465880f38e036e782fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:10.034963   624 tablet_service.cc:1511] Processing CreateTablet for tablet 03c3cb16f6c5465880f38e036e782fcb (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:56:10.044883   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c3cb16f6c5465880f38e036e782fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:10.075670   698 tablet_service.cc:1511] Processing CreateTablet for tablet 03c3cb16f6c5465880f38e036e782fcb (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:56:10.077188   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c3cb16f6c5465880f38e036e782fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:10.096791   548 tablet_service.cc:1511] Processing CreateTablet for tablet a00eb050a0164e2684700df650d12c0e (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:56:10.098213   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a00eb050a0164e2684700df650d12c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:10.203989   666 heartbeater.cc:499] Master 127.0.107.254:33499 was elected leader, sending a full tablet report...
I20260709 12:56:10.204344   623 tablet_service.cc:1511] Processing CreateTablet for tablet a00eb050a0164e2684700df650d12c0e (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:56:10.321921   759 tablet_bootstrap.cc:492] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a: Bootstrap starting.
I20260709 12:56:10.332808   760 tablet_bootstrap.cc:492] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81: Bootstrap starting.
I20260709 12:56:10.334497   761 tablet_bootstrap.cc:492] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e: Bootstrap starting.
I20260709 12:56:10.399017   703 tablet_service.cc:1511] Processing CreateTablet for tablet a00eb050a0164e2684700df650d12c0e (DEFAULT_TABLE table=test-workload [id=8fbab8b25ad940d6b3a2f15e601c372b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:56:10.525334   740 heartbeater.cc:499] Master 127.0.107.254:33499 was elected leader, sending a full tablet report...
I20260709 12:56:10.598583   760 tablet_bootstrap.cc:654] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:10.608999   759 tablet_bootstrap.cc:654] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:10.642599   761 tablet_bootstrap.cc:654] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:10.713253   761 tablet_bootstrap.cc:492] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e: No bootstrap required, opened a new log
I20260709 12:56:10.717223   761 ts_tablet_manager.cc:1403] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e: Time spent bootstrapping tablet: real 0.454s	user 0.053s	sys 0.041s
I20260709 12:56:10.734670   761 raft_consensus.cc:359] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:10.735802   761 raft_consensus.cc:385] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:10.736166   761 raft_consensus.cc:740] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Initialized, Role: FOLLOWER
I20260709 12:56:10.739437   761 consensus_queue.cc:260] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:10.753772   761 ts_tablet_manager.cc:1434] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e: Time spent starting tablet: real 0.034s	user 0.019s	sys 0.016s
I20260709 12:56:10.762428   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a00eb050a0164e2684700df650d12c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:10.793897   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a00eb050a0164e2684700df650d12c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:10.794500   761 tablet_bootstrap.cc:492] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e: Bootstrap starting.
I20260709 12:56:10.870498   763 raft_consensus.cc:493] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:10.874620   763 raft_consensus.cc:515] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
W20260709 12:56:10.891855   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:56:10.913925   667 tablet.cc:2406] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:56:10.937961   763 leader_election.cc:290] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337), 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913)
I20260709 12:56:10.940857   761 tablet_bootstrap.cc:654] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.020332   759 tablet_bootstrap.cc:492] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a: No bootstrap required, opened a new log
I20260709 12:56:11.043558   759 ts_tablet_manager.cc:1403] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a: Time spent bootstrapping tablet: real 0.819s	user 0.041s	sys 0.065s
I20260709 12:56:11.052754   760 tablet_bootstrap.cc:492] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81: No bootstrap required, opened a new log
I20260709 12:56:11.058022   760 ts_tablet_manager.cc:1403] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent bootstrapping tablet: real 0.807s	user 0.057s	sys 0.056s
I20260709 12:56:11.073035   761 tablet_bootstrap.cc:492] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e: No bootstrap required, opened a new log
I20260709 12:56:11.075497   761 ts_tablet_manager.cc:1403] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e: Time spent bootstrapping tablet: real 0.284s	user 0.053s	sys 0.046s
I20260709 12:56:11.090128   760 raft_consensus.cc:359] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.094426   760 raft_consensus.cc:385] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.096426   760 raft_consensus.cc:740] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.100914   760 consensus_queue.cc:260] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.179616   761 raft_consensus.cc:359] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.180440   760 ts_tablet_manager.cc:1434] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent starting tablet: real 0.121s	user 0.019s	sys 0.020s
I20260709 12:56:11.180621   761 raft_consensus.cc:385] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.181224   761 raft_consensus.cc:740] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.151109   759 raft_consensus.cc:359] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.187960   759 raft_consensus.cc:385] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.188380   759 raft_consensus.cc:740] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.184841   760 tablet_bootstrap.cc:492] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81: Bootstrap starting.
I20260709 12:56:11.186568   761 consensus_queue.cc:260] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.192993   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
W20260709 12:56:11.196146   607 leader_election.cc:343] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.197155   761 ts_tablet_manager.cc:1434] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e: Time spent starting tablet: real 0.111s	user 0.016s	sys 0.011s
I20260709 12:56:11.194222   759 consensus_queue.cc:260] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.204097   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:11.206177   761 tablet_bootstrap.cc:492] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e: Bootstrap starting.
I20260709 12:56:11.206599   759 ts_tablet_manager.cc:1434] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a: Time spent starting tablet: real 0.161s	user 0.026s	sys 0.004s
I20260709 12:56:11.208977   759 tablet_bootstrap.cc:492] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a: Bootstrap starting.
W20260709 12:56:11.207706   606 leader_election.cc:343] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.210294   606 leader_election.cc:304] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e; no voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:11.212579   763 raft_consensus.cc:2749] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:11.223726   760 tablet_bootstrap.cc:654] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.231674   759 tablet_bootstrap.cc:654] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.236588   761 tablet_bootstrap.cc:654] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.253732   760 tablet_bootstrap.cc:492] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81: No bootstrap required, opened a new log
I20260709 12:56:11.254276   759 tablet_bootstrap.cc:492] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a: No bootstrap required, opened a new log
I20260709 12:56:11.254454   760 ts_tablet_manager.cc:1403] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.016s
I20260709 12:56:11.254884   759 ts_tablet_manager.cc:1403] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.023s
I20260709 12:56:11.258216   761 tablet_bootstrap.cc:492] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e: No bootstrap required, opened a new log
I20260709 12:56:11.258982   761 ts_tablet_manager.cc:1403] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.018s
I20260709 12:56:11.259966   760 raft_consensus.cc:359] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.260257   759 raft_consensus.cc:359] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.261036   760 raft_consensus.cc:385] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.261207   759 raft_consensus.cc:385] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.261509   760 raft_consensus.cc:740] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.261643   759 raft_consensus.cc:740] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.262789   759 consensus_queue.cc:260] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.262791   760 consensus_queue.cc:260] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.266680   759 ts_tablet_manager.cc:1434] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.001s
I20260709 12:56:11.268041   759 tablet_bootstrap.cc:492] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a: Bootstrap starting.
I20260709 12:56:11.271705   761 raft_consensus.cc:359] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.272869   761 raft_consensus.cc:385] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.273386   761 raft_consensus.cc:740] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.277117   761 consensus_queue.cc:260] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.282251   759 tablet_bootstrap.cc:654] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.286446   761 ts_tablet_manager.cc:1434] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.009s
I20260709 12:56:11.288064   761 tablet_bootstrap.cc:492] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e: Bootstrap starting.
I20260709 12:56:11.294170   760 ts_tablet_manager.cc:1434] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.005s
I20260709 12:56:11.295701   760 tablet_bootstrap.cc:492] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81: Bootstrap starting.
I20260709 12:56:11.315881   759 tablet_bootstrap.cc:492] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a: No bootstrap required, opened a new log
I20260709 12:56:11.316537   759 ts_tablet_manager.cc:1403] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.024s
I20260709 12:56:11.317195   761 tablet_bootstrap.cc:654] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.320691   759 raft_consensus.cc:359] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.321604   759 raft_consensus.cc:385] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.321923   759 raft_consensus.cc:740] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.322350   760 tablet_bootstrap.cc:654] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.322836   759 consensus_queue.cc:260] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.330358   759 ts_tablet_manager.cc:1434] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:56:11.331730   759 tablet_bootstrap.cc:492] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a: Bootstrap starting.
I20260709 12:56:11.342360   759 tablet_bootstrap.cc:654] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.344105   760 tablet_bootstrap.cc:492] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81: No bootstrap required, opened a new log
I20260709 12:56:11.344740   760 ts_tablet_manager.cc:1403] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.014s
I20260709 12:56:11.346982   761 tablet_bootstrap.cc:492] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e: No bootstrap required, opened a new log
I20260709 12:56:11.347451   761 ts_tablet_manager.cc:1403] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.015s
I20260709 12:56:11.350605   760 raft_consensus.cc:359] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.351583   761 raft_consensus.cc:359] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.352025   760 raft_consensus.cc:385] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.352555   761 raft_consensus.cc:385] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.352768   760 raft_consensus.cc:740] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.353235   761 raft_consensus.cc:740] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.354507   761 consensus_queue.cc:260] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.354573   760 consensus_queue.cc:260] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.361032   759 tablet_bootstrap.cc:492] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a: No bootstrap required, opened a new log
I20260709 12:56:11.361756   759 ts_tablet_manager.cc:1403] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.011s
I20260709 12:56:11.363477   760 ts_tablet_manager.cc:1434] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 12:56:11.365252   760 tablet_bootstrap.cc:492] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81: Bootstrap starting.
I20260709 12:56:11.365824   763 raft_consensus.cc:493] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:11.366453   763 raft_consensus.cc:515] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.367425   759 raft_consensus.cc:359] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:11.368567   759 raft_consensus.cc:385] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.369056   759 raft_consensus.cc:740] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.370939   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:11.370271   759 consensus_queue.cc:260] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:11.372009   566 raft_consensus.cc:2468] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 0.
I20260709 12:56:11.372789   763 leader_election.cc:290] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:11.375468   771 raft_consensus.cc:493] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:11.375545   606 leader_election.cc:304] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:11.377218   763 raft_consensus.cc:2804] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:11.377831   763 raft_consensus.cc:493] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:11.378402   763 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:11.378944   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
I20260709 12:56:11.376310   771 raft_consensus.cc:515] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
W20260709 12:56:11.382195   607 leader_election.cc:343] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.384754   759 ts_tablet_manager.cc:1434] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.006s
I20260709 12:56:11.388345   759 tablet_bootstrap.cc:492] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a: Bootstrap starting.
I20260709 12:56:11.396883   761 ts_tablet_manager.cc:1434] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.007s
I20260709 12:56:11.394599   771 leader_election.cc:290] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:11.408922   761 tablet_bootstrap.cc:492] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e: Bootstrap starting.
I20260709 12:56:11.446787   760 tablet_bootstrap.cc:654] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.454042   763 raft_consensus.cc:515] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.465629   759 tablet_bootstrap.cc:654] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.468022   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:11.468892   763 leader_election.cc:290] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:11.468971   566 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 0.
I20260709 12:56:11.470412   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
W20260709 12:56:11.472759   607 leader_election.cc:343] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.472910   680 leader_election.cc:304] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:11.474323   771 raft_consensus.cc:2804] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:11.475301   771 raft_consensus.cc:493] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:11.476480   771 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:11.474484   761 tablet_bootstrap.cc:654] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.472373   763 raft_consensus.cc:493] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:11.486562   772 raft_consensus.cc:493] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:11.487308   772 raft_consensus.cc:515] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.488180   763 raft_consensus.cc:515] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.534164   772 leader_election.cc:290] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:11.565202   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:11.572795   566 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:11.569917   771 raft_consensus.cc:515] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.577497   771 leader_election.cc:290] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:11.578275   771 raft_consensus.cc:493] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:11.578905   771 raft_consensus.cc:515] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.583184   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
I20260709 12:56:11.584381   641 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 0.
I20260709 12:56:11.585510   771 leader_election.cc:290] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:11.588390   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:11.589190   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
I20260709 12:56:11.590235   763 leader_election.cc:290] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:11.589524   641 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:11.592834   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
W20260709 12:56:11.592938   678 leader_election.cc:343] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.602547   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:11.603794   565 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:11.605996   607 leader_election.cc:343] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.609167   760 tablet_bootstrap.cc:492] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81: No bootstrap required, opened a new log
I20260709 12:56:11.606746   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:11.609644   760 ts_tablet_manager.cc:1403] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent bootstrapping tablet: real 0.245s	user 0.028s	sys 0.022s
I20260709 12:56:11.610546   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:11.614125   566 raft_consensus.cc:2468] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 1.
W20260709 12:56:11.617326   606 leader_election.cc:343] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.617777   606 leader_election.cc:304] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e; no voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:11.613431   564 raft_consensus.cc:2468] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 0.
I20260709 12:56:11.617902   760 raft_consensus.cc:359] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:11.619130   760 raft_consensus.cc:385] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.618839   763 raft_consensus.cc:2749] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:11.621470   606 leader_election.cc:304] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:11.621883   680 leader_election.cc:304] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 0d739c07675f449f95139625cb0fc14e
I20260709 12:56:11.622792   763 raft_consensus.cc:2804] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:11.623343   763 raft_consensus.cc:697] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:11.619896   760 raft_consensus.cc:740] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.625334   785 raft_consensus.cc:2804] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:11.626155   785 raft_consensus.cc:493] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:11.626585   785 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:11.626117   760 consensus_queue.cc:260] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:11.624418   763 consensus_queue.cc:237] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.638867   759 tablet_bootstrap.cc:492] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a: No bootstrap required, opened a new log
I20260709 12:56:11.639358   759 ts_tablet_manager.cc:1403] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a: Time spent bootstrapping tablet: real 0.253s	user 0.010s	sys 0.025s
I20260709 12:56:11.643653   760 ts_tablet_manager.cc:1434] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.004s
I20260709 12:56:11.645155   565 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 1.
I20260709 12:56:11.647608   680 leader_election.cc:304] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:11.648347   760 tablet_bootstrap.cc:492] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81: Bootstrap starting.
I20260709 12:56:11.648450   771 raft_consensus.cc:2804] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:11.651557   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
I20260709 12:56:11.658644   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
I20260709 12:56:11.660784   761 tablet_bootstrap.cc:492] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e: No bootstrap required, opened a new log
I20260709 12:56:11.662734   761 ts_tablet_manager.cc:1403] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e: Time spent bootstrapping tablet: real 0.254s	user 0.016s	sys 0.017s
I20260709 12:56:11.662062   641 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 1.
W20260709 12:56:11.666239   529 leader_election.cc:343] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.663635   785 raft_consensus.cc:515] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.672320   715 raft_consensus.cc:2393] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 884f189d876f40caacd6d7ff9132b98a in current term 1: Already voted for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in this term.
I20260709 12:56:11.663546   759 raft_consensus.cc:359] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.682272   759 raft_consensus.cc:385] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.682791   759 raft_consensus.cc:740] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.687229   532 leader_election.cc:304] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a; no voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:11.689098   785 leader_election.cc:290] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:11.689373   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:11.689447   772 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:11.684273   759 consensus_queue.cc:260] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.679870   771 raft_consensus.cc:697] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Becoming Leader. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:11.693830   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:11.697156   791 raft_consensus.cc:493] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:11.699432   771 consensus_queue.cc:237] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.700476   791 raft_consensus.cc:515] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
W20260709 12:56:11.718804   678 leader_election.cc:343] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.728382   760 tablet_bootstrap.cc:654] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:11.734907   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
I20260709 12:56:11.739223   641 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 0.
I20260709 12:56:11.749107   791 leader_election.cc:290] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913)
I20260709 12:56:11.763542   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:11.765589   678 leader_election.cc:304] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:11.781246   791 raft_consensus.cc:2804] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:11.795559   564 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 0.
I20260709 12:56:11.786916   791 raft_consensus.cc:493] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:11.805406   791 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:11.807531   460 catalog_manager.cc:5697] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:11.826109   759 ts_tablet_manager.cc:1434] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a: Time spent starting tablet: real 0.186s	user 0.022s	sys 0.023s
I20260709 12:56:11.771715   761 raft_consensus.cc:359] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.825415   792 raft_consensus.cc:493] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:11.808018   794 raft_consensus.cc:493] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:11.837355   759 tablet_bootstrap.cc:492] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a: Bootstrap starting.
I20260709 12:56:11.842319   761 raft_consensus.cc:385] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:11.862687   761 raft_consensus.cc:740] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Initialized, Role: FOLLOWER
I20260709 12:56:11.845880   792 raft_consensus.cc:515] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.886003   772 raft_consensus.cc:2749] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:11.845736   794 raft_consensus.cc:515] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
W20260709 12:56:11.920517   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:11.880231   761 consensus_queue.cc:260] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:11.935058   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:11.939116   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
W20260709 12:56:11.946314   678 leader_election.cc:343] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.932040   760 tablet_bootstrap.cc:492] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81: No bootstrap required, opened a new log
I20260709 12:56:11.932482   792 leader_election.cc:290] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:11.954748   761 ts_tablet_manager.cc:1434] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e: Time spent starting tablet: real 0.291s	user 0.027s	sys 0.012s
I20260709 12:56:11.956094   760 ts_tablet_manager.cc:1403] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent bootstrapping tablet: real 0.308s	user 0.039s	sys 0.016s
W20260709 12:56:11.962237   680 leader_election.cc:343] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:11.905750   462 catalog_manager.cc:5697] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:11.997743   680 leader_election.cc:304] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:11.998857   763 raft_consensus.cc:493] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:11.999244   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
I20260709 12:56:12.002049   761 tablet_bootstrap.cc:492] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e: Bootstrap starting.
I20260709 12:56:12.001101   763 raft_consensus.cc:515] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.002812   794 leader_election.cc:290] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:12.009399   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
I20260709 12:56:12.017936   792 raft_consensus.cc:2749] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:12.024513   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
I20260709 12:56:12.026721   641 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 0.
I20260709 12:56:12.028414   714 raft_consensus.cc:2393] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d739c07675f449f95139625cb0fc14e in current term 1: Already voted for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in this term.
W20260709 12:56:12.021405   680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39913, user_credentials={real_user=slave}} blocked reactor thread for 62139.8us
I20260709 12:56:12.029959   529 leader_election.cc:304] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:12.019204   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:12.032058   565 raft_consensus.cc:2468] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 1.
I20260709 12:56:12.018628   763 leader_election.cc:290] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:12.041141   794 raft_consensus.cc:2804] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:12.051242   794 raft_consensus.cc:493] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:12.054273   794 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.061053   607 leader_election.cc:304] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e; no voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:12.069651   759 tablet_bootstrap.cc:654] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.069108   784 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.074916   680 leader_election.cc:304] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 0d739c07675f449f95139625cb0fc14e
I20260709 12:56:12.079412   792 raft_consensus.cc:2804] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:12.079556   791 raft_consensus.cc:515] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:12.080111   792 raft_consensus.cc:697] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Becoming Leader. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:12.080888   715 raft_consensus.cc:2393] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 884f189d876f40caacd6d7ff9132b98a in current term 1: Already voted for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in this term.
I20260709 12:56:12.079038   760 raft_consensus.cc:359] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.081664   792 consensus_queue.cc:237] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.084733   760 raft_consensus.cc:385] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.085717   760 raft_consensus.cc:740] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.086884   760 consensus_queue.cc:260] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.088765   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:12.089542   641 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.099387   791 leader_election.cc:290] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 election: Requested vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913)
I20260709 12:56:12.101634   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:12.107865   794 raft_consensus.cc:515] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:12.110762   565 raft_consensus.cc:2393] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in current term 1: Already voted for candidate 884f189d876f40caacd6d7ff9132b98a in this term.
I20260709 12:56:12.111202   763 consensus_queue.cc:1048] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:12.113138   760 ts_tablet_manager.cc:1434] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent starting tablet: real 0.147s	user 0.024s	sys 0.001s
I20260709 12:56:12.114596   760 tablet_bootstrap.cc:492] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81: Bootstrap starting.
I20260709 12:56:12.120877   761 tablet_bootstrap.cc:654] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.121654   791 raft_consensus.cc:493] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:12.124471   791 raft_consensus.cc:515] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.121006   641 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 1.
I20260709 12:56:12.126585   794 leader_election.cc:290] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 election: Requested vote from peers ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:12.127310   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:12.128399   715 raft_consensus.cc:2393] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 884f189d876f40caacd6d7ff9132b98a in current term 1: Already voted for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in this term.
I20260709 12:56:12.128604   791 leader_election.cc:290] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:12.132019   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:12.134759   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
I20260709 12:56:12.135991   640 raft_consensus.cc:2393] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 884f189d876f40caacd6d7ff9132b98a in current term 1: Already voted for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in this term.
I20260709 12:56:12.138916   678 leader_election.cc:304] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:12.139129   529 leader_election.cc:304] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a; no voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:12.136803   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:12.142973   791 raft_consensus.cc:2804] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:12.144285   791 raft_consensus.cc:697] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Becoming Leader. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:12.145239   680 leader_election.cc:304] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:12.146765   792 raft_consensus.cc:2749] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:12.146420   791 consensus_queue.cc:237] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:12.143498   794 raft_consensus.cc:2749] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:12.157454   759 tablet_bootstrap.cc:492] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a: No bootstrap required, opened a new log
I20260709 12:56:12.157985   759 ts_tablet_manager.cc:1403] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a: Time spent bootstrapping tablet: real 0.326s	user 0.036s	sys 0.022s
I20260709 12:56:12.158456   784 raft_consensus.cc:2749] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:12.162523   759 raft_consensus.cc:359] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.163761   759 raft_consensus.cc:385] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.164348   759 raft_consensus.cc:740] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.165681   759 consensus_queue.cc:260] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.155670   794 raft_consensus.cc:493] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:12.171877   794 raft_consensus.cc:515] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.171157   760 tablet_bootstrap.cc:654] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.181370   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
I20260709 12:56:12.182261   639 raft_consensus.cc:2468] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 0.
I20260709 12:56:12.183529   715 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.183727   794 leader_election.cc:290] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:12.184077   529 leader_election.cc:304] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:12.187644   795 raft_consensus.cc:2804] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:12.188258   795 raft_consensus.cc:493] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:12.189481   795 raft_consensus.cc:3060] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.192698   759 ts_tablet_manager.cc:1434] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.003s
I20260709 12:56:12.193325   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
W20260709 12:56:12.196717   532 leader_election.cc:343] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:12.197391   759 tablet_bootstrap.cc:492] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a: Bootstrap starting.
I20260709 12:56:12.214568   791 consensus_queue.cc:1048] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:12.224148   759 tablet_bootstrap.cc:654] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.214325   795 raft_consensus.cc:515] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.229127   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:12.229905   639 raft_consensus.cc:3060] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.239699   791 consensus_queue.cc:1048] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:56:12.245042   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:12.243158   795 leader_election.cc:290] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 election: Requested vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
W20260709 12:56:12.248286   532 leader_election.cc:343] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:12.266750   784 consensus_queue.cc:1048] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:12.267290   761 tablet_bootstrap.cc:492] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e: No bootstrap required, opened a new log
I20260709 12:56:12.267980   761 ts_tablet_manager.cc:1403] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e: Time spent bootstrapping tablet: real 0.276s	user 0.020s	sys 0.020s
I20260709 12:56:12.270196   760 tablet_bootstrap.cc:492] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81: No bootstrap required, opened a new log
I20260709 12:56:12.270920   760 ts_tablet_manager.cc:1403] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent bootstrapping tablet: real 0.157s	user 0.020s	sys 0.015s
I20260709 12:56:12.273149   761 raft_consensus.cc:359] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.273959   639 raft_consensus.cc:2468] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 1.
I20260709 12:56:12.274138   761 raft_consensus.cc:385] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.274659   761 raft_consensus.cc:740] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.275808   761 consensus_queue.cc:260] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.278390   760 raft_consensus.cc:359] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.279372   760 raft_consensus.cc:385] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.279883   761 ts_tablet_manager.cc:1434] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 12:56:12.279699   529 leader_election.cc:304] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:12.281558   761 tablet_bootstrap.cc:492] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e: Bootstrap starting.
I20260709 12:56:12.279814   760 raft_consensus.cc:740] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.282859   795 raft_consensus.cc:2804] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:12.283521   795 raft_consensus.cc:697] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 1 LEADER]: Becoming Leader. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:12.284776   795 consensus_queue.cc:237] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.302906   772 raft_consensus.cc:493] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:12.303576   772 raft_consensus.cc:515] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.308075   772 leader_election.cc:290] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:12.308245   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8232805e9d24a72a9319fb99ed000a9" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
W20260709 12:56:12.310663   532 leader_election.cc:343] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:12.307715   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8232805e9d24a72a9319fb99ed000a9" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
W20260709 12:56:12.313159   529 leader_election.cc:343] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:12.313166   761 tablet_bootstrap.cc:654] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.313797   529 leader_election.cc:304] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a; no voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:12.314879   772 raft_consensus.cc:2749] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:12.301466   460 catalog_manager.cc:5697] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:12.305689   760 consensus_queue.cc:260] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.324391   760 ts_tablet_manager.cc:1434] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.004s
I20260709 12:56:12.325840   760 tablet_bootstrap.cc:492] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81: Bootstrap starting.
I20260709 12:56:12.325830   460 catalog_manager.cc:5697] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:12.336661   761 tablet_bootstrap.cc:492] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e: No bootstrap required, opened a new log
I20260709 12:56:12.337311   761 ts_tablet_manager.cc:1403] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e: Time spent bootstrapping tablet: real 0.056s	user 0.004s	sys 0.037s
I20260709 12:56:12.342496   760 tablet_bootstrap.cc:654] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.342492   761 raft_consensus.cc:359] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.343648   761 raft_consensus.cc:385] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.344133   761 raft_consensus.cc:740] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.345588   761 consensus_queue.cc:260] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.350162   761 ts_tablet_manager.cc:1434] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.007s
I20260709 12:56:12.351711   761 tablet_bootstrap.cc:492] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e: Bootstrap starting.
I20260709 12:56:12.361498   760 tablet_bootstrap.cc:492] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81: No bootstrap required, opened a new log
I20260709 12:56:12.362143   760 ts_tablet_manager.cc:1403] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.022s
I20260709 12:56:12.365906   761 tablet_bootstrap.cc:654] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.368993   760 raft_consensus.cc:359] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.370189   760 raft_consensus.cc:385] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.370723   760 raft_consensus.cc:740] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.372309   760 consensus_queue.cc:260] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.379622   792 raft_consensus.cc:493] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:12.380347   792 raft_consensus.cc:515] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.384456   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:12.386489   792 leader_election.cc:290] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:12.387437   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
I20260709 12:56:12.387816   760 ts_tablet_manager.cc:1434] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.011s
I20260709 12:56:12.388751   640 raft_consensus.cc:2393] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in current term 1: Already voted for candidate 884f189d876f40caacd6d7ff9132b98a in this term.
I20260709 12:56:12.389336   760 tablet_bootstrap.cc:492] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81: Bootstrap starting.
I20260709 12:56:12.391821   680 leader_election.cc:304] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:12.393121   792 raft_consensus.cc:3060] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.415756   759 tablet_bootstrap.cc:492] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a: No bootstrap required, opened a new log
I20260709 12:56:12.416486   759 ts_tablet_manager.cc:1403] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a: Time spent bootstrapping tablet: real 0.222s	user 0.036s	sys 0.072s
I20260709 12:56:12.423178   761 tablet_bootstrap.cc:492] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e: No bootstrap required, opened a new log
I20260709 12:56:12.424005   761 ts_tablet_manager.cc:1403] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.030s
I20260709 12:56:12.428531   761 raft_consensus.cc:359] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.429366   761 raft_consensus.cc:385] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.429484   792 raft_consensus.cc:2749] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:12.429746   761 raft_consensus.cc:740] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.430765   761 consensus_queue.cc:260] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.438053   761 ts_tablet_manager.cc:1434] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:56:12.439641   760 tablet_bootstrap.cc:654] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.440758   761 tablet_bootstrap.cc:492] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e: Bootstrap starting.
I20260709 12:56:12.447220   759 raft_consensus.cc:359] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.448510   759 raft_consensus.cc:385] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.446573   461 catalog_manager.cc:5697] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a reported cstate change: term changed from 0 to 1, leader changed from <none> to 884f189d876f40caacd6d7ff9132b98a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "884f189d876f40caacd6d7ff9132b98a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:12.449134   759 raft_consensus.cc:740] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.450542   759 consensus_queue.cc:260] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.454205   761 tablet_bootstrap.cc:654] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.454685   759 ts_tablet_manager.cc:1434] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.008s
I20260709 12:56:12.456094   759 tablet_bootstrap.cc:492] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a: Bootstrap starting.
I20260709 12:56:12.470181   759 tablet_bootstrap.cc:654] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.471166   761 tablet_bootstrap.cc:492] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e: No bootstrap required, opened a new log
I20260709 12:56:12.471721   761 ts_tablet_manager.cc:1403] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.014s
I20260709 12:56:12.473433   760 tablet_bootstrap.cc:492] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81: No bootstrap required, opened a new log
I20260709 12:56:12.473917   760 ts_tablet_manager.cc:1403] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.015s
I20260709 12:56:12.475823   761 raft_consensus.cc:359] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.476434   761 raft_consensus.cc:385] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.476680   761 raft_consensus.cc:740] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.477257   761 consensus_queue.cc:260] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.485184   760 raft_consensus.cc:359] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.485867   760 raft_consensus.cc:385] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.486145   760 raft_consensus.cc:740] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.488695   761 ts_tablet_manager.cc:1434] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.005s
I20260709 12:56:12.491309   760 consensus_queue.cc:260] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.499459   759 tablet_bootstrap.cc:492] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a: No bootstrap required, opened a new log
I20260709 12:56:12.499955   759 ts_tablet_manager.cc:1403] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.017s
I20260709 12:56:12.500663   760 ts_tablet_manager.cc:1434] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 12:56:12.501916   760 tablet_bootstrap.cc:492] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81: Bootstrap starting.
I20260709 12:56:12.503961   759 raft_consensus.cc:359] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.508605   759 raft_consensus.cc:385] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.508962   759 raft_consensus.cc:740] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.509800   759 consensus_queue.cc:260] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.512523   759 ts_tablet_manager.cc:1434] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:56:12.513486   759 tablet_bootstrap.cc:492] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a: Bootstrap starting.
I20260709 12:56:12.514197   760 tablet_bootstrap.cc:654] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.523033   792 consensus_queue.cc:1048] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:12.532793   784 raft_consensus.cc:493] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:12.533485   784 raft_consensus.cc:515] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.538982   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8232805e9d24a72a9319fb99ed000a9" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:12.539950   565 raft_consensus.cc:2468] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 0.
I20260709 12:56:12.542011   606 leader_election.cc:304] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:12.543650   763 raft_consensus.cc:2804] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:12.544221   763 raft_consensus.cc:493] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:12.544778   763 raft_consensus.cc:3060] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.551514   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8232805e9d24a72a9319fb99ed000a9" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
I20260709 12:56:12.552464   715 raft_consensus.cc:2468] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 0.
I20260709 12:56:12.554963   784 leader_election.cc:290] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:12.569839   759 tablet_bootstrap.cc:654] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:12.588063   791 consensus_queue.cc:1048] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:12.574218   763 raft_consensus.cc:515] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.596549   760 tablet_bootstrap.cc:492] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81: No bootstrap required, opened a new log
I20260709 12:56:12.597144   760 ts_tablet_manager.cc:1403] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent bootstrapping tablet: real 0.095s	user 0.049s	sys 0.036s
I20260709 12:56:12.599356   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8232805e9d24a72a9319fb99ed000a9" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:12.600124   564 raft_consensus.cc:3060] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.601899   760 raft_consensus.cc:359] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.603215   760 raft_consensus.cc:385] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.603685   760 raft_consensus.cc:740] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.604564   760 consensus_queue.cc:260] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.607298   760 ts_tablet_manager.cc:1434] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:56:12.613369   763 leader_election.cc:290] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:12.616735   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8232805e9d24a72a9319fb99ed000a9" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:12.617465   564 raft_consensus.cc:2468] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 1.
I20260709 12:56:12.617568   715 raft_consensus.cc:3060] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.620096   606 leader_election.cc:304] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:12.621372   763 raft_consensus.cc:2804] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:12.622370   763 raft_consensus.cc:697] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:12.630023   763 consensus_queue.cc:237] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.633675   715 raft_consensus.cc:2468] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 1.
I20260709 12:56:12.650189   759 tablet_bootstrap.cc:492] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a: No bootstrap required, opened a new log
I20260709 12:56:12.650909   759 ts_tablet_manager.cc:1403] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.011s
I20260709 12:56:12.662302   462 catalog_manager.cc:5697] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:12.664029   763 raft_consensus.cc:493] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:12.664186   759 raft_consensus.cc:359] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.665041   759 raft_consensus.cc:385] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:12.665482   759 raft_consensus.cc:740] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Initialized, Role: FOLLOWER
I20260709 12:56:12.664840   763 raft_consensus.cc:515] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.666296   759 consensus_queue.cc:260] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.669577   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:12.670430   565 raft_consensus.cc:2468] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 0.
I20260709 12:56:12.672238   606 leader_election.cc:304] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:12.673440   784 raft_consensus.cc:2804] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:12.673967   784 raft_consensus.cc:493] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:12.674440   784 raft_consensus.cc:3060] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.677930   763 leader_election.cc:290] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:12.679365   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
I20260709 12:56:12.680143   715 raft_consensus.cc:2468] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 0.
I20260709 12:56:12.682845   759 ts_tablet_manager.cc:1434] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.004s
I20260709 12:56:12.684659   784 raft_consensus.cc:515] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.689184   791 consensus_queue.cc:1048] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:12.690689   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:12.691464   565 raft_consensus.cc:3060] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.691536   791 consensus_queue.cc:1048] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:12.700846   791 raft_consensus.cc:493] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:12.701471   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:12.702481   715 raft_consensus.cc:3060] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.703625   784 leader_election.cc:290] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:12.706306   565 raft_consensus.cc:2468] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 1.
I20260709 12:56:12.707942   606 leader_election.cc:304] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:12.701472   791 raft_consensus.cc:515] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.709515   784 raft_consensus.cc:2804] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:12.710224   784 raft_consensus.cc:697] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:12.737174   715 raft_consensus.cc:2468] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 1.
I20260709 12:56:12.765388   791 leader_election.cc:290] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:12.766321   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e" is_pre_election: true
I20260709 12:56:12.766369   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:12.767278   639 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 0.
I20260709 12:56:12.767482   565 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 0.
I20260709 12:56:12.763422   784 consensus_queue.cc:237] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.769672   678 leader_election.cc:304] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:12.771387   791 raft_consensus.cc:2804] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:12.777083   832 raft_consensus.cc:493] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:12.777834   832 raft_consensus.cc:515] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.781559   832 leader_election.cc:290] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:12.782961   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00eb050a0164e2684700df650d12c0e" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" is_pre_election: true
I20260709 12:56:12.783746   714 raft_consensus.cc:2468] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 0.
I20260709 12:56:12.771821   791 raft_consensus.cc:493] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:12.784716   791 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.812515   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00eb050a0164e2684700df650d12c0e" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a" is_pre_election: true
I20260709 12:56:12.814524   565 raft_consensus.cc:2468] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 0.
I20260709 12:56:12.806691   607 leader_election.cc:304] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:12.817775   833 raft_consensus.cc:2804] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:12.818275   833 raft_consensus.cc:493] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:12.818723   833 raft_consensus.cc:3060] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.819310   794 consensus_queue.cc:1048] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:12.833410   791 raft_consensus.cc:515] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.836767   791 leader_election.cc:290] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:12.836313   462 catalog_manager.cc:5697] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:12.839625   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:12.840523   639 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.840710   833 raft_consensus.cc:515] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.845645   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00eb050a0164e2684700df650d12c0e" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:12.846338   714 raft_consensus.cc:3060] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.848618   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00eb050a0164e2684700df650d12c0e" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:12.849442   565 raft_consensus.cc:3060] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.851199   639 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 1.
I20260709 12:56:12.851392   833 leader_election.cc:290] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:12.852553   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:12.864449   564 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:12.868434   678 leader_election.cc:304] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:12.869716   791 raft_consensus.cc:2804] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:12.870431   791 raft_consensus.cc:697] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Becoming Leader. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:12.871683   791 consensus_queue.cc:237] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.876896   564 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 1.
I20260709 12:56:12.860116   714 raft_consensus.cc:2468] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 1.
I20260709 12:56:12.880511   607 leader_election.cc:304] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:12.881798   833 raft_consensus.cc:2804] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:12.882429   833 raft_consensus.cc:697] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:12.883665   833 consensus_queue.cc:237] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:12.860477   565 raft_consensus.cc:2468] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 1.
I20260709 12:56:12.904317   463 catalog_manager.cc:5697] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:12.908026   795 consensus_queue.cc:1048] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:12.935109   462 catalog_manager.cc:5697] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
W20260709 12:56:12.941789   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:13.092509   833 consensus_queue.cc:1048] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:13.104856   763 consensus_queue.cc:1048] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:13.306577   791 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:13.316808   792 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:13.354892   833 consensus_queue.cc:1048] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:13.366842   833 consensus_queue.cc:1048] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:13.415489   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
mode: GRACEFUL
new_leader_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:56:13.416085   714 raft_consensus.cc:606] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Received request to transfer leadership to TS 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:13.421643   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
mode: GRACEFUL
new_leader_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:56:13.421582   833 consensus_queue.cc:1048] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:13.422235   714 raft_consensus.cc:606] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Received request to transfer leadership to TS 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:13.429168   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
mode: GRACEFUL
new_leader_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:56:13.430166   714 raft_consensus.cc:606] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Received request to transfer leadership to TS 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:13.435779   763 consensus_queue.cc:1048] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:13.456200   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
mode: GRACEFUL
new_leader_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:47900
I20260709 12:56:13.456812   640 raft_consensus.cc:606] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Received request to transfer leadership to TS 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:13.472990   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
mode: GRACEFUL
new_leader_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:60054
I20260709 12:56:13.473554   564 raft_consensus.cc:606] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 1 LEADER]: Received request to transfer leadership to TS 0d739c07675f449f95139625cb0fc14e
I20260709 12:56:13.475467   771 raft_consensus.cc:993] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81: : Instructing follower 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:13.476008   792 raft_consensus.cc:1081] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Signalling peer 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:13.477596   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:53240
I20260709 12:56:13.478111   565 raft_consensus.cc:493] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:13.478449   565 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.484522   565 raft_consensus.cc:515] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.485210   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
mode: GRACEFUL
new_leader_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:56:13.485677   715 raft_consensus.cc:606] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Received request to transfer leadership to TS 0d739c07675f449f95139625cb0fc14e
I20260709 12:56:13.486418   565 leader_election.cc:290] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Requested vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:13.487195   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:13.487346   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:13.487819   640 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.487914   715 raft_consensus.cc:3055] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:13.488318   715 raft_consensus.cc:740] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:13.489125   715 consensus_queue.cc:260] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.490157   715 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.493989   640 raft_consensus.cc:2468] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:13.494935   529 leader_election.cc:304] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:13.495514   715 raft_consensus.cc:2468] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:13.495711   851 raft_consensus.cc:2804] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:13.496243   851 raft_consensus.cc:697] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Becoming Leader. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:13.497188   851 consensus_queue.cc:237] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.497605   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a00eb050a0164e2684700df650d12c0e"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
mode: GRACEFUL
new_leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:47900
I20260709 12:56:13.498116   640 raft_consensus.cc:606] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Received request to transfer leadership to TS ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:13.504184   462 catalog_manager.cc:5697] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a reported cstate change: term changed from 1 to 2, leader changed from ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195) to 884f189d876f40caacd6d7ff9132b98a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "884f189d876f40caacd6d7ff9132b98a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:13.505803   852 raft_consensus.cc:993] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a: : Instructing follower 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:13.506232   851 raft_consensus.cc:1081] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 1 LEADER]: Signalling peer 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:13.507864   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:34454
I20260709 12:56:13.508359   640 raft_consensus.cc:493] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:13.508711   640 raft_consensus.cc:3060] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.516180   640 raft_consensus.cc:515] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.519188   640 leader_election.cc:290] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 2 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:13.519428   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:13.519876   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36d2b1c59314fc1b1f64fbab5624149" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:13.520183   565 raft_consensus.cc:3055] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:13.520489   715 raft_consensus.cc:3060] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.520596   565 raft_consensus.cc:740] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:13.521871   565 consensus_queue.cc:260] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.523500   565 raft_consensus.cc:3060] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.529832   715 raft_consensus.cc:2468] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 2.
I20260709 12:56:13.531142   607 leader_election.cc:304] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:13.531678   565 raft_consensus.cc:2468] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 2.
I20260709 12:56:13.531836   831 raft_consensus.cc:2804] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:13.532302   831 raft_consensus.cc:697] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 2 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:13.533130   831 consensus_queue.cc:237] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.539189   462 catalog_manager.cc:5697] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 1 to 2, leader changed from 884f189d876f40caacd6d7ff9132b98a (127.0.107.193) to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:13.650092   771 raft_consensus.cc:993] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81: : Instructing follower 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:13.650580   792 raft_consensus.cc:1081] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Signalling peer 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:13.652026   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:53240
I20260709 12:56:13.652585   565 raft_consensus.cc:493] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:13.652997   565 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.657781   565 raft_consensus.cc:515] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:13.659269   565 leader_election.cc:290] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Requested vote from peers ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:13.660233   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:13.660241   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:13.660779   640 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.660851   715 raft_consensus.cc:3055] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:13.661214   715 raft_consensus.cc:740] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:13.661866   715 consensus_queue.cc:260] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:13.662716   715 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.665474   640 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:13.666392   529 leader_election.cc:304] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:13.667050   851 raft_consensus.cc:2804] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:13.667300   715 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:13.667464   851 raft_consensus.cc:697] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Becoming Leader. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:13.668277   851 consensus_queue.cc:237] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:13.674503   462 catalog_manager.cc:5697] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a reported cstate change: term changed from 1 to 2, leader changed from ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195) to 884f189d876f40caacd6d7ff9132b98a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "884f189d876f40caacd6d7ff9132b98a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:13.695818   833 raft_consensus.cc:993] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e: : Instructing follower 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:13.696257   831 raft_consensus.cc:1081] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Signalling peer 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:13.697634   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:53234
I20260709 12:56:13.698069   564 raft_consensus.cc:493] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:13.698398   564 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.703316   564 raft_consensus.cc:515] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.705039   564 leader_election.cc:290] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Requested vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:13.705718   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:13.706045   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:13.706277   640 raft_consensus.cc:3055] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:13.706542   715 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.706615   640 raft_consensus.cc:740] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:13.707476   640 consensus_queue.cc:260] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.708349   640 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.711308   715 raft_consensus.cc:2468] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:13.712288   532 leader_election.cc:304] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:13.713112   851 raft_consensus.cc:2804] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:13.713557   851 raft_consensus.cc:697] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Becoming Leader. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:13.713692   640 raft_consensus.cc:2468] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:13.714406   851 consensus_queue.cc:237] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.722898   462 catalog_manager.cc:5697] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a reported cstate change: term changed from 1 to 2, leader changed from 0d739c07675f449f95139625cb0fc14e (127.0.107.194) to 884f189d876f40caacd6d7ff9132b98a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "884f189d876f40caacd6d7ff9132b98a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:13.781273   792 raft_consensus.cc:993] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81: : Instructing follower 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:13.781682   771 raft_consensus.cc:1081] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Signalling peer 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:13.783272   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:34440
I20260709 12:56:13.783820   640 raft_consensus.cc:493] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:13.784173   640 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.785622   771 raft_consensus.cc:993] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81: : Instructing follower 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:13.786026   792 raft_consensus.cc:1081] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Signalling peer 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:13.787523   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:53240
I20260709 12:56:13.788039   564 raft_consensus.cc:493] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:13.788360   564 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.790536   640 raft_consensus.cc:515] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.792171   640 leader_election.cc:290] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 2 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:13.793417   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:13.793449   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:13.793988   715 raft_consensus.cc:3055] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:13.794064   565 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.794382   715 raft_consensus.cc:740] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:13.794232   564 raft_consensus.cc:515] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.795205   715 consensus_queue.cc:260] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.796186   715 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.797124   564 leader_election.cc:290] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Requested vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:13.797351   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:13.797510   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:13.797886   714 raft_consensus.cc:3055] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:13.798048   640 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.798220   714 raft_consensus.cc:740] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:13.799057   714 consensus_queue.cc:260] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.800676   714 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.802794   640 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:13.804111   529 leader_election.cc:304] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:13.804896   851 raft_consensus.cc:2804] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:13.805433   851 raft_consensus.cc:697] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Becoming Leader. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:13.806352   851 consensus_queue.cc:237] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.807129   714 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:13.810019   565 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 2.
I20260709 12:56:13.811617   715 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 2.
I20260709 12:56:13.813334   607 leader_election.cc:304] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:13.814404   831 raft_consensus.cc:2804] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:13.814975   831 raft_consensus.cc:697] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 2 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:13.816179   831 consensus_queue.cc:237] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.822393   462 catalog_manager.cc:5697] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a reported cstate change: term changed from 1 to 2, leader changed from ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195) to 884f189d876f40caacd6d7ff9132b98a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "884f189d876f40caacd6d7ff9132b98a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:13.824910   463 catalog_manager.cc:5697] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 1 to 2, leader changed from ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195) to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:13.927057   640 raft_consensus.cc:1275] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:13.928277   851 consensus_queue.cc:1048] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:13.937152   715 raft_consensus.cc:1275] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:13.939081   852 consensus_queue.cc:1048] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:13.957865   763 raft_consensus.cc:993] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e: : Instructing follower ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:13.958372   831 raft_consensus.cc:1081] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Signalling peer ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:13.959935   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a00eb050a0164e2684700df650d12c0e"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:58710
I20260709 12:56:13.960517   715 raft_consensus.cc:493] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:13.960922   715 raft_consensus.cc:3060] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.966300   715 raft_consensus.cc:515] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.968539   715 leader_election.cc:290] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 2 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:13.969238   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00eb050a0164e2684700df650d12c0e" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:13.969631   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a00eb050a0164e2684700df650d12c0e" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:13.969848   565 raft_consensus.cc:3060] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.970315   640 raft_consensus.cc:3055] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:13.970618   640 raft_consensus.cc:740] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:13.971333   640 consensus_queue.cc:260] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.972198   640 raft_consensus.cc:3060] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:13.975471   565 raft_consensus.cc:2468] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 2.
I20260709 12:56:13.976605   680 leader_election.cc:304] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:13.977404   792 raft_consensus.cc:2804] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:13.977551   640 raft_consensus.cc:2468] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 2.
I20260709 12:56:13.977913   792 raft_consensus.cc:697] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 LEADER]: Becoming Leader. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:13.978729   792 consensus_queue.cc:237] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:13.984866   462 catalog_manager.cc:5697] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 reported cstate change: term changed from 1 to 2, leader changed from 0d739c07675f449f95139625cb0fc14e (127.0.107.194) to ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:14.051187   715 raft_consensus.cc:1275] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.052712   831 consensus_queue.cc:1048] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:14.052925   640 raft_consensus.cc:1275] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.054490   852 consensus_queue.cc:1048] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:14.063315   565 raft_consensus.cc:1275] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.064975   763 consensus_queue.cc:1048] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:14.068513   714 raft_consensus.cc:1275] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.070288   794 consensus_queue.cc:1048] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:14.237888   714 raft_consensus.cc:1275] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.239318   794 consensus_queue.cc:1048] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:14.245244   565 raft_consensus.cc:1275] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.246801   833 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:14.248936   715 raft_consensus.cc:1275] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.250818   640 raft_consensus.cc:1275] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.252288   851 consensus_queue.cc:1048] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:14.259505   640 raft_consensus.cc:1275] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.253829   851 consensus_queue.cc:1048] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:56:14.264099   851 consensus_queue.cc:1048] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:14.266708   714 raft_consensus.cc:1275] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.268886   763 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:14.404192   565 raft_consensus.cc:1275] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.405458   771 consensus_queue.cc:1048] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:14.413277   639 raft_consensus.cc:1275] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:14.414930   771 consensus_queue.cc:1048] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:16.569765   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:56:16.570706   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:16.590409   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
mode: GRACEFUL
new_leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:56:16.591053   639 raft_consensus.cc:606] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 2 LEADER]: Received request to transfer leadership to TS ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:16.604205   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
mode: GRACEFUL
new_leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:60070
I20260709 12:56:16.605326   565 raft_consensus.cc:606] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Received request to transfer leadership to TS ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:16.607717   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:56:16.608419   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:16.845888   794 raft_consensus.cc:993] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a: : Instructing follower ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:16.847822   877 raft_consensus.cc:1081] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Signalling peer ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:16.852667   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:56:16.854269   713 raft_consensus.cc:493] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:16.855418   713 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:16.886934   713 raft_consensus.cc:515] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:16.901721   713 leader_election.cc:290] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 3 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:16.904884   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:16.906057   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:16.909804   564 raft_consensus.cc:3055] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:16.912187   564 raft_consensus.cc:740] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:16.911362   639 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:16.917268   564 consensus_queue.cc:260] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:16.929394   564 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:16.961232   639 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 3.
I20260709 12:56:16.966415   678 leader_election.cc:304] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:16.970360   771 raft_consensus.cc:2804] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:16.970880   564 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 3.
I20260709 12:56:16.978268   771 raft_consensus.cc:697] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Becoming Leader. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:16.982148   771 consensus_queue.cc:237] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.018448   463 catalog_manager.cc:5697] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 reported cstate change: term changed from 2 to 3, leader changed from 884f189d876f40caacd6d7ff9132b98a (127.0.107.193) to ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:17.034575   831 raft_consensus.cc:993] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e: : Instructing follower ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:17.035358   871 raft_consensus.cc:1081] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 2 LEADER]: Signalling peer ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:17.037130   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:58710
I20260709 12:56:17.037753   713 raft_consensus.cc:493] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:17.038110   713 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:17.043078   713 raft_consensus.cc:515] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.044898   713 leader_election.cc:290] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 3 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:17.045733   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:17.046372   564 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:17.046149   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:17.047823   639 raft_consensus.cc:3055] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:17.048183   639 raft_consensus.cc:740] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:17.048938   639 consensus_queue.cc:260] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.049913   639 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:17.051524   564 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 3.
I20260709 12:56:17.052843   680 leader_election.cc:304] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:17.053511   771 raft_consensus.cc:2804] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:17.053902   771 raft_consensus.cc:697] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Becoming Leader. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:17.054594   771 consensus_queue.cc:237] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.055181   639 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 3.
I20260709 12:56:17.061985   463 catalog_manager.cc:5697] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 reported cstate change: term changed from 2 to 3, leader changed from 0d739c07675f449f95139625cb0fc14e (127.0.107.194) to ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:17.392413   639 raft_consensus.cc:1275] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:17.393893   771 consensus_queue.cc:1048] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:17.408474   564 raft_consensus.cc:1275] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:17.410182   879 consensus_queue.cc:1048] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:17.511605   564 raft_consensus.cc:1275] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:17.513077   879 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:17.522989   639 raft_consensus.cc:1275] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:17.525126   892 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:17.609673   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:17.621690   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
mode: GRACEFUL
new_leader_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:60054
I20260709 12:56:17.622195   564 raft_consensus.cc:606] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Received request to transfer leadership to TS 0d739c07675f449f95139625cb0fc14e
I20260709 12:56:17.627169   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
mode: GRACEFUL
new_leader_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:56:17.627637   713 raft_consensus.cc:606] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Received request to transfer leadership to TS 0d739c07675f449f95139625cb0fc14e
I20260709 12:56:17.632172   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
mode: GRACEFUL
new_leader_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:60054
I20260709 12:56:17.632565   564 raft_consensus.cc:606] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Received request to transfer leadership to TS 0d739c07675f449f95139625cb0fc14e
I20260709 12:56:17.637614   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
mode: GRACEFUL
new_leader_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:60054
I20260709 12:56:17.638000   564 raft_consensus.cc:606] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Received request to transfer leadership to TS 0d739c07675f449f95139625cb0fc14e
I20260709 12:56:17.650053   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
mode: GRACEFUL
new_leader_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:56:17.650557   713 raft_consensus.cc:606] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Received request to transfer leadership to TS 0d739c07675f449f95139625cb0fc14e
I20260709 12:56:17.823686   877 raft_consensus.cc:993] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a: : Instructing follower 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:17.824138   894 raft_consensus.cc:1081] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Signalling peer 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:17.825529   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:34454
I20260709 12:56:17.826009   639 raft_consensus.cc:493] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:17.826318   639 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:17.830986   639 raft_consensus.cc:515] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.832641   639 leader_election.cc:290] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 3 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:17.833421   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:17.833762   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:17.833979   564 raft_consensus.cc:3055] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:17.834316   713 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:17.834342   564 raft_consensus.cc:740] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:17.835343   564 consensus_queue.cc:260] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.836369   564 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:17.839550   713 raft_consensus.cc:2468] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 3.
I20260709 12:56:17.840721   607 leader_election.cc:304] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:17.841450   871 raft_consensus.cc:2804] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:17.841663   564 raft_consensus.cc:2468] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 3.
I20260709 12:56:17.842605   871 raft_consensus.cc:697] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:17.843482   871 consensus_queue.cc:237] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.850162   460 catalog_manager.cc:5697] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 2 to 3, leader changed from 884f189d876f40caacd6d7ff9132b98a (127.0.107.193) to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:17.932734   892 raft_consensus.cc:993] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81: : Instructing follower 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:17.933347   878 raft_consensus.cc:1081] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Signalling peer 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:17.934994   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:34440
I20260709 12:56:17.935482   639 raft_consensus.cc:493] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:17.935942   639 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:17.941298   639 raft_consensus.cc:515] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.943096   639 leader_election.cc:290] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 4 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:17.943756   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:17.944360   564 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:17.944613   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:17.945186   713 raft_consensus.cc:3055] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:17.945461   713 raft_consensus.cc:740] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:17.946061   713 consensus_queue.cc:260] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.946962   713 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:17.949568   564 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 4.
I20260709 12:56:17.950564   606 leader_election.cc:304] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:17.951233   871 raft_consensus.cc:2804] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:17.951617   871 raft_consensus.cc:697] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 4 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:17.951889   713 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 4.
I20260709 12:56:17.952370   871 consensus_queue.cc:237] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.958122   460 catalog_manager.cc:5697] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 3 to 4, leader changed from ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195) to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:17.972330   892 raft_consensus.cc:993] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81: : Instructing follower 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:17.972798   878 raft_consensus.cc:1081] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Signalling peer 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:17.974268   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:34440
I20260709 12:56:17.974741   639 raft_consensus.cc:493] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:17.975050   639 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:17.979717   639 raft_consensus.cc:515] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.981302   639 leader_election.cc:290] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 4 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:17.982098   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:17.982324   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7a7f59fd2746ccbf27920a53270b65" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:17.982681   564 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:17.982833   713 raft_consensus.cc:3055] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:17.983186   713 raft_consensus.cc:740] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:17.983979   713 consensus_queue.cc:260] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.985152   713 raft_consensus.cc:3060] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:17.988170   877 raft_consensus.cc:993] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a: : Instructing follower 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:17.988658   894 raft_consensus.cc:1081] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Signalling peer 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:17.989449   564 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 4.
I20260709 12:56:17.990132   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:34454
I20260709 12:56:17.990675   639 raft_consensus.cc:493] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:17.990466   606 leader_election.cc:304] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, 884f189d876f40caacd6d7ff9132b98a; no voters: 
I20260709 12:56:17.990999   639 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:17.991386   871 raft_consensus.cc:2804] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:17.991848   713 raft_consensus.cc:2468] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 4.
I20260709 12:56:17.992717   871 raft_consensus.cc:697] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 4 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:17.993675   871 consensus_queue.cc:237] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.997602   639 raft_consensus.cc:515] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:17.999580   639 leader_election.cc:290] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 3 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:18.001133   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:18.001547   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:18.002182   564 raft_consensus.cc:3055] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:18.001588   460 catalog_manager.cc:5697] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 3 to 4, leader changed from ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195) to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:18.001741   713 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:18.002499   564 raft_consensus.cc:740] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:18.005311   564 consensus_queue.cc:260] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:18.006572   564 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:18.009766   713 raft_consensus.cc:2468] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 3.
I20260709 12:56:18.010908   607 leader_election.cc:304] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:18.011746   871 raft_consensus.cc:2804] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:18.012163   871 raft_consensus.cc:697] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:18.012979   871 consensus_queue.cc:237] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:18.014194   564 raft_consensus.cc:2468] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 3.
I20260709 12:56:18.020532   460 catalog_manager.cc:5697] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 2 to 3, leader changed from 884f189d876f40caacd6d7ff9132b98a (127.0.107.193) to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:18.144017   877 raft_consensus.cc:993] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a: : Instructing follower 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:18.144503   894 raft_consensus.cc:1081] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Signalling peer 0d739c07675f449f95139625cb0fc14e to start an election
I20260709 12:56:18.145984   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
 from {username='slave'} at 127.0.0.1:34454
I20260709 12:56:18.146451   639 raft_consensus.cc:493] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:18.146733   639 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:18.151530   639 raft_consensus.cc:515] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:18.153143   639 leader_election.cc:290] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 3 election: Requested vote from peers ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337), 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913)
I20260709 12:56:18.154055   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:18.154271   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "0d739c07675f449f95139625cb0fc14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:18.154670   713 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:18.154757   564 raft_consensus.cc:3055] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:18.155095   564 raft_consensus.cc:740] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:18.155916   564 consensus_queue.cc:260] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:18.157135   564 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:18.161448   713 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 3.
I20260709 12:56:18.162601   607 leader_election.cc:304] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:18.163365   871 raft_consensus.cc:2804] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:18.163524   564 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d739c07675f449f95139625cb0fc14e in term 3.
I20260709 12:56:18.163884   871 raft_consensus.cc:697] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Becoming Leader. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:18.165064   871 consensus_queue.cc:237] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:18.172528   460 catalog_manager.cc:5697] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e reported cstate change: term changed from 2 to 3, leader changed from 884f189d876f40caacd6d7ff9132b98a (127.0.107.193) to 0d739c07675f449f95139625cb0fc14e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "0d739c07675f449f95139625cb0fc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:18.310269   564 raft_consensus.cc:1275] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:18.311554   871 consensus_queue.cc:1048] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:18.320680   713 raft_consensus.cc:1275] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:18.322270   871 consensus_queue.cc:1048] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:18.351106   564 raft_consensus.cc:1275] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:18.352311   904 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:18.359516   713 raft_consensus.cc:1275] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:18.363950   904 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:18.405946   713 raft_consensus.cc:1275] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:18.407229   908 consensus_queue.cc:1048] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:18.417693   564 raft_consensus.cc:1275] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:18.419085   871 consensus_queue.cc:1048] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:18.505204   564 raft_consensus.cc:1275] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:18.506577   871 consensus_queue.cc:1048] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:18.517386   713 raft_consensus.cc:1275] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:18.519157   904 consensus_queue.cc:1048] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:18.582664   564 raft_consensus.cc:1275] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:18.583801   904 consensus_queue.cc:1048] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:18.593465   713 raft_consensus.cc:1275] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Refusing update from remote peer 0d739c07675f449f95139625cb0fc14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:18.595139   871 consensus_queue.cc:1048] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:20.654949   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:20.661438   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
mode: GRACEFUL
new_leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:56:20.661962   639 raft_consensus.cc:606] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 4 LEADER]: Received request to transfer leadership to TS ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:20.665218   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
mode: GRACEFUL
new_leader_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:56:20.665692   639 raft_consensus.cc:606] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Received request to transfer leadership to TS 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:20.667636   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
mode: GRACEFUL
new_leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:56:20.668067   639 raft_consensus.cc:606] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Received request to transfer leadership to TS ea9b88cde38f47aeb398ae6d7b2a5a81
I20260709 12:56:20.670123   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
mode: GRACEFUL
new_leader_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:56:20.670524   639 raft_consensus.cc:606] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Received request to transfer leadership to TS 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:20.672458   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c"
dest_uuid: "0d739c07675f449f95139625cb0fc14e"
mode: GRACEFUL
new_leader_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:56:20.672925   639 raft_consensus.cc:606] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Received request to transfer leadership to TS 884f189d876f40caacd6d7ff9132b98a
I20260709 12:56:20.673833   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:56:20.674351   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:20.791730   916 raft_consensus.cc:993] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e: : Instructing follower 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:20.792232   915 raft_consensus.cc:1081] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Signalling peer 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:20.793694   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:53234
I20260709 12:56:20.794050   564 raft_consensus.cc:493] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:20.794260   564 raft_consensus.cc:3060] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:20.798403   564 raft_consensus.cc:515] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:20.799732   564 leader_election.cc:290] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Requested vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:20.800868   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:20.801393   713 raft_consensus.cc:3060] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:20.801400   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b4b676a1124a0c80ff3c2328af3c3c" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:20.801959   639 raft_consensus.cc:3055] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:20.802225   639 raft_consensus.cc:740] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:20.802917   639 consensus_queue.cc:260] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:20.803886   639 raft_consensus.cc:3060] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:20.805889   713 raft_consensus.cc:2468] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:20.807050   532 leader_election.cc:304] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:20.808210   639 raft_consensus.cc:2468] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 2.
I20260709 12:56:20.808840   917 raft_consensus.cc:2804] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:20.809777   917 raft_consensus.cc:697] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Becoming Leader. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:20.810688   917 consensus_queue.cc:237] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:20.817507   463 catalog_manager.cc:5697] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a reported cstate change: term changed from 1 to 2, leader changed from 0d739c07675f449f95139625cb0fc14e (127.0.107.194) to 884f189d876f40caacd6d7ff9132b98a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "884f189d876f40caacd6d7ff9132b98a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:20.884516   916 raft_consensus.cc:993] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e: : Instructing follower ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:20.885069   924 raft_consensus.cc:1081] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Signalling peer ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:20.886981   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:58710
I20260709 12:56:20.887254   916 raft_consensus.cc:993] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e: : Instructing follower 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:20.887512   713 raft_consensus.cc:493] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:20.887868   924 raft_consensus.cc:1081] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Signalling peer 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:20.887902   713 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:20.889762   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:53234
I20260709 12:56:20.890169   564 raft_consensus.cc:493] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:20.890420   564 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:20.893098   713 raft_consensus.cc:515] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:20.894164   564 raft_consensus.cc:515] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:20.894731   713 leader_election.cc:290] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 4 election: Requested vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913)
I20260709 12:56:20.895447   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:20.895977   639 raft_consensus.cc:3055] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:20.896440   639 raft_consensus.cc:740] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:20.896483   564 leader_election.cc:290] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 4 election: Requested vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:20.895963   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79543b0c13624dabbedf0adc8531472d" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:20.897164   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:20.897791   565 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:20.897971   640 raft_consensus.cc:3055] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:20.897362   639 consensus_queue.cc:260] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:20.898386   640 raft_consensus.cc:740] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:20.898967   639 raft_consensus.cc:3060] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:20.899410   640 consensus_queue.cc:260] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:20.900913   640 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:20.900991   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd276c7ca7946a5a43ff3489240af63" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:20.901657   713 raft_consensus.cc:3060] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:20.904462   639 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 4.
I20260709 12:56:20.904814   565 raft_consensus.cc:2468] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 4.
I20260709 12:56:20.905627   678 leader_election.cc:304] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d739c07675f449f95139625cb0fc14e, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:20.906656   878 raft_consensus.cc:2804] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:20.908331   713 raft_consensus.cc:2468] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 4.
I20260709 12:56:20.909276   640 raft_consensus.cc:2468] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 4.
I20260709 12:56:20.909538   532 leader_election.cc:304] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:20.910349   878 raft_consensus.cc:697] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 LEADER]: Becoming Leader. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:20.911643   917 raft_consensus.cc:2804] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:20.912179   917 raft_consensus.cc:697] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 4 LEADER]: Becoming Leader. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:20.912098   878 consensus_queue.cc:237] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } }
I20260709 12:56:20.913051   917 consensus_queue.cc:237] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:20.921185   463 catalog_manager.cc:5697] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 reported cstate change: term changed from 3 to 4, leader changed from 0d739c07675f449f95139625cb0fc14e (127.0.107.194) to ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:20.922880   460 catalog_manager.cc:5697] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a reported cstate change: term changed from 3 to 4, leader changed from 0d739c07675f449f95139625cb0fc14e (127.0.107.194) to 884f189d876f40caacd6d7ff9132b98a (127.0.107.193). New cstate: current_term: 4 leader_uuid: "884f189d876f40caacd6d7ff9132b98a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:20.983734   916 raft_consensus.cc:993] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e: : Instructing follower 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:20.984195   924 raft_consensus.cc:1081] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Signalling peer 884f189d876f40caacd6d7ff9132b98a to start an election
I20260709 12:56:20.985659   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7"
dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
 from {username='slave'} at 127.0.0.1:53234
I20260709 12:56:20.986065   565 raft_consensus.cc:493] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:20.986304   565 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:20.990473   565 raft_consensus.cc:515] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:20.991976   565 leader_election.cc:290] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 4 election: Requested vote from peers 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483), ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195:38337)
I20260709 12:56:20.992775   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:20.993135   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9b694fe1949138c4a082e5d237ba7" candidate_uuid: "884f189d876f40caacd6d7ff9132b98a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
I20260709 12:56:20.993356   640 raft_consensus.cc:3055] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:20.993618   713 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:20.993727   640 raft_consensus.cc:740] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:20.994547   640 consensus_queue.cc:260] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:20.995453   640 raft_consensus.cc:3060] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:20.997743   713 raft_consensus.cc:2468] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 4.
I20260709 12:56:20.998611   532 leader_election.cc:304] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:20.999302   917 raft_consensus.cc:2804] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:20.999891   917 raft_consensus.cc:697] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 4 LEADER]: Becoming Leader. State: Replica: 884f189d876f40caacd6d7ff9132b98a, State: Running, Role: LEADER
I20260709 12:56:21.000826   917 consensus_queue.cc:237] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:21.001933   640 raft_consensus.cc:2468] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 884f189d876f40caacd6d7ff9132b98a in term 4.
I20260709 12:56:21.008129   460 catalog_manager.cc:5697] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a reported cstate change: term changed from 3 to 4, leader changed from 0d739c07675f449f95139625cb0fc14e (127.0.107.194) to 884f189d876f40caacd6d7ff9132b98a (127.0.107.193). New cstate: current_term: 4 leader_uuid: "884f189d876f40caacd6d7ff9132b98a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:21.030634   916 raft_consensus.cc:993] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e: : Instructing follower ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:21.031054   924 raft_consensus.cc:1081] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 4 LEADER]: Signalling peer ea9b88cde38f47aeb398ae6d7b2a5a81 to start an election
I20260709 12:56:21.032266   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb"
dest_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81"
 from {username='slave'} at 127.0.0.1:58710
I20260709 12:56:21.032634   713 raft_consensus.cc:493] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:21.032929   713 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:21.036609   713 raft_consensus.cc:515] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:21.037909   713 leader_election.cc:290] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 5 election: Requested vote from peers 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913), 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483)
I20260709 12:56:21.038820   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "884f189d876f40caacd6d7ff9132b98a"
I20260709 12:56:21.039060   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c3cb16f6c5465880f38e036e782fcb" candidate_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0d739c07675f449f95139625cb0fc14e"
I20260709 12:56:21.039304   565 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:21.039664   640 raft_consensus.cc:3055] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:56:21.039966   640 raft_consensus.cc:740] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0d739c07675f449f95139625cb0fc14e, State: Running, Role: LEADER
I20260709 12:56:21.040685   640 consensus_queue.cc:260] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:21.041551   640 raft_consensus.cc:3060] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:21.043918   565 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 5.
I20260709 12:56:21.044957   680 leader_election.cc:304] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 884f189d876f40caacd6d7ff9132b98a, ea9b88cde38f47aeb398ae6d7b2a5a81; no voters: 
I20260709 12:56:21.045738   878 raft_consensus.cc:2804] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:56:21.046258   878 raft_consensus.cc:697] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 5 LEADER]: Becoming Leader. State: Replica: ea9b88cde38f47aeb398ae6d7b2a5a81, State: Running, Role: LEADER
I20260709 12:56:21.046394   640 raft_consensus.cc:2468] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b88cde38f47aeb398ae6d7b2a5a81 in term 5.
I20260709 12:56:21.047158   878 consensus_queue.cc:237] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } }
I20260709 12:56:21.054469   460 catalog_manager.cc:5697] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 reported cstate change: term changed from 4 to 5, leader changed from 0d739c07675f449f95139625cb0fc14e (127.0.107.194) to ea9b88cde38f47aeb398ae6d7b2a5a81 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:21.290518   640 raft_consensus.cc:1275] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:21.291838   917 consensus_queue.cc:1048] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:21.302165   713 raft_consensus.cc:1275] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:21.304582   918 consensus_queue.cc:1048] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:21.407490   640 raft_consensus.cc:1275] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:21.408782   918 consensus_queue.cc:1048] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:21.417979   713 raft_consensus.cc:1275] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:21.419489   917 consensus_queue.cc:1048] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:21.434306   640 raft_consensus.cc:1275] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 5 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:56:21.435458   878 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:56:21.443992   565 raft_consensus.cc:1275] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:21.445945   939 consensus_queue.cc:1048] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:21.448167   565 raft_consensus.cc:1275] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 5 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:56:21.449839   925 consensus_queue.cc:1048] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "884f189d876f40caacd6d7ff9132b98a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:56:21.458770   640 raft_consensus.cc:1275] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Refusing update from remote peer ea9b88cde38f47aeb398ae6d7b2a5a81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:21.461733   925 consensus_queue.cc:1048] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:21.466948   713 raft_consensus.cc:1275] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:21.468426   917 consensus_queue.cc:1048] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b88cde38f47aeb398ae6d7b2a5a81" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:21.484254   639 raft_consensus.cc:1275] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Refusing update from remote peer 884f189d876f40caacd6d7ff9132b98a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:21.485899   918 consensus_queue.cc:1048] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d739c07675f449f95139625cb0fc14e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:21.675112   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:21.680445   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 12:56:21.697650   680 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:56:21.701977   680 consensus_peers.cc:597] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 -> Peer 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913): Couldn't send request to peer 884f189d876f40caacd6d7ff9132b98a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:21.708176   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:21.708897   431 tablet_replica.cc:333] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a: stopping tablet replica
I20260709 12:56:21.709616   431 raft_consensus.cc:2243] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.710203   431 raft_consensus.cc:2272] T a00eb050a0164e2684700df650d12c0e P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.713074   431 tablet_replica.cc:333] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a: stopping tablet replica
I20260709 12:56:21.713544   431 raft_consensus.cc:2243] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.713958   431 raft_consensus.cc:2272] T 03c3cb16f6c5465880f38e036e782fcb P 884f189d876f40caacd6d7ff9132b98a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.715782   431 tablet_replica.cc:333] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a: stopping tablet replica
I20260709 12:56:21.716224   431 raft_consensus.cc:2243] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.716573   431 raft_consensus.cc:2272] T d36d2b1c59314fc1b1f64fbab5624149 P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.718209   431 tablet_replica.cc:333] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a: stopping tablet replica
I20260709 12:56:21.718636   431 raft_consensus.cc:2243] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.718948   431 raft_consensus.cc:2272] T a8232805e9d24a72a9319fb99ed000a9 P 884f189d876f40caacd6d7ff9132b98a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.720341   431 tablet_replica.cc:333] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a: stopping tablet replica
I20260709 12:56:21.720829   431 raft_consensus.cc:2243] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:21.721458   431 raft_consensus.cc:2272] T 3cd276c7ca7946a5a43ff3489240af63 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.723304   431 tablet_replica.cc:333] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a: stopping tablet replica
I20260709 12:56:21.723724   431 raft_consensus.cc:2243] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:21.724347   431 raft_consensus.cc:2272] T e5b4b676a1124a0c80ff3c2328af3c3c P 884f189d876f40caacd6d7ff9132b98a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.726126   431 tablet_replica.cc:333] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a: stopping tablet replica
I20260709 12:56:21.726636   431 raft_consensus.cc:2243] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:21.727298   431 raft_consensus.cc:2272] T d5e9b694fe1949138c4a082e5d237ba7 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.729118   431 tablet_replica.cc:333] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a: stopping tablet replica
I20260709 12:56:21.729550   431 raft_consensus.cc:2243] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.729964   431 raft_consensus.cc:2272] T 79543b0c13624dabbedf0adc8531472d P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.731720   431 tablet_replica.cc:333] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a: stopping tablet replica
I20260709 12:56:21.732160   431 raft_consensus.cc:2243] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.732535   431 raft_consensus.cc:2272] T dc7a7f59fd2746ccbf27920a53270b65 P 884f189d876f40caacd6d7ff9132b98a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.830163   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:56:21.831945   606 consensus_peers.cc:597] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e -> Peer 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913): Couldn't send request to peer 884f189d876f40caacd6d7ff9132b98a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:56:21.847527   680 consensus_peers.cc:597] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 -> Peer 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913): Couldn't send request to peer 884f189d876f40caacd6d7ff9132b98a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:21.853313   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:56:21.877801   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:21.878435   431 tablet_replica.cc:333] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e: stopping tablet replica
I20260709 12:56:21.879038   431 raft_consensus.cc:2243] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.879693   431 raft_consensus.cc:2272] T a00eb050a0164e2684700df650d12c0e P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.882375   431 tablet_replica.cc:333] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e: stopping tablet replica
I20260709 12:56:21.883033   431 raft_consensus.cc:2243] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.883508   431 raft_consensus.cc:2272] T 03c3cb16f6c5465880f38e036e782fcb P 0d739c07675f449f95139625cb0fc14e [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:56:21.885305   680 consensus_peers.cc:597] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 -> Peer 884f189d876f40caacd6d7ff9132b98a (127.0.107.193:39913): Couldn't send request to peer 884f189d876f40caacd6d7ff9132b98a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:21.886284   431 tablet_replica.cc:333] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e: stopping tablet replica
I20260709 12:56:21.886833   431 raft_consensus.cc:2243] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:56:21.887490   431 raft_consensus.cc:2272] T a8232805e9d24a72a9319fb99ed000a9 P 0d739c07675f449f95139625cb0fc14e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.889212   431 tablet_replica.cc:333] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e: stopping tablet replica
I20260709 12:56:21.889629   431 raft_consensus.cc:2243] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.889950   431 raft_consensus.cc:2272] T 3cd276c7ca7946a5a43ff3489240af63 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.891778   431 tablet_replica.cc:333] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e: stopping tablet replica
I20260709 12:56:21.892196   431 raft_consensus.cc:2243] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.892522   431 raft_consensus.cc:2272] T e5b4b676a1124a0c80ff3c2328af3c3c P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.894323   431 tablet_replica.cc:333] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e: stopping tablet replica
I20260709 12:56:21.894734   431 raft_consensus.cc:2243] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.895066   431 raft_consensus.cc:2272] T d5e9b694fe1949138c4a082e5d237ba7 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.897104   431 tablet_replica.cc:333] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e: stopping tablet replica
I20260709 12:56:21.897590   431 raft_consensus.cc:2243] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:21.898253   431 raft_consensus.cc:2272] T d36d2b1c59314fc1b1f64fbab5624149 P 0d739c07675f449f95139625cb0fc14e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.899982   431 tablet_replica.cc:333] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e: stopping tablet replica
I20260709 12:56:21.900378   431 raft_consensus.cc:2243] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:21.901059   431 raft_consensus.cc:2272] T dc7a7f59fd2746ccbf27920a53270b65 P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.902618   431 tablet_replica.cc:333] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e: stopping tablet replica
I20260709 12:56:21.902992   431 raft_consensus.cc:2243] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.903293   431 raft_consensus.cc:2272] T 79543b0c13624dabbedf0adc8531472d P 0d739c07675f449f95139625cb0fc14e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.930310   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 12:56:21.937175   678 consensus_peers.cc:597] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 -> Peer 0d739c07675f449f95139625cb0fc14e (127.0.107.194:45483): Couldn't send request to peer 0d739c07675f449f95139625cb0fc14e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:21.949572   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:56:21.976238   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:21.976976   431 tablet_replica.cc:333] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81: stopping tablet replica
I20260709 12:56:21.977618   431 raft_consensus.cc:2243] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:21.978377   431 raft_consensus.cc:2272] T a00eb050a0164e2684700df650d12c0e P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.980142   431 tablet_replica.cc:333] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81: stopping tablet replica
I20260709 12:56:21.980741   431 raft_consensus.cc:2243] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:56:21.981407   431 raft_consensus.cc:2272] T 03c3cb16f6c5465880f38e036e782fcb P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.983282   431 tablet_replica.cc:333] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81: stopping tablet replica
I20260709 12:56:21.983776   431 raft_consensus.cc:2243] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.984195   431 raft_consensus.cc:2272] T d36d2b1c59314fc1b1f64fbab5624149 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.985903   431 tablet_replica.cc:333] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81: stopping tablet replica
I20260709 12:56:21.986384   431 raft_consensus.cc:2243] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.986764   431 raft_consensus.cc:2272] T d5e9b694fe1949138c4a082e5d237ba7 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.988507   431 tablet_replica.cc:333] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81: stopping tablet replica
I20260709 12:56:21.989022   431 raft_consensus.cc:2243] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.989398   431 raft_consensus.cc:2272] T e5b4b676a1124a0c80ff3c2328af3c3c P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.991184   431 tablet_replica.cc:333] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81: stopping tablet replica
I20260709 12:56:21.991647   431 raft_consensus.cc:2243] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.992095   431 raft_consensus.cc:2272] T a8232805e9d24a72a9319fb99ed000a9 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.993700   431 tablet_replica.cc:333] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81: stopping tablet replica
I20260709 12:56:21.994144   431 raft_consensus.cc:2243] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.994553   431 raft_consensus.cc:2272] T 3cd276c7ca7946a5a43ff3489240af63 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.996295   431 tablet_replica.cc:333] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81: stopping tablet replica
I20260709 12:56:21.996866   431 raft_consensus.cc:2243] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:21.997530   431 raft_consensus.cc:2272] T 79543b0c13624dabbedf0adc8531472d P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:21.999141   431 tablet_replica.cc:333] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81: stopping tablet replica
I20260709 12:56:21.999562   431 raft_consensus.cc:2243] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:21.999994   431 raft_consensus.cc:2272] T dc7a7f59fd2746ccbf27920a53270b65 P ea9b88cde38f47aeb398ae6d7b2a5a81 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:22.025246   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:56:22.042069   431 master.cc:562] Master@127.0.107.254:33499 shutting down...
I20260709 12:56:22.157248   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:56:22.157764   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:22.158041   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1625f6505f9e4afc8480763169df08a8: stopping tablet replica
I20260709 12:56:22.177670   431 master.cc:584] Master@127.0.107.254:33499 shutdown complete.
0d739c07675f449f95139625cb0fc14e  4
884f189d876f40caacd6d7ff9132b98a  4
ea9b88cde38f47aeb398ae6d7b2a5a81  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (15736 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:56:22.217000   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38933
I20260709 12:56:22.218113   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:22.223579   951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:22.223965   952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:22.226661   431 server_base.cc:1061] running on GCE node
W20260709 12:56:22.226778   954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:22.227795   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:22.227977   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:22.228088   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601782228077 us; error 0 us; skew 500 ppm
I20260709 12:56:22.228538   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:22.230942   431 webserver.cc:533] Webserver started at http://127.0.107.254:39569/ using document root <none> and password file <none>
I20260709 12:56:22.231374   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:22.231526   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:22.231740   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:22.232827   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/master-0-root/instance:
uuid: "360f44d25b514ef2892e88bf6685c657"
format_stamp: "Formatted at 2026-07-09 12:56:22 on dist-test-slave-73vh"
I20260709 12:56:22.237016   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:56:22.240854   959 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.241559   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:56:22.241901   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/master-0-root
uuid: "360f44d25b514ef2892e88bf6685c657"
format_stamp: "Formatted at 2026-07-09 12:56:22 on dist-test-slave-73vh"
I20260709 12:56:22.242201   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:22.256948   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:22.258193   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:22.299139   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38933
I20260709 12:56:22.299258  1010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38933 every 8 connection(s)
I20260709 12:56:22.303300  1011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.312711  1011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657: Bootstrap starting.
I20260709 12:56:22.317140  1011 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:22.321312  1011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657: No bootstrap required, opened a new log
I20260709 12:56:22.323225  1011 raft_consensus.cc:359] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "360f44d25b514ef2892e88bf6685c657" member_type: VOTER }
I20260709 12:56:22.323576  1011 raft_consensus.cc:385] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:22.323752  1011 raft_consensus.cc:740] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360f44d25b514ef2892e88bf6685c657, State: Initialized, Role: FOLLOWER
I20260709 12:56:22.324306  1011 consensus_queue.cc:260] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "360f44d25b514ef2892e88bf6685c657" member_type: VOTER }
I20260709 12:56:22.324784  1011 raft_consensus.cc:399] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:56:22.324997  1011 raft_consensus.cc:493] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:56:22.325201  1011 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:22.329455  1011 raft_consensus.cc:515] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "360f44d25b514ef2892e88bf6685c657" member_type: VOTER }
I20260709 12:56:22.329917  1011 leader_election.cc:304] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 360f44d25b514ef2892e88bf6685c657; no voters: 
I20260709 12:56:22.331094  1011 leader_election.cc:290] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:56:22.331414  1014 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:22.332967  1014 raft_consensus.cc:697] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 1 LEADER]: Becoming Leader. State: Replica: 360f44d25b514ef2892e88bf6685c657, State: Running, Role: LEADER
I20260709 12:56:22.333711  1014 consensus_queue.cc:237] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "360f44d25b514ef2892e88bf6685c657" member_type: VOTER }
I20260709 12:56:22.334523  1011 sys_catalog.cc:565] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:56:22.340698  1015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "360f44d25b514ef2892e88bf6685c657" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "360f44d25b514ef2892e88bf6685c657" member_type: VOTER } }
I20260709 12:56:22.340974  1016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 360f44d25b514ef2892e88bf6685c657. Latest consensus state: current_term: 1 leader_uuid: "360f44d25b514ef2892e88bf6685c657" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "360f44d25b514ef2892e88bf6685c657" member_type: VOTER } }
I20260709 12:56:22.341477  1015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:22.341630  1016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:22.343910  1023 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:56:22.349968  1023 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:56:22.350975   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:56:22.358500  1023 catalog_manager.cc:1383] Generated new cluster ID: 92ba6b14c2b84697877ac5bb1065ee8f
I20260709 12:56:22.358783  1023 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:56:22.371098  1023 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:56:22.372241  1023 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:56:22.388773  1023 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657: Generated new TSK 0
I20260709 12:56:22.389372  1023 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:56:22.417747   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:22.423615  1032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:22.425108  1033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:22.426396  1035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:22.426959   431 server_base.cc:1061] running on GCE node
I20260709 12:56:22.427668   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:22.427857   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:22.427976   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601782427965 us; error 0 us; skew 500 ppm
I20260709 12:56:22.428392   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:22.430511   431 webserver.cc:533] Webserver started at http://127.0.107.193:36545/ using document root <none> and password file <none>
I20260709 12:56:22.430928   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:22.431092   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:22.431348   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:22.432308   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-0-root/instance:
uuid: "718f7071fe17452cb46abd3ed705b860"
format_stamp: "Formatted at 2026-07-09 12:56:22 on dist-test-slave-73vh"
I20260709 12:56:22.436720   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:56:22.439834  1040 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.440554   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:56:22.440917   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "718f7071fe17452cb46abd3ed705b860"
format_stamp: "Formatted at 2026-07-09 12:56:22 on dist-test-slave-73vh"
I20260709 12:56:22.441201   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:22.466408   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:22.467731   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:22.469323   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:22.471582   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:22.471805   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.472064   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:22.472247   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.519891   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43963
I20260709 12:56:22.519942  1102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43963 every 8 connection(s)
I20260709 12:56:22.525681   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:22.532871  1107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:22.536491   431 server_base.cc:1061] running on GCE node
W20260709 12:56:22.537349  1110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:22.537739  1108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:22.538829   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:22.539058   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:22.539237   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601782539220 us; error 0 us; skew 500 ppm
I20260709 12:56:22.539913   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:22.542858   431 webserver.cc:533] Webserver started at http://127.0.107.194:34703/ using document root <none> and password file <none>
I20260709 12:56:22.543016  1103 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38933
I20260709 12:56:22.543402  1103 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:22.543442   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:22.543771   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:22.544052   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:22.544545  1103 heartbeater.cc:507] Master 127.0.107.254:38933 requested a full tablet report, sending...
I20260709 12:56:22.545415   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-1-root/instance:
uuid: "45b34cfd2e4d4db88ac4eaa456352863"
format_stamp: "Formatted at 2026-07-09 12:56:22 on dist-test-slave-73vh"
I20260709 12:56:22.546973   976 ts_manager.cc:194] Registered new tserver with Master: 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963)
I20260709 12:56:22.549310   976 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42458
I20260709 12:56:22.550802   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:56:22.554239  1115 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.555102   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:56:22.555387   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-1-root
uuid: "45b34cfd2e4d4db88ac4eaa456352863"
format_stamp: "Formatted at 2026-07-09 12:56:22 on dist-test-slave-73vh"
I20260709 12:56:22.555668   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:22.572474   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:22.573719   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:22.575176   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:22.577589   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:22.577811   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.578070   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:22.578243   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.623471   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:46305
I20260709 12:56:22.623584  1177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:46305 every 8 connection(s)
I20260709 12:56:22.628041   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:22.635638  1181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:22.637459  1182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:22.639727   431 server_base.cc:1061] running on GCE node
W20260709 12:56:22.640089  1185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:22.640635  1178 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38933
I20260709 12:56:22.641049  1178 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:22.641144   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:22.641445   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:22.641629   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601782641596 us; error 0 us; skew 500 ppm
I20260709 12:56:22.641878  1178 heartbeater.cc:507] Master 127.0.107.254:38933 requested a full tablet report, sending...
I20260709 12:56:22.642306   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:22.644187   976 ts_manager.cc:194] Registered new tserver with Master: 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:22.645713   431 webserver.cc:533] Webserver started at http://127.0.107.195:36507/ using document root <none> and password file <none>
I20260709 12:56:22.645977   976 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42466
I20260709 12:56:22.646314   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:22.646552   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:22.646883   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:22.648020   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-2-root/instance:
uuid: "3b253bf935f34ff7a68e9899522dd3e5"
format_stamp: "Formatted at 2026-07-09 12:56:22 on dist-test-slave-73vh"
I20260709 12:56:22.652559   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:56:22.656167  1189 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.657042   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:56:22.657449   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-2-root
uuid: "3b253bf935f34ff7a68e9899522dd3e5"
format_stamp: "Formatted at 2026-07-09 12:56:22 on dist-test-slave-73vh"
I20260709 12:56:22.657881   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601766316156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:22.670881   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:22.672132   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:22.673951   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:22.676400   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:22.676573   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.676887   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:22.677054   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:22.723502   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35609
I20260709 12:56:22.723598  1251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35609 every 8 connection(s)
I20260709 12:56:22.738247  1252 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38933
I20260709 12:56:22.738618  1252 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:22.739543  1252 heartbeater.cc:507] Master 127.0.107.254:38933 requested a full tablet report, sending...
I20260709 12:56:22.741621   976 ts_manager.cc:194] Registered new tserver with Master: 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:22.742508   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015675567s
I20260709 12:56:22.743217   976 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35690
I20260709 12:56:22.768216   976 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35706:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:56:22.771071   976 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:56:22.854894  1217 tablet_service.cc:1511] Processing CreateTablet for tablet 7eeab2e6ed17483db4a6a5fda2e86726 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:56:22.855876  1216 tablet_service.cc:1511] Processing CreateTablet for tablet aad029edc95b42efb337a8729eb7e5bb (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:56:22.856396  1217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeab2e6ed17483db4a6a5fda2e86726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.856433  1068 tablet_service.cc:1511] Processing CreateTablet for tablet 7eeab2e6ed17483db4a6a5fda2e86726 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:56:22.857985  1068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeab2e6ed17483db4a6a5fda2e86726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.858120  1215 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8cebfe89b34676bbe58074be045245 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:56:22.859509  1215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8cebfe89b34676bbe58074be045245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.861855  1214 tablet_service.cc:1511] Processing CreateTablet for tablet cee261776aaa405095de2df38e2c91b2 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:56:22.863284  1214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee261776aaa405095de2df38e2c91b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.869717  1212 tablet_service.cc:1511] Processing CreateTablet for tablet 846b3cd9925547f88c8ad23543e4415c (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:56:22.869949  1213 tablet_service.cc:1511] Processing CreateTablet for tablet d9072f77ad39480192d363bad64c2476 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:56:22.871075  1212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846b3cd9925547f88c8ad23543e4415c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.871857  1216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad029edc95b42efb337a8729eb7e5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.873512  1213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9072f77ad39480192d363bad64c2476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.875607  1211 tablet_service.cc:1511] Processing CreateTablet for tablet 0099362892064a75bcad7f83433f00d4 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:56:22.876039  1067 tablet_service.cc:1511] Processing CreateTablet for tablet aad029edc95b42efb337a8729eb7e5bb (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:56:22.877370  1067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad029edc95b42efb337a8729eb7e5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.878973  1066 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8cebfe89b34676bbe58074be045245 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:56:22.882313  1210 tablet_service.cc:1511] Processing CreateTablet for tablet 7256e50637b84a8baa7e1699e10abf49 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:56:22.885720  1209 tablet_service.cc:1511] Processing CreateTablet for tablet 2c017b10905b4ee7817fc66f10eddbe5 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:56:22.886720  1211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0099362892064a75bcad7f83433f00d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.887456  1209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c017b10905b4ee7817fc66f10eddbe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.891667  1267 tablet_bootstrap.cc:492] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
I20260709 12:56:22.892771  1066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8cebfe89b34676bbe58074be045245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.893112  1210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7256e50637b84a8baa7e1699e10abf49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.898499  1267 tablet_bootstrap.cc:654] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:22.901315  1217 tablet_service.cc:1511] Processing CreateTablet for tablet d3a6d66216044b54bd9922b4b2f3113c (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:56:22.903163  1217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a6d66216044b54bd9922b4b2f3113c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.910703  1065 tablet_service.cc:1511] Processing CreateTablet for tablet cee261776aaa405095de2df38e2c91b2 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:56:22.912276  1065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee261776aaa405095de2df38e2c91b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.914527  1064 tablet_service.cc:1511] Processing CreateTablet for tablet d9072f77ad39480192d363bad64c2476 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:56:22.916038  1064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9072f77ad39480192d363bad64c2476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.921950  1063 tablet_service.cc:1511] Processing CreateTablet for tablet 846b3cd9925547f88c8ad23543e4415c (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:56:22.923544  1063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846b3cd9925547f88c8ad23543e4415c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.925767  1062 tablet_service.cc:1511] Processing CreateTablet for tablet 0099362892064a75bcad7f83433f00d4 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:56:22.927191  1062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0099362892064a75bcad7f83433f00d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.931035  1061 tablet_service.cc:1511] Processing CreateTablet for tablet 7256e50637b84a8baa7e1699e10abf49 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:56:22.932783  1061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7256e50637b84a8baa7e1699e10abf49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.944036  1143 tablet_service.cc:1511] Processing CreateTablet for tablet 7eeab2e6ed17483db4a6a5fda2e86726 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:56:22.947057  1143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeab2e6ed17483db4a6a5fda2e86726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.949828  1142 tablet_service.cc:1511] Processing CreateTablet for tablet aad029edc95b42efb337a8729eb7e5bb (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:56:22.951123  1142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad029edc95b42efb337a8729eb7e5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.953904  1059 tablet_service.cc:1511] Processing CreateTablet for tablet d3a6d66216044b54bd9922b4b2f3113c (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:56:22.955229  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a6d66216044b54bd9922b4b2f3113c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.937202  1060 tablet_service.cc:1511] Processing CreateTablet for tablet 2c017b10905b4ee7817fc66f10eddbe5 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:56:22.960338  1060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c017b10905b4ee7817fc66f10eddbe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.977815  1140 tablet_service.cc:1511] Processing CreateTablet for tablet cee261776aaa405095de2df38e2c91b2 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:56:22.979615  1268 tablet_bootstrap.cc:492] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:22.979947  1140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee261776aaa405095de2df38e2c91b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.986068  1135 tablet_service.cc:1511] Processing CreateTablet for tablet 2c017b10905b4ee7817fc66f10eddbe5 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:56:22.987582  1135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c017b10905b4ee7817fc66f10eddbe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.994570  1139 tablet_service.cc:1511] Processing CreateTablet for tablet d9072f77ad39480192d363bad64c2476 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:56:22.994725  1138 tablet_service.cc:1511] Processing CreateTablet for tablet 846b3cd9925547f88c8ad23543e4415c (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:56:22.994946  1136 tablet_service.cc:1511] Processing CreateTablet for tablet 7256e50637b84a8baa7e1699e10abf49 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:56:22.996088  1139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9072f77ad39480192d363bad64c2476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.976130  1141 tablet_service.cc:1511] Processing CreateTablet for tablet 8e8cebfe89b34676bbe58074be045245 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:56:22.996759  1136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7256e50637b84a8baa7e1699e10abf49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.996547  1137 tablet_service.cc:1511] Processing CreateTablet for tablet 0099362892064a75bcad7f83433f00d4 (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:56:22.997675  1141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e8cebfe89b34676bbe58074be045245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.998323  1137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0099362892064a75bcad7f83433f00d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.998903  1138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846b3cd9925547f88c8ad23543e4415c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:22.998704  1134 tablet_service.cc:1511] Processing CreateTablet for tablet d3a6d66216044b54bd9922b4b2f3113c (DEFAULT_TABLE table=test-workload [id=9c63c9af0a9c4fafa7386bdaf9faf399]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:56:23.000114  1134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a6d66216044b54bd9922b4b2f3113c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:23.026212  1268 tablet_bootstrap.cc:654] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.048420  1270 tablet_bootstrap.cc:492] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
I20260709 12:56:23.049437  1267 tablet_bootstrap.cc:492] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.049963  1267 ts_tablet_manager.cc:1403] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.014s
I20260709 12:56:23.052937  1267 raft_consensus.cc:359] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.054557  1267 raft_consensus.cc:385] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.054908  1267 raft_consensus.cc:740] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.055864  1267 consensus_queue.cc:260] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.056406  1270 tablet_bootstrap.cc:654] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.077915  1267 ts_tablet_manager.cc:1434] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.028s	user 0.014s	sys 0.011s
I20260709 12:56:23.078648  1252 heartbeater.cc:499] Master 127.0.107.254:38933 was elected leader, sending a full tablet report...
I20260709 12:56:23.079020  1268 tablet_bootstrap.cc:492] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.079501  1268 ts_tablet_manager.cc:1403] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.100s	user 0.003s	sys 0.015s
I20260709 12:56:23.084708  1268 raft_consensus.cc:359] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.086782  1268 raft_consensus.cc:385] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.087091  1268 raft_consensus.cc:740] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.088217  1267 tablet_bootstrap.cc:492] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
I20260709 12:56:23.087985  1268 consensus_queue.cc:260] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.107231  1267 tablet_bootstrap.cc:654] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.113634  1272 raft_consensus.cc:493] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.114149  1272 raft_consensus.cc:515] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.125522  1272 leader_election.cc:290] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.127529  1268 ts_tablet_manager.cc:1434] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.048s	user 0.023s	sys 0.022s
I20260709 12:56:23.128320  1103 heartbeater.cc:499] Master 127.0.107.254:38933 was elected leader, sending a full tablet report...
I20260709 12:56:23.128588  1268 tablet_bootstrap.cc:492] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:23.135535  1268 tablet_bootstrap.cc:654] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.137485  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.138044  1270 tablet_bootstrap.cc:492] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.140895  1270 ts_tablet_manager.cc:1403] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.022s
W20260709 12:56:23.141150  1193 leader_election.cc:343] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.143851  1270 raft_consensus.cc:359] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.144702  1270 raft_consensus.cc:385] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.145020  1270 raft_consensus.cc:740] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.145793  1270 consensus_queue.cc:260] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.154498  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.154955  1178 heartbeater.cc:499] Master 127.0.107.254:38933 was elected leader, sending a full tablet report...
I20260709 12:56:23.156301  1270 ts_tablet_manager.cc:1434] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.009s
I20260709 12:56:23.157200  1270 tablet_bootstrap.cc:492] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
W20260709 12:56:23.164106  1193 leader_election.cc:343] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.164765  1193 leader_election.cc:304] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5; no voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.165378  1270 tablet_bootstrap.cc:654] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.165632  1272 raft_consensus.cc:2749] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:23.170490  1270 tablet_bootstrap.cc:492] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.170931  1270 ts_tablet_manager.cc:1403] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 12:56:23.171530  1268 tablet_bootstrap.cc:492] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.172051  1268 ts_tablet_manager.cc:1403] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.010s
I20260709 12:56:23.173344  1270 raft_consensus.cc:359] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.173880  1270 raft_consensus.cc:385] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.174147  1270 raft_consensus.cc:740] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.174849  1270 consensus_queue.cc:260] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.175446  1268 raft_consensus.cc:359] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.176294  1268 raft_consensus.cc:385] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.176532  1270 ts_tablet_manager.cc:1434] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:56:23.176620  1268 raft_consensus.cc:740] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.177482  1270 tablet_bootstrap.cc:492] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
I20260709 12:56:23.177810  1268 consensus_queue.cc:260] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.179571  1267 tablet_bootstrap.cc:492] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.180131  1267 ts_tablet_manager.cc:1403] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.004s
I20260709 12:56:23.180538  1268 ts_tablet_manager.cc:1434] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:56:23.181540  1268 tablet_bootstrap.cc:492] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:23.183171  1267 raft_consensus.cc:359] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.183892  1267 raft_consensus.cc:385] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.184217  1270 tablet_bootstrap.cc:654] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.184262  1267 raft_consensus.cc:740] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.185438  1267 consensus_queue.cc:260] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.188788  1268 tablet_bootstrap.cc:654] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.193195  1267 ts_tablet_manager.cc:1434] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:56:23.194572  1267 tablet_bootstrap.cc:492] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
I20260709 12:56:23.201457  1268 tablet_bootstrap.cc:492] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.202095  1268 ts_tablet_manager.cc:1403] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 12:56:23.205685  1268 raft_consensus.cc:359] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.201471  1270 tablet_bootstrap.cc:492] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.206557  1268 raft_consensus.cc:385] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.206951  1268 raft_consensus.cc:740] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.207041  1270 ts_tablet_manager.cc:1403] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.019s
I20260709 12:56:23.207489  1267 tablet_bootstrap.cc:654] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.209404  1268 consensus_queue.cc:260] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.210161  1270 raft_consensus.cc:359] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.211781  1270 raft_consensus.cc:385] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.211938  1268 ts_tablet_manager.cc:1434] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:56:23.212147  1270 raft_consensus.cc:740] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.212626  1267 tablet_bootstrap.cc:492] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.213064  1268 tablet_bootstrap.cc:492] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:23.213109  1267 ts_tablet_manager.cc:1403] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.008s
I20260709 12:56:23.213279  1270 consensus_queue.cc:260] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.215760  1270 ts_tablet_manager.cc:1434] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:56:23.216733  1270 tablet_bootstrap.cc:492] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
I20260709 12:56:23.222375  1268 tablet_bootstrap.cc:654] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.222168  1267 raft_consensus.cc:359] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.222929  1267 raft_consensus.cc:385] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.223249  1267 raft_consensus.cc:740] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.223498  1270 tablet_bootstrap.cc:654] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.224148  1267 consensus_queue.cc:260] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.236030  1267 ts_tablet_manager.cc:1434] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:56:23.242069  1276 raft_consensus.cc:493] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.242782  1276 raft_consensus.cc:515] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.244634  1268 tablet_bootstrap.cc:492] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.245208  1268 ts_tablet_manager.cc:1403] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.016s
I20260709 12:56:23.248745  1268 raft_consensus.cc:359] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.249559  1268 raft_consensus.cc:385] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.249908  1268 raft_consensus.cc:740] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.250262  1267 tablet_bootstrap.cc:492] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
I20260709 12:56:23.250886  1268 consensus_queue.cc:260] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.258598  1267 tablet_bootstrap.cc:654] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.259438  1276 leader_election.cc:290] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.261677  1268 ts_tablet_manager.cc:1434] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 12:56:23.261989  1270 tablet_bootstrap.cc:492] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.262951  1270 ts_tablet_manager.cc:1403] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.023s
I20260709 12:56:23.267596  1270 raft_consensus.cc:359] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.274581  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.275303  1078 raft_consensus.cc:2468] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 0.
I20260709 12:56:23.276571  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.276834  1119 leader_election.cc:304] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:23.277738  1276 raft_consensus.cc:2804] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.278112  1276 raft_consensus.cc:493] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:56:23.278240  1118 leader_election.cc:343] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.278504  1276 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.268568  1270 raft_consensus.cc:385] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.279313  1270 raft_consensus.cc:740] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.278527  1268 tablet_bootstrap.cc:492] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:23.280318  1270 consensus_queue.cc:260] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.282351  1267 tablet_bootstrap.cc:492] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.283109  1267 ts_tablet_manager.cc:1403] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.017s
I20260709 12:56:23.285988  1276 raft_consensus.cc:515] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.287539  1268 tablet_bootstrap.cc:654] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.287681  1267 raft_consensus.cc:359] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.288769  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:23.288914  1267 raft_consensus.cc:385] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.289374  1078 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.289551  1267 raft_consensus.cc:740] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.290967  1267 consensus_queue.cc:260] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.297310  1267 ts_tablet_manager.cc:1434] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:56:23.298878  1267 tablet_bootstrap.cc:492] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
I20260709 12:56:23.310298  1267 tablet_bootstrap.cc:654] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.319046  1078 raft_consensus.cc:2468] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 1.
I20260709 12:56:23.320367  1119 leader_election.cc:304] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:23.326104  1267 tablet_bootstrap.cc:492] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.326452  1276 leader_election.cc:290] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.327579  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:23.327255  1276 raft_consensus.cc:2804] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:56:23.329278  1118 leader_election.cc:343] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.329603  1276 raft_consensus.cc:697] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Becoming Leader. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:23.329758  1272 raft_consensus.cc:493] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.330490  1272 raft_consensus.cc:515] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.334978  1077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
W20260709 12:56:23.337154  1193 leader_election.cc:343] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.339274  1272 leader_election.cc:290] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.341081  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.330430  1276 consensus_queue.cc:237] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.326978  1267 ts_tablet_manager.cc:1403] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 12:56:23.341854  1153 raft_consensus.cc:2468] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 0.
I20260709 12:56:23.343283  1193 leader_election.cc:304] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.344303  1272 raft_consensus.cc:2804] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.344686  1272 raft_consensus.cc:493] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:23.345062  1272 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:23.345430  1024 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:23.345813  1268 tablet_bootstrap.cc:492] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.346391  1268 ts_tablet_manager.cc:1403] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.031s
I20260709 12:56:23.346498  1270 ts_tablet_manager.cc:1434] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.083s	user 0.049s	sys 0.019s
I20260709 12:56:23.345008  1267 raft_consensus.cc:359] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.347942  1267 raft_consensus.cc:385] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.348294  1267 raft_consensus.cc:740] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.349202  1267 consensus_queue.cc:260] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.347657  1270 tablet_bootstrap.cc:492] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
I20260709 12:56:23.350103  1268 raft_consensus.cc:359] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.351096  1268 raft_consensus.cc:385] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.351532  1268 raft_consensus.cc:740] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.352666  1268 consensus_queue.cc:260] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.355499  1272 raft_consensus.cc:515] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.358793  1270 tablet_bootstrap.cc:654] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.359431  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:23.364188  1078 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.364997  1268 ts_tablet_manager.cc:1434] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:56:23.362026  1274 raft_consensus.cc:493] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.362088  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:23.369148  1153 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.369093  1274 raft_consensus.cc:515] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.372845  1274 leader_election.cc:290] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.375862  1268 tablet_bootstrap.cc:492] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:23.363526  1272 leader_election.cc:290] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.377345   975 catalog_manager.cc:5697] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:23.381026  1267 ts_tablet_manager.cc:1434] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.039s	user 0.016s	sys 0.005s
I20260709 12:56:23.384543  1267 tablet_bootstrap.cc:492] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
I20260709 12:56:23.391242  1078 raft_consensus.cc:2468] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 1.
I20260709 12:56:23.392545  1267 tablet_bootstrap.cc:654] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.394865  1153 raft_consensus.cc:2468] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 1.
I20260709 12:56:23.396391  1193 leader_election.cc:304] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 
I20260709 12:56:23.397433  1272 raft_consensus.cc:2804] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:23.410679  1268 tablet_bootstrap.cc:654] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.413429  1293 raft_consensus.cc:493] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.415886  1293 raft_consensus.cc:515] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.417412  1267 tablet_bootstrap.cc:492] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.414256  1272 raft_consensus.cc:697] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:23.418773  1293 leader_election.cc:290] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.418738  1272 consensus_queue.cc:237] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.420753  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
W20260709 12:56:23.422330  1193 leader_election.cc:343] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.422832  1270 tablet_bootstrap.cc:492] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.423286  1270 ts_tablet_manager.cc:1403] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.019s
I20260709 12:56:23.417919  1267 ts_tablet_manager.cc:1403] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.004s
I20260709 12:56:23.425559  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.428414  1267 raft_consensus.cc:359] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.429194  1267 raft_consensus.cc:385] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.429543  1267 raft_consensus.cc:740] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.430585  1267 consensus_queue.cc:260] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.432190  1270 raft_consensus.cc:359] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
W20260709 12:56:23.432864  1193 leader_election.cc:343] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.433027  1270 raft_consensus.cc:385] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.433365  1193 leader_election.cc:304] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5; no voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.434614  1293 raft_consensus.cc:2749] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:23.433441  1270 raft_consensus.cc:740] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.438148  1270 consensus_queue.cc:260] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.439296  1267 ts_tablet_manager.cc:1434] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:56:23.439824  1268 tablet_bootstrap.cc:492] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.440385  1268 ts_tablet_manager.cc:1403] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.005s
I20260709 12:56:23.440500  1267 tablet_bootstrap.cc:492] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
I20260709 12:56:23.441565  1270 ts_tablet_manager.cc:1434] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 12:56:23.442701  1270 tablet_bootstrap.cc:492] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
I20260709 12:56:23.449252  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.450717  1270 tablet_bootstrap.cc:654] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:23.451427  1044 leader_election.cc:343] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.454486  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.454999  1267 tablet_bootstrap.cc:654] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.455186  1227 raft_consensus.cc:2468] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 0.
I20260709 12:56:23.457319  1276 raft_consensus.cc:493] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.457187  1043 leader_election.cc:304] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:23.458071  1276 raft_consensus.cc:515] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.459160  1274 raft_consensus.cc:2804] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.459757  1274 raft_consensus.cc:493] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:23.460316  1274 raft_consensus.cc:3060] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.461975  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099362892064a75bcad7f83433f00d4" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.462920  1276 leader_election.cc:290] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
W20260709 12:56:23.463584  1119 leader_election.cc:343] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.466020  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099362892064a75bcad7f83433f00d4" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.466961  1227 raft_consensus.cc:2468] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 0.
I20260709 12:56:23.468680  1118 leader_election.cc:304] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.470454  1276 raft_consensus.cc:2804] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.470990  1276 raft_consensus.cc:493] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:23.471518  1276 raft_consensus.cc:3060] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.487282  1274 raft_consensus.cc:515] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.488682  1267 tablet_bootstrap.cc:492] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.454460  1268 raft_consensus.cc:359] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.489555  1267 ts_tablet_manager.cc:1403] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.006s
I20260709 12:56:23.489876  1268 raft_consensus.cc:385] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.494138  1267 raft_consensus.cc:359] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.495234  1267 raft_consensus.cc:385] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.495642  1267 raft_consensus.cc:740] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.496665  1288 raft_consensus.cc:493] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.496809  1267 consensus_queue.cc:260] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.497205  1288 raft_consensus.cc:515] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.499370  1267 ts_tablet_manager.cc:1434] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:56:23.501689  1276 raft_consensus.cc:515] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.500599  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.490393  1268 raft_consensus.cc:740] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.503795  1267 tablet_bootstrap.cc:492] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
W20260709 12:56:23.503989  1119 leader_election.cc:343] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.501888  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.499703  1288 leader_election.cc:290] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
W20260709 12:56:23.506191  1118 leader_election.cc:343] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.506821  1118 leader_election.cc:304] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863; no voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.507859  1288 raft_consensus.cc:2749] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:23.508515  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:23.509429  1227 raft_consensus.cc:3060] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.514606  1267 tablet_bootstrap.cc:654] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.520601  1274 leader_election.cc:290] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 election: Requested vote from peers 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.517118  1268 consensus_queue.cc:260] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.523542  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:23.523873  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099362892064a75bcad7f83433f00d4" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860"
W20260709 12:56:23.525535  1119 leader_election.cc:343] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.525677  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099362892064a75bcad7f83433f00d4" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:23.527228  1226 raft_consensus.cc:3060] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.531533  1268 ts_tablet_manager.cc:1434] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.004s
I20260709 12:56:23.533056  1268 tablet_bootstrap.cc:492] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:23.536417  1288 raft_consensus.cc:493] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.536950  1288 raft_consensus.cc:515] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.539165  1288 leader_election.cc:290] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.541867  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.542220  1225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
W20260709 12:56:23.528626  1044 leader_election.cc:343] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.543162  1225 raft_consensus.cc:2468] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 0.
W20260709 12:56:23.543484  1119 leader_election.cc:343] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.545697  1118 leader_election.cc:304] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.547163  1288 raft_consensus.cc:2804] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.547540  1288 raft_consensus.cc:493] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:23.547910  1288 raft_consensus.cc:3060] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.548224  1268 tablet_bootstrap.cc:654] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.529119  1276 leader_election.cc:290] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.557493  1227 raft_consensus.cc:2468] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 1.
I20260709 12:56:23.558749  1043 leader_election.cc:304] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:23.560408  1274 raft_consensus.cc:2804] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:23.562005  1226 raft_consensus.cc:2468] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 1.
I20260709 12:56:23.563694  1118 leader_election.cc:304] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.565997  1276 raft_consensus.cc:2804] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:23.566812  1276 raft_consensus.cc:697] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Becoming Leader. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:23.567725  1276 consensus_queue.cc:237] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.566212  1288 raft_consensus.cc:515] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.570518  1270 tablet_bootstrap.cc:492] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.571055  1270 ts_tablet_manager.cc:1403] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.129s	user 0.042s	sys 0.046s
I20260709 12:56:23.571908  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860"
W20260709 12:56:23.573398  1119 leader_election.cc:343] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.572960   975 catalog_manager.cc:5697] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:23.574630  1270 raft_consensus.cc:359] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.575277  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:23.575620  1270 raft_consensus.cc:385] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.575865  1226 raft_consensus.cc:3060] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.576071  1270 raft_consensus.cc:740] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.580361  1288 leader_election.cc:290] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.580998  1267 tablet_bootstrap.cc:492] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.581459  1267 ts_tablet_manager.cc:1403] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.010s
I20260709 12:56:23.583148  1270 consensus_queue.cc:260] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.587122  1270 ts_tablet_manager.cc:1434] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:56:23.587177  1267 raft_consensus.cc:359] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.588277  1267 raft_consensus.cc:385] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.588986  1267 raft_consensus.cc:740] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.582342  1226 raft_consensus.cc:2468] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 1.
I20260709 12:56:23.585388  1274 raft_consensus.cc:697] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:23.591373  1267 consensus_queue.cc:260] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.592008  1307 raft_consensus.cc:493] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.593588  1267 ts_tablet_manager.cc:1434] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:56:23.592486  1307 raft_consensus.cc:515] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.594485  1267 tablet_bootstrap.cc:492] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
I20260709 12:56:23.595875  1270 tablet_bootstrap.cc:492] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
I20260709 12:56:23.600479  1118 leader_election.cc:304] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.599164  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.596477  1274 consensus_queue.cc:237] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.597546  1307 leader_election.cc:290] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
W20260709 12:56:23.602995  1043 leader_election.cc:343] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.612444  1270 tablet_bootstrap.cc:654] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.619983  1309 raft_consensus.cc:493] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.609566  1276 raft_consensus.cc:2804] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:23.620553  1309 raft_consensus.cc:515] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.624938  1276 raft_consensus.cc:697] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Becoming Leader. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:23.606529  1267 tablet_bootstrap.cc:654] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.627703  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8cebfe89b34676bbe58074be045245" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.597347  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.628314  1227 raft_consensus.cc:2468] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 0.
W20260709 12:56:23.629180  1044 leader_election.cc:343] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.629616  1043 leader_election.cc:304] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:23.629992  1276 consensus_queue.cc:237] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.629638  1044 leader_election.cc:304] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 718f7071fe17452cb46abd3ed705b860; no voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:23.598186   975 catalog_manager.cc:5697] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:23.633538  1307 raft_consensus.cc:2804] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.627099  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8cebfe89b34676bbe58074be045245" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.629869  1270 tablet_bootstrap.cc:492] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.627190  1268 tablet_bootstrap.cc:492] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.626118  1309 leader_election.cc:290] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.634595  1267 tablet_bootstrap.cc:492] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.634059  1307 raft_consensus.cc:493] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:23.638000  1307 raft_consensus.cc:3060] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.636893  1270 ts_tablet_manager.cc:1403] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.007s
I20260709 12:56:23.636029  1268 ts_tablet_manager.cc:1403] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.000s
I20260709 12:56:23.636009  1274 raft_consensus.cc:2749] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:23.648797   973 catalog_manager.cc:5697] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 0 to 1, leader changed from <none> to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:23.653255  1270 raft_consensus.cc:359] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.654731  1267 ts_tablet_manager.cc:1403] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.004s
I20260709 12:56:23.666357  1267 raft_consensus.cc:359] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.667033  1267 raft_consensus.cc:385] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.667320  1267 raft_consensus.cc:740] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.667845  1293 raft_consensus.cc:493] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.648370  1268 raft_consensus.cc:359] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.668803  1268 raft_consensus.cc:385] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.668371  1293 raft_consensus.cc:515] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.669149  1268 raft_consensus.cc:740] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.666432  1307 raft_consensus.cc:515] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.670042  1268 consensus_queue.cc:260] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.670615  1293 leader_election.cc:290] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.671036   975 catalog_manager.cc:5697] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:23.655680  1272 raft_consensus.cc:493] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.672400  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.672544  1268 ts_tablet_manager.cc:1434] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:56:23.674649  1272 raft_consensus.cc:515] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
W20260709 12:56:23.675279  1193 leader_election.cc:343] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.676602  1272 leader_election.cc:290] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.668022  1267 consensus_queue.cc:260] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.677762  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.678424  1267 ts_tablet_manager.cc:1434] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:56:23.679275  1267 tablet_bootstrap.cc:492] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5: Bootstrap starting.
I20260709 12:56:23.680801  1270 raft_consensus.cc:385] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.681178  1270 raft_consensus.cc:740] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.672690  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.682811  1078 raft_consensus.cc:2468] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 0.
I20260709 12:56:23.673107  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8cebfe89b34676bbe58074be045245" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:23.685251  1227 raft_consensus.cc:3060] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.685451  1193 leader_election.cc:304] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:23.686509  1272 raft_consensus.cc:2804] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.686874  1272 raft_consensus.cc:493] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:23.687223  1272 raft_consensus.cc:3060] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.687742  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.688274  1268 tablet_bootstrap.cc:492] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:23.688467  1078 raft_consensus.cc:2393] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b253bf935f34ff7a68e9899522dd3e5 in current term 1: Already voted for candidate 45b34cfd2e4d4db88ac4eaa456352863 in this term.
I20260709 12:56:23.689720  1193 leader_election.cc:304] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5; no voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.690531  1293 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.681871  1270 consensus_queue.cc:260] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.687335  1267 tablet_bootstrap.cc:654] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.693928  1270 ts_tablet_manager.cc:1434] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.002s
I20260709 12:56:23.694850  1270 tablet_bootstrap.cc:492] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
I20260709 12:56:23.696781  1272 raft_consensus.cc:515] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.699075  1272 leader_election.cc:290] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.701083  1307 leader_election.cc:290] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.704447  1270 tablet_bootstrap.cc:654] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.704550  1293 raft_consensus.cc:2749] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:23.705466  1227 raft_consensus.cc:2468] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 1.
I20260709 12:56:23.706705  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:23.706959  1043 leader_election.cc:304] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:23.707369  1078 raft_consensus.cc:3060] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.713133  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:23.713716  1268 tablet_bootstrap.cc:654] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.711956  1307 raft_consensus.cc:2804] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:23.715009  1307 raft_consensus.cc:697] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:23.716329  1307 consensus_queue.cc:237] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
W20260709 12:56:23.711352  1044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46305, user_credentials={real_user=slave}} blocked reactor thread for 82209.1us
I20260709 12:56:23.721328  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8cebfe89b34676bbe58074be045245" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
W20260709 12:56:23.724814  1193 leader_election.cc:343] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.728303  1267 tablet_bootstrap.cc:492] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5: No bootstrap required, opened a new log
I20260709 12:56:23.728922  1267 ts_tablet_manager.cc:1403] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.006s
W20260709 12:56:23.721395  1044 leader_election.cc:343] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:23.730507  1044 leader_election.cc:343] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:23.724918  1078 raft_consensus.cc:2468] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 1.
I20260709 12:56:23.732782  1267 raft_consensus.cc:359] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.733248  1193 leader_election.cc:304] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:23.733743  1267 raft_consensus.cc:385] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.734782  1267 raft_consensus.cc:740] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.734144  1293 raft_consensus.cc:2804] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:23.735584  1293 raft_consensus.cc:697] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:23.736413  1270 tablet_bootstrap.cc:492] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.736939  1270 ts_tablet_manager.cc:1403] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.015s
I20260709 12:56:23.736720  1293 consensus_queue.cc:237] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.739696  1270 raft_consensus.cc:359] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.740320  1270 raft_consensus.cc:385] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.740588  1270 raft_consensus.cc:740] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.741257  1270 consensus_queue.cc:260] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.742946  1267 consensus_queue.cc:260] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.743520  1270 ts_tablet_manager.cc:1434] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:56:23.744711  1270 tablet_bootstrap.cc:492] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
I20260709 12:56:23.748528   976 catalog_manager.cc:5697] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 0 to 1, leader changed from <none> to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:23.751189  1270 tablet_bootstrap.cc:654] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.752285  1268 tablet_bootstrap.cc:492] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.752810  1268 ts_tablet_manager.cc:1403] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.000s
I20260709 12:56:23.755638  1268 raft_consensus.cc:359] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.756371  1268 raft_consensus.cc:385] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.756784  1268 raft_consensus.cc:740] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.756850   973 catalog_manager.cc:5697] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:23.758299  1267 ts_tablet_manager.cc:1434] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:56:23.757735  1268 consensus_queue.cc:260] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.761626  1268 ts_tablet_manager.cc:1434] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:56:23.762760  1268 tablet_bootstrap.cc:492] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:23.764784  1276 raft_consensus.cc:493] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.765277  1276 raft_consensus.cc:515] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.767539  1276 leader_election.cc:290] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.768628  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.769310  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.769325  1078 raft_consensus.cc:2468] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 0.
I20260709 12:56:23.770008  1227 raft_consensus.cc:2468] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 0.
I20260709 12:56:23.770843  1268 tablet_bootstrap.cc:654] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.770882  1119 leader_election.cc:304] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:23.772250  1276 raft_consensus.cc:2804] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.772701  1276 raft_consensus.cc:493] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:23.773442  1276 raft_consensus.cc:3060] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.780043  1268 tablet_bootstrap.cc:492] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.780521  1268 ts_tablet_manager.cc:1403] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 12:56:23.782618  1270 tablet_bootstrap.cc:492] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.783136  1270 ts_tablet_manager.cc:1403] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.012s
I20260709 12:56:23.782706  1268 raft_consensus.cc:359] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.785663  1270 raft_consensus.cc:359] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.786852  1268 raft_consensus.cc:385] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.786971  1270 raft_consensus.cc:385] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.787222  1268 raft_consensus.cc:740] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.787322  1270 raft_consensus.cc:740] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.786404  1276 raft_consensus.cc:515] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.788035  1268 consensus_queue.cc:260] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.789665  1270 consensus_queue.cc:260] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.790532  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:23.790812  1268 ts_tablet_manager.cc:1434] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:56:23.791065  1227 raft_consensus.cc:3060] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.791687  1270 ts_tablet_manager.cc:1434] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:56:23.791780  1268 tablet_bootstrap.cc:492] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860: Bootstrap starting.
I20260709 12:56:23.792201  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:23.792675  1270 tablet_bootstrap.cc:492] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863: Bootstrap starting.
I20260709 12:56:23.792810  1078 raft_consensus.cc:3060] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.797304  1276 leader_election.cc:290] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.798792  1293 raft_consensus.cc:493] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.799304  1293 raft_consensus.cc:515] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.799969  1270 tablet_bootstrap.cc:654] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.801005  1227 raft_consensus.cc:2468] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 1.
I20260709 12:56:23.801724  1293 leader_election.cc:290] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.802278  1118 leader_election.cc:304] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 
I20260709 12:56:23.803012  1077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.803788  1077 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 0.
I20260709 12:56:23.804133  1288 raft_consensus.cc:2804] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:23.804728  1288 raft_consensus.cc:697] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Becoming Leader. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:23.805176  1193 leader_election.cc:304] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:23.805482  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.805691  1288 consensus_queue.cc:237] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.806207  1152 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 0.
I20260709 12:56:23.807973  1078 raft_consensus.cc:2468] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 1.
I20260709 12:56:23.806207  1293 raft_consensus.cc:2804] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.809947  1293 raft_consensus.cc:493] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:23.810421  1293 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.812183  1268 tablet_bootstrap.cc:654] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:23.812827  1276 consensus_queue.cc:1048] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:23.831245  1293 raft_consensus.cc:515] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.839205  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:23.839967  1078 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.842482  1293 leader_election.cc:290] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:23.841437   974 catalog_manager.cc:5697] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:23.844344  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:23.845206  1152 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.849236  1078 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 1.
I20260709 12:56:23.850438  1193 leader_election.cc:304] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:23.851310  1272 raft_consensus.cc:2804] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:23.851787  1272 raft_consensus.cc:697] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:23.852746  1272 consensus_queue.cc:237] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.861303  1270 tablet_bootstrap.cc:492] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863: No bootstrap required, opened a new log
I20260709 12:56:23.861887  1270 ts_tablet_manager.cc:1403] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent bootstrapping tablet: real 0.069s	user 0.034s	sys 0.006s
I20260709 12:56:23.860298  1152 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 1.
I20260709 12:56:23.863173  1268 tablet_bootstrap.cc:492] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860: No bootstrap required, opened a new log
I20260709 12:56:23.863907  1268 ts_tablet_manager.cc:1403] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.029s
I20260709 12:56:23.865376  1270 raft_consensus.cc:359] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.866247  1270 raft_consensus.cc:385] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.866571  1270 raft_consensus.cc:740] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.867326  1270 consensus_queue.cc:260] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.867726  1268 raft_consensus.cc:359] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.868571  1268 raft_consensus.cc:385] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:23.868942  1268 raft_consensus.cc:740] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Initialized, Role: FOLLOWER
I20260709 12:56:23.869711  1268 consensus_queue.cc:260] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.871395  1270 ts_tablet_manager.cc:1434] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:56:23.871738  1268 ts_tablet_manager.cc:1434] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:56:23.874344   973 catalog_manager.cc:5697] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:23.885473  1291 consensus_queue.cc:1048] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:23.888798  1307 raft_consensus.cc:493] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.889336  1307 raft_consensus.cc:515] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.891541  1307 leader_election.cc:290] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.893324  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.894438  1226 raft_consensus.cc:2393] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 718f7071fe17452cb46abd3ed705b860 in current term 1: Already voted for candidate 45b34cfd2e4d4db88ac4eaa456352863 in this term.
I20260709 12:56:23.894297  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.896855  1044 leader_election.cc:304] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 718f7071fe17452cb46abd3ed705b860; no voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:23.897979  1307 raft_consensus.cc:3060] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.904842  1307 raft_consensus.cc:2749] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:23.948419  1307 raft_consensus.cc:493] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.948890  1307 raft_consensus.cc:515] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.950732  1307 leader_election.cc:290] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.951499  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863" is_pre_election: true
I20260709 12:56:23.951730  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.952023  1152 raft_consensus.cc:2468] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 0.
I20260709 12:56:23.952303  1227 raft_consensus.cc:2468] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 0.
I20260709 12:56:23.952747  1291 raft_consensus.cc:493] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.953114  1044 leader_election.cc:304] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:23.953183  1291 raft_consensus.cc:515] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.954535  1307 raft_consensus.cc:2804] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:23.954895  1307 raft_consensus.cc:493] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:23.955214  1307 raft_consensus.cc:3060] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.955853  1291 leader_election.cc:290] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.956102  1077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8cebfe89b34676bbe58074be045245" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.957301  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e8cebfe89b34676bbe58074be045245" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.958007  1227 raft_consensus.cc:2393] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45b34cfd2e4d4db88ac4eaa456352863 in current term 1: Already voted for candidate 718f7071fe17452cb46abd3ed705b860 in this term.
I20260709 12:56:23.958892  1118 leader_election.cc:304] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863; no voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:23.959538  1291 raft_consensus.cc:3060] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.961247  1307 raft_consensus.cc:515] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.963274  1307 leader_election.cc:290] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.963766  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:23.964272  1152 raft_consensus.cc:3060] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.964205  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:23.964840  1227 raft_consensus.cc:3060] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.966049  1291 raft_consensus.cc:2749] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:23.966253  1276 consensus_queue.cc:1048] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:23.969261  1272 consensus_queue.cc:1048] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:23.971139  1152 raft_consensus.cc:2468] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 1.
I20260709 12:56:23.971613  1227 raft_consensus.cc:2468] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 1.
I20260709 12:56:23.972404  1044 leader_election.cc:304] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:23.973328  1307 raft_consensus.cc:2804] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:23.974707  1307 raft_consensus.cc:697] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:23.975697  1307 consensus_queue.cc:237] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:23.981086  1077 raft_consensus.cc:3060] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:23.988062  1293 consensus_queue.cc:1048] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:23.992950  1291 raft_consensus.cc:493] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:23.993445  1291 raft_consensus.cc:515] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:23.995376  1291 leader_election.cc:290] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:23.997244  1076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:23.997535  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:23.999233  1226 raft_consensus.cc:2393] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45b34cfd2e4d4db88ac4eaa456352863 in current term 1: Already voted for candidate 718f7071fe17452cb46abd3ed705b860 in this term.
I20260709 12:56:24.006014  1291 consensus_queue.cc:1048] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:24.007756  1118 leader_election.cc:304] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863; no voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:24.008795  1291 raft_consensus.cc:3060] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:24.017962   976 catalog_manager.cc:5697] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 0 to 1, leader changed from <none> to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:24.020270  1291 raft_consensus.cc:2749] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:24.105850  1291 consensus_queue.cc:1048] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.110698  1291 raft_consensus.cc:493] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:24.111220  1291 raft_consensus.cc:515] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.114873  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "718f7071fe17452cb46abd3ed705b860" is_pre_election: true
I20260709 12:56:24.115638  1078 raft_consensus.cc:2393] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45b34cfd2e4d4db88ac4eaa456352863 in current term 1: Already voted for candidate 3b253bf935f34ff7a68e9899522dd3e5 in this term.
I20260709 12:56:24.118870  1291 leader_election.cc:290] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:24.119804  1291 consensus_queue.cc:1048] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.120085  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5" is_pre_election: true
I20260709 12:56:24.121542  1118 leader_election.cc:304] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863; no voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:24.122277  1291 raft_consensus.cc:3060] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:24.129266  1291 raft_consensus.cc:2749] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:24.186254  1307 consensus_queue.cc:1048] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.196419  1341 consensus_queue.cc:1048] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.211623  1341 consensus_queue.cc:1048] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.222210  1314 consensus_queue.cc:1048] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.244926  1153 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb"
dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
mode: GRACEFUL
new_leader_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:40842
I20260709 12:56:24.245568  1153 raft_consensus.cc:606] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Received request to transfer leadership to TS 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:24.246989  1293 consensus_queue.cc:1048] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.254913  1153 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2"
dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
mode: GRACEFUL
new_leader_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:40842
I20260709 12:56:24.255586  1153 raft_consensus.cc:606] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Received request to transfer leadership to TS 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:24.262506  1293 consensus_queue.cc:1048] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.279354  1226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9072f77ad39480192d363bad64c2476"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
mode: GRACEFUL
new_leader_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:56338
I20260709 12:56:24.279999  1226 raft_consensus.cc:606] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Received request to transfer leadership to TS 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:24.289824  1226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
mode: GRACEFUL
new_leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
 from {username='slave'} at 127.0.0.1:56338
I20260709 12:56:24.290457  1226 raft_consensus.cc:606] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Received request to transfer leadership to TS 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:24.294901  1226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
mode: GRACEFUL
new_leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
 from {username='slave'} at 127.0.0.1:56338
I20260709 12:56:24.295298  1226 raft_consensus.cc:606] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Received request to transfer leadership to TS 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:24.307233  1077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
mode: GRACEFUL
new_leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:37734
I20260709 12:56:24.307806  1077 raft_consensus.cc:606] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Received request to transfer leadership to TS 3b253bf935f34ff7a68e9899522dd3e5
I20260709 12:56:24.327669  1291 consensus_queue.cc:1048] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.338320  1338 consensus_queue.cc:1048] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.347721  1291 raft_consensus.cc:993] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863: : Instructing follower 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:24.348125  1338 raft_consensus.cc:1081] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Signalling peer 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:24.349741  1077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:56:24.350317  1077 raft_consensus.cc:493] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:24.350684  1077 raft_consensus.cc:3060] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.356163  1077 raft_consensus.cc:515] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.358978  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:24.359253  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:24.359555  1153 raft_consensus.cc:3055] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:24.359810  1226 raft_consensus.cc:3060] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.359972  1153 raft_consensus.cc:740] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:24.361028  1153 consensus_queue.cc:260] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.362329  1153 raft_consensus.cc:3060] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.364949  1077 leader_election.cc:290] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:24.367720  1226 raft_consensus.cc:2468] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:24.368851  1043 leader_election.cc:304] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:24.369216  1153 raft_consensus.cc:2468] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:24.369511  1314 raft_consensus.cc:2804] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:24.369993  1314 raft_consensus.cc:697] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:24.370764  1314 consensus_queue.cc:237] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.376996   974 catalog_manager.cc:5697] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 1 to 2, leader changed from 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194) to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:24.423285  1293 consensus_queue.cc:1048] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.429570  1272 raft_consensus.cc:993] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5: : Instructing follower 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:24.430027  1299 raft_consensus.cc:1081] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Signalling peer 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:24.432133  1293 consensus_queue.cc:1048] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:24.434566  1078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9072f77ad39480192d363bad64c2476"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:37710
I20260709 12:56:24.436252  1078 raft_consensus.cc:493] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:24.436774  1078 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.447255  1078 raft_consensus.cc:515] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.448289  1314 consensus_queue.cc:1048] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:24.454785  1078 leader_election.cc:290] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:24.454404  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:24.455894  1153 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.457980  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:24.458755  1227 raft_consensus.cc:3055] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:24.459280  1227 raft_consensus.cc:740] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:24.460624  1227 consensus_queue.cc:260] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.462423  1227 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.467793  1153 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:24.469516  1341 raft_consensus.cc:993] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860: : Instructing follower 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:24.469448  1044 leader_election.cc:304] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:24.470129  1341 raft_consensus.cc:1081] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Signalling peer 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:24.473233  1341 raft_consensus.cc:2804] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:24.476184  1226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:56328
I20260709 12:56:24.477152  1226 raft_consensus.cc:493] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:24.477741  1226 raft_consensus.cc:3060] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.502808  1291 raft_consensus.cc:993] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863: : Instructing follower 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:24.503439  1338 raft_consensus.cc:1081] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Signalling peer 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:24.504418  1227 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:24.504349  1307 consensus_queue.cc:1048] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:24.505519  1078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:56:24.505745  1341 raft_consensus.cc:697] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:24.506296  1078 raft_consensus.cc:493] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:24.506836  1078 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.512552  1341 consensus_queue.cc:237] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.514508  1078 raft_consensus.cc:515] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.516285  1226 raft_consensus.cc:515] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.518685  1225 raft_consensus.cc:1240] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Rejecting Update request from peer 718f7071fe17452cb46abd3ed705b860 for earlier term 1. Current term is 2. Ops: []
I20260709 12:56:24.520274  1078 leader_election.cc:290] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:24.520124  1227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:24.521315  1227 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.524261  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:24.525166  1078 raft_consensus.cc:3055] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:24.520072  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:24.526047  1152 raft_consensus.cc:3055] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:24.525712  1078 raft_consensus.cc:740] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:24.526523  1152 raft_consensus.cc:740] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:24.527894  1152 consensus_queue.cc:260] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.530138  1152 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.530407  1307 consensus_queue.cc:1059] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:24.534189  1151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a6d66216044b54bd9922b4b2f3113c" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:24.535142  1151 raft_consensus.cc:3060] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.541656  1078 consensus_queue.cc:260] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.543367  1272 raft_consensus.cc:993] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5: : Instructing follower 45b34cfd2e4d4db88ac4eaa456352863 to start an election
I20260709 12:56:24.543488  1227 raft_consensus.cc:2468] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:24.544101  1272 raft_consensus.cc:1081] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Signalling peer 45b34cfd2e4d4db88ac4eaa456352863 to start an election
I20260709 12:56:24.545097  1043 leader_election.cc:304] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:24.546340  1307 raft_consensus.cc:2804] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:24.546931  1226 leader_election.cc:290] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 2 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:24.547026  1307 raft_consensus.cc:697] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:24.547390  1153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49"
dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
 from {username='slave'} at 127.0.0.1:40818
I20260709 12:56:24.548184  1153 raft_consensus.cc:493] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:24.548774  1153 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.548391  1307 consensus_queue.cc:237] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.549410  1078 raft_consensus.cc:3060] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.552435  1151 raft_consensus.cc:2468] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 2.
I20260709 12:56:24.527944   973 catalog_manager.cc:5697] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 1 to 2, leader changed from 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195) to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:24.552587  1152 raft_consensus.cc:2468] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:24.557981  1193 leader_election.cc:304] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 
I20260709 12:56:24.559373  1293 raft_consensus.cc:2804] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:24.560094  1293 raft_consensus.cc:697] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 LEADER]: Becoming Leader. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:24.561378  1293 consensus_queue.cc:237] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.562213  1153 raft_consensus.cc:515] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.566591  1153 leader_election.cc:290] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 2 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:24.567080  1077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:24.567883  1077 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.573583  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:24.574380  1226 raft_consensus.cc:3055] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:24.574841  1226 raft_consensus.cc:740] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:24.576162  1226 consensus_queue.cc:260] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.577950  1226 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.578939  1077 raft_consensus.cc:2468] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 2.
I20260709 12:56:24.580693  1119 leader_election.cc:304] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:24.581641  1078 raft_consensus.cc:2468] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 2.
I20260709 12:56:24.581881  1338 raft_consensus.cc:2804] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:24.579231   973 catalog_manager.cc:5697] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 reported cstate change: term changed from 1 to 2, leader changed from 718f7071fe17452cb46abd3ed705b860 (127.0.107.193) to 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:24.582551  1338 raft_consensus.cc:697] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 LEADER]: Becoming Leader. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
W20260709 12:56:24.584396  1341 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:56:24.583832  1338 consensus_queue.cc:237] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.587529  1226 raft_consensus.cc:2468] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 2.
I20260709 12:56:24.596055   976 catalog_manager.cc:5697] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 1 to 2, leader changed from 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194) to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:24.601667   973 catalog_manager.cc:5697] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 reported cstate change: term changed from 1 to 2, leader changed from 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195) to 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:24.796581  1272 raft_consensus.cc:993] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5: : Instructing follower 45b34cfd2e4d4db88ac4eaa456352863 to start an election
I20260709 12:56:24.797260  1293 raft_consensus.cc:1081] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Signalling peer 45b34cfd2e4d4db88ac4eaa456352863 to start an election
I20260709 12:56:24.799505  1152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5"
dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
 from {username='slave'} at 127.0.0.1:40818
I20260709 12:56:24.800311  1152 raft_consensus.cc:493] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:24.800882  1152 raft_consensus.cc:3060] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.809939  1152 raft_consensus.cc:515] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.812067  1152 leader_election.cc:290] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 2 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:24.812719  1077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:24.813289  1077 raft_consensus.cc:3060] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.813206  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c017b10905b4ee7817fc66f10eddbe5" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:24.814049  1226 raft_consensus.cc:3055] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:24.814401  1226 raft_consensus.cc:740] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:24.815189  1226 consensus_queue.cc:260] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.816262  1226 raft_consensus.cc:3060] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:24.818797  1077 raft_consensus.cc:2468] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 2.
I20260709 12:56:24.820135  1119 leader_election.cc:304] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:24.821270  1338 raft_consensus.cc:2804] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:24.821774  1338 raft_consensus.cc:697] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 LEADER]: Becoming Leader. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:24.822723  1338 consensus_queue.cc:237] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:24.823449  1226 raft_consensus.cc:2468] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 2.
I20260709 12:56:24.831933   973 catalog_manager.cc:5697] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 reported cstate change: term changed from 1 to 2, leader changed from 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195) to 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:24.871666  1226 raft_consensus.cc:1275] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:24.873111  1341 consensus_queue.cc:1048] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:24.883422  1152 raft_consensus.cc:1275] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:24.884872  1307 consensus_queue.cc:1048] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:24.901683  1152 raft_consensus.cc:1275] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:24.902976  1307 consensus_queue.cc:1048] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:24.912498  1226 raft_consensus.cc:1275] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:24.915665  1358 consensus_queue.cc:1048] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:24.980770  1152 raft_consensus.cc:1275] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Refusing update from remote peer 3b253bf935f34ff7a68e9899522dd3e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:24.982306  1293 consensus_queue.cc:1048] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:24.991885  1077 raft_consensus.cc:1275] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Refusing update from remote peer 3b253bf935f34ff7a68e9899522dd3e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:24.993391  1293 consensus_queue.cc:1048] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:25.052903  1152 raft_consensus.cc:1275] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:25.054136  1358 consensus_queue.cc:1048] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:25.062247  1226 raft_consensus.cc:1275] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:25.064087  1341 consensus_queue.cc:1048] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:25.096108  1226 raft_consensus.cc:1275] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Refusing update from remote peer 45b34cfd2e4d4db88ac4eaa456352863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:25.097348  1338 consensus_queue.cc:1048] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:25.108220  1077 raft_consensus.cc:1275] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Refusing update from remote peer 45b34cfd2e4d4db88ac4eaa456352863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:25.110495  1276 consensus_queue.cc:1048] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:25.223448  1077 raft_consensus.cc:1275] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Refusing update from remote peer 45b34cfd2e4d4db88ac4eaa456352863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:25.224759  1276 consensus_queue.cc:1048] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:25.232184  1227 raft_consensus.cc:1275] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Refusing update from remote peer 45b34cfd2e4d4db88ac4eaa456352863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:25.234016  1365 consensus_queue.cc:1048] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:27.337499   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:56:27.338477   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:27.357002  1078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
mode: GRACEFUL
new_leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:37748
I20260709 12:56:27.357916  1078 raft_consensus.cc:606] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Received request to transfer leadership to TS 3b253bf935f34ff7a68e9899522dd3e5
I20260709 12:56:27.360884  1078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9072f77ad39480192d363bad64c2476"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
mode: GRACEFUL
new_leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:37748
I20260709 12:56:27.361328  1078 raft_consensus.cc:606] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Received request to transfer leadership to TS 3b253bf935f34ff7a68e9899522dd3e5
I20260709 12:56:27.362317   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:56:27.362789   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:27.383561  1369 raft_consensus.cc:993] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860: : Instructing follower 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:27.384090  1374 raft_consensus.cc:1081] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Signalling peer 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:27.385684  1225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9072f77ad39480192d363bad64c2476"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:56328
I20260709 12:56:27.386162  1225 raft_consensus.cc:493] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:27.386476  1225 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:27.391836  1225 raft_consensus.cc:515] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:27.393790  1225 leader_election.cc:290] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 3 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:27.394573  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:27.395153  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:27.395409  1078 raft_consensus.cc:3055] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:27.395700  1152 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:27.395802  1078 raft_consensus.cc:740] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:27.396943  1078 consensus_queue.cc:260] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:27.398396  1078 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:27.401120  1152 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 3.
I20260709 12:56:27.402401  1193 leader_election.cc:304] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 
I20260709 12:56:27.403210  1368 raft_consensus.cc:2804] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:27.404351  1368 raft_consensus.cc:697] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Becoming Leader. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:27.405354  1368 consensus_queue.cc:237] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:27.406150  1078 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 3.
I20260709 12:56:27.412880   976 catalog_manager.cc:5697] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 reported cstate change: term changed from 2 to 3, leader changed from 718f7071fe17452cb46abd3ed705b860 (127.0.107.193) to 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:27.475847  1369 raft_consensus.cc:993] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860: : Instructing follower 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:27.476307  1374 raft_consensus.cc:1081] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Signalling peer 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:27.477645  1225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:56328
I20260709 12:56:27.478111  1225 raft_consensus.cc:493] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:27.478471  1225 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:27.483521  1225 raft_consensus.cc:515] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:27.485131  1225 leader_election.cc:290] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 3 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:27.485929  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:27.486166  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:27.486441  1078 raft_consensus.cc:3055] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:27.486702  1152 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:27.486816  1078 raft_consensus.cc:740] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:27.487748  1078 consensus_queue.cc:260] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:27.488929  1078 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:27.491755  1152 raft_consensus.cc:2468] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 3.
I20260709 12:56:27.492724  1193 leader_election.cc:304] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 
I20260709 12:56:27.493376  1368 raft_consensus.cc:2804] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:27.493613  1078 raft_consensus.cc:2468] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 3.
I20260709 12:56:27.493752  1368 raft_consensus.cc:697] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Becoming Leader. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:27.494706  1368 consensus_queue.cc:237] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:27.501030   976 catalog_manager.cc:5697] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 reported cstate change: term changed from 2 to 3, leader changed from 718f7071fe17452cb46abd3ed705b860 (127.0.107.193) to 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:27.830844  1078 raft_consensus.cc:1275] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Refusing update from remote peer 3b253bf935f34ff7a68e9899522dd3e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:27.831941  1368 consensus_queue.cc:1048] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:27.846012  1152 raft_consensus.cc:1275] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Refusing update from remote peer 3b253bf935f34ff7a68e9899522dd3e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:27.847594  1368 consensus_queue.cc:1048] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:27.936012  1152 raft_consensus.cc:1275] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Refusing update from remote peer 3b253bf935f34ff7a68e9899522dd3e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:27.937243  1368 consensus_queue.cc:1048] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:27.945956  1078 raft_consensus.cc:1275] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Refusing update from remote peer 3b253bf935f34ff7a68e9899522dd3e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:27.947618  1388 consensus_queue.cc:1048] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:28.363612   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:28.376389  1225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
mode: GRACEFUL
new_leader_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:56338
I20260709 12:56:28.376992  1225 raft_consensus.cc:606] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Received request to transfer leadership to TS 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:28.386132  1225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9072f77ad39480192d363bad64c2476"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
mode: GRACEFUL
new_leader_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:56338
I20260709 12:56:28.386617  1225 raft_consensus.cc:606] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Received request to transfer leadership to TS 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:28.390636  1152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c"
dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
mode: GRACEFUL
new_leader_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:40842
I20260709 12:56:28.391117  1152 raft_consensus.cc:606] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Received request to transfer leadership to TS 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:28.395247  1152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0099362892064a75bcad7f83433f00d4"
dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
mode: GRACEFUL
new_leader_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:40842
I20260709 12:56:28.395704  1152 raft_consensus.cc:606] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Received request to transfer leadership to TS 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:28.400688  1152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49"
dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
mode: GRACEFUL
new_leader_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:40842
I20260709 12:56:28.401153  1152 raft_consensus.cc:606] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 LEADER]: Received request to transfer leadership to TS 718f7071fe17452cb46abd3ed705b860
I20260709 12:56:28.503896  1368 raft_consensus.cc:993] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5: : Instructing follower 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.504472  1375 raft_consensus.cc:1081] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Signalling peer 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.506150  1078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:37710
I20260709 12:56:28.506690  1078 raft_consensus.cc:493] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:28.507032  1078 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:28.597491  1078 raft_consensus.cc:515] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.599802  1078 leader_election.cc:290] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 4 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:28.600883  1225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:28.600874  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad029edc95b42efb337a8729eb7e5bb" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:28.601640  1225 raft_consensus.cc:3055] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:28.601687  1152 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:28.602103  1225 raft_consensus.cc:740] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:28.602941  1225 consensus_queue.cc:260] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.604122  1225 raft_consensus.cc:3060] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:28.609592  1371 raft_consensus.cc:993] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863: : Instructing follower 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.610175  1390 raft_consensus.cc:1081] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 LEADER]: Signalling peer 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.611656  1078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:56:28.612203  1078 raft_consensus.cc:493] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:28.612465  1078 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:28.691664  1152 raft_consensus.cc:2468] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 4.
I20260709 12:56:28.691664  1225 raft_consensus.cc:2468] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 4.
I20260709 12:56:28.692436  1078 raft_consensus.cc:515] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.693499  1044 leader_election.cc:304] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:28.694242  1390 raft_consensus.cc:993] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863: : Instructing follower 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.694355  1374 raft_consensus.cc:2804] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:28.694942  1390 raft_consensus.cc:1081] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Signalling peer 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.695027  1078 leader_election.cc:290] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 3 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:28.696098  1225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:28.696682  1225 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:28.697124  1078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0099362892064a75bcad7f83433f00d4"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:56:28.697605  1078 raft_consensus.cc:493] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:28.697945  1078 raft_consensus.cc:3060] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:28.698357  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:28.698920  1152 raft_consensus.cc:3055] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:28.699254  1152 raft_consensus.cc:740] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:28.699966  1374 raft_consensus.cc:697] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 4 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:28.700172  1152 consensus_queue.cc:260] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.700966  1374 consensus_queue.cc:237] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.701485  1152 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:28.707566   974 catalog_manager.cc:5697] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 3 to 4, leader changed from 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195) to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:28.773021  1371 raft_consensus.cc:993] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863: : Instructing follower 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.773445  1390 raft_consensus.cc:1081] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Signalling peer 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.774852  1077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:56:28.775312  1077 raft_consensus.cc:493] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:28.775616  1077 raft_consensus.cc:3060] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:28.793499  1152 raft_consensus.cc:2468] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 3.
I20260709 12:56:28.794848  1044 leader_election.cc:304] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:28.793499  1225 raft_consensus.cc:2468] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 3.
I20260709 12:56:28.796165  1374 raft_consensus.cc:2804] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:28.796705  1374 raft_consensus.cc:697] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 3 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:28.793545  1078 raft_consensus.cc:515] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.797751  1374 consensus_queue.cc:237] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.798524  1078 leader_election.cc:290] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:28.802109  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099362892064a75bcad7f83433f00d4" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:28.802757  1226 raft_consensus.cc:3060] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:28.804502  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099362892064a75bcad7f83433f00d4" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:28.805409  1152 raft_consensus.cc:3055] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:28.805647  1152 raft_consensus.cc:740] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:28.806295  1152 consensus_queue.cc:260] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.807292  1152 raft_consensus.cc:3060] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:28.808696   974 catalog_manager.cc:5697] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 2 to 3, leader changed from 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194) to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:28.825793  1368 raft_consensus.cc:993] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5: : Instructing follower 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.826213  1375 raft_consensus.cc:1081] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Signalling peer 718f7071fe17452cb46abd3ed705b860 to start an election
I20260709 12:56:28.827445  1078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9072f77ad39480192d363bad64c2476"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
 from {username='slave'} at 127.0.0.1:37710
I20260709 12:56:28.827850  1078 raft_consensus.cc:493] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:28.828110  1078 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:28.897951  1226 raft_consensus.cc:2468] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:28.897863  1077 raft_consensus.cc:515] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.899125  1152 raft_consensus.cc:2468] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:28.899560  1043 leader_election.cc:304] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:28.901132  1391 raft_consensus.cc:2804] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:28.901335  1077 leader_election.cc:290] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:28.901599  1391 raft_consensus.cc:697] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:28.901999  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:28.902555  1152 raft_consensus.cc:3055] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:28.902614  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846b3cd9925547f88c8ad23543e4415c" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:28.903045  1152 raft_consensus.cc:740] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:28.902510  1391 consensus_queue.cc:237] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.903258  1226 raft_consensus.cc:3060] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:28.904559  1152 consensus_queue.cc:260] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.905946  1152 raft_consensus.cc:3060] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:28.911769   974 catalog_manager.cc:5697] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 1 to 2, leader changed from 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194) to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:28.993721  1152 raft_consensus.cc:2468] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:28.993762  1226 raft_consensus.cc:2468] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 2.
I20260709 12:56:28.993752  1078 raft_consensus.cc:515] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.995056  1044 leader_election.cc:304] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:28.995954  1078 leader_election.cc:290] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 4 election: Requested vote from peers 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:28.996790  1391 raft_consensus.cc:2804] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:28.997380  1391 raft_consensus.cc:697] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:28.997550  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:28.997566  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "718f7071fe17452cb46abd3ed705b860" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:28.998806  1226 raft_consensus.cc:3055] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:28.999411  1226 raft_consensus.cc:740] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:28.999039  1391 consensus_queue.cc:237] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:29.000237  1226 consensus_queue.cc:260] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:28.998806  1152 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:29.001407  1226 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:29.010931   974 catalog_manager.cc:5697] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 1 to 2, leader changed from 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194) to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:29.077016  1152 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 4.
I20260709 12:56:29.077016  1226 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 718f7071fe17452cb46abd3ed705b860 in term 4.
I20260709 12:56:29.078652  1044 leader_election.cc:304] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:29.079602  1391 raft_consensus.cc:2804] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:29.080116  1391 raft_consensus.cc:697] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 4 LEADER]: Becoming Leader. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:29.080964  1391 consensus_queue.cc:237] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:29.087069   974 catalog_manager.cc:5697] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 reported cstate change: term changed from 3 to 4, leader changed from 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195) to 718f7071fe17452cb46abd3ed705b860 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "718f7071fe17452cb46abd3ed705b860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:29.098611  1152 raft_consensus.cc:1275] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:29.099766  1391 consensus_queue.cc:1048] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:29.118202  1226 raft_consensus.cc:1275] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:29.123063  1391 consensus_queue.cc:1048] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:29.238219  1226 raft_consensus.cc:1275] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:29.239354  1391 consensus_queue.cc:1048] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:29.248795  1153 raft_consensus.cc:1275] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:29.250300  1401 consensus_queue.cc:1048] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:29.342922  1153 raft_consensus.cc:1275] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:29.344189  1391 consensus_queue.cc:1048] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:29.353749  1226 raft_consensus.cc:1275] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:29.354983  1401 consensus_queue.cc:1048] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:29.464439  1153 raft_consensus.cc:1275] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:29.465562  1401 consensus_queue.cc:1048] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:29.473505  1226 raft_consensus.cc:1275] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:29.475353  1401 consensus_queue.cc:1048] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:29.502879  1226 raft_consensus.cc:1275] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:29.504000  1401 consensus_queue.cc:1048] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:29.512523  1153 raft_consensus.cc:1275] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Refusing update from remote peer 718f7071fe17452cb46abd3ed705b860: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:29.514014  1404 consensus_queue.cc:1048] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:31.407562   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:31.415581  1078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
mode: GRACEFUL
new_leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
 from {username='slave'} at 127.0.0.1:37748
I20260709 12:56:31.416002  1078 raft_consensus.cc:606] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 3 LEADER]: Received request to transfer leadership to TS 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:31.418098  1078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
mode: GRACEFUL
new_leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:37748
I20260709 12:56:31.418473  1078 raft_consensus.cc:606] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Received request to transfer leadership to TS 3b253bf935f34ff7a68e9899522dd3e5
I20260709 12:56:31.420584  1078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
mode: GRACEFUL
new_leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
 from {username='slave'} at 127.0.0.1:37748
I20260709 12:56:31.420995  1078 raft_consensus.cc:606] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Received request to transfer leadership to TS 45b34cfd2e4d4db88ac4eaa456352863
I20260709 12:56:31.422827  1078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9072f77ad39480192d363bad64c2476"
dest_uuid: "718f7071fe17452cb46abd3ed705b860"
mode: GRACEFUL
new_leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:37748
I20260709 12:56:31.423194  1078 raft_consensus.cc:606] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 4 LEADER]: Received request to transfer leadership to TS 3b253bf935f34ff7a68e9899522dd3e5
I20260709 12:56:31.424038   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:56:31.424468   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:31.446148  1401 raft_consensus.cc:993] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860: : Instructing follower 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:31.446645  1415 raft_consensus.cc:1081] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Signalling peer 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:31.447995  1226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:56328
I20260709 12:56:31.448572  1226 raft_consensus.cc:493] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:31.448941  1226 raft_consensus.cc:3060] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:31.454658  1226 raft_consensus.cc:515] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:31.456053  1226 leader_election.cc:290] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 2 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:31.456707  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:31.457219  1078 raft_consensus.cc:3055] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:31.457252  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeab2e6ed17483db4a6a5fda2e86726" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:31.457634  1078 raft_consensus.cc:740] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:31.457921  1152 raft_consensus.cc:3060] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:31.458436  1078 consensus_queue.cc:260] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:31.459674  1078 raft_consensus.cc:3060] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:31.462371  1152 raft_consensus.cc:2468] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 2.
I20260709 12:56:31.463248  1193 leader_election.cc:304] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 
I20260709 12:56:31.463867  1078 raft_consensus.cc:2468] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 2.
I20260709 12:56:31.464007  1375 raft_consensus.cc:2804] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:31.465013  1375 raft_consensus.cc:697] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 LEADER]: Becoming Leader. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:31.465803  1375 consensus_queue.cc:237] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } }
I20260709 12:56:31.472260   976 catalog_manager.cc:5697] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 reported cstate change: term changed from 1 to 2, leader changed from 718f7071fe17452cb46abd3ed705b860 (127.0.107.193) to 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:31.807826  1401 raft_consensus.cc:993] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860: : Instructing follower 45b34cfd2e4d4db88ac4eaa456352863 to start an election
I20260709 12:56:31.810534  1415 raft_consensus.cc:1081] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Signalling peer 45b34cfd2e4d4db88ac4eaa456352863 to start an election
I20260709 12:56:31.815622  1152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2"
dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
 from {username='slave'} at 127.0.0.1:40832
I20260709 12:56:31.817216  1152 raft_consensus.cc:493] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:31.818209  1152 raft_consensus.cc:3060] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:31.844913  1152 raft_consensus.cc:515] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:31.853137  1152 leader_election.cc:290] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 3 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:31.858853  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:31.858916  1415 raft_consensus.cc:993] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860: : Instructing follower 45b34cfd2e4d4db88ac4eaa456352863 to start an election
I20260709 12:56:31.858916  1226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee261776aaa405095de2df38e2c91b2" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:31.865746  1422 raft_consensus.cc:1081] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 3 LEADER]: Signalling peer 45b34cfd2e4d4db88ac4eaa456352863 to start an election
I20260709 12:56:31.863997  1078 raft_consensus.cc:3055] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:31.868956  1078 raft_consensus.cc:740] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:31.865904  1226 raft_consensus.cc:3060] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:31.874209  1152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49"
dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
 from {username='slave'} at 127.0.0.1:40832
I20260709 12:56:31.875725  1152 raft_consensus.cc:493] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:31.876900  1152 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:31.884479  1078 consensus_queue.cc:260] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:31.888512  1078 raft_consensus.cc:3060] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:31.886147  1401 raft_consensus.cc:993] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860: : Instructing follower 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:31.894300  1422 raft_consensus.cc:1081] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 4 LEADER]: Signalling peer 3b253bf935f34ff7a68e9899522dd3e5 to start an election
I20260709 12:56:31.906272  1225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9072f77ad39480192d363bad64c2476"
dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
 from {username='slave'} at 127.0.0.1:56328
I20260709 12:56:31.910020  1225 raft_consensus.cc:493] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:31.915746  1225 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:31.917377  1152 raft_consensus.cc:515] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:31.920099  1078 raft_consensus.cc:2468] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 3.
I20260709 12:56:31.925292  1119 leader_election.cc:304] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b34cfd2e4d4db88ac4eaa456352863, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:31.930296  1390 raft_consensus.cc:2804] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:31.928052  1152 leader_election.cc:290] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 4 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195:35609)
I20260709 12:56:31.938205  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:31.938221  1224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7256e50637b84a8baa7e1699e10abf49" candidate_uuid: "45b34cfd2e4d4db88ac4eaa456352863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3b253bf935f34ff7a68e9899522dd3e5"
I20260709 12:56:31.938879  1226 raft_consensus.cc:2468] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 3.
I20260709 12:56:31.939391  1078 raft_consensus.cc:3055] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:31.939436  1224 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:31.940011  1078 raft_consensus.cc:740] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:31.940865  1078 consensus_queue.cc:260] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:31.942114  1078 raft_consensus.cc:3060] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:31.945994  1152 raft_consensus.cc:1275] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Refusing update from remote peer 3b253bf935f34ff7a68e9899522dd3e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.951175  1375 consensus_queue.cc:1048] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:31.951895  1224 raft_consensus.cc:2468] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 4.
I20260709 12:56:31.952498  1390 raft_consensus.cc:697] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 LEADER]: Becoming Leader. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:31.953470  1390 consensus_queue.cc:237] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:31.954254  1078 raft_consensus.cc:2468] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b34cfd2e4d4db88ac4eaa456352863 in term 4.
I20260709 12:56:31.954604  1118 leader_election.cc:304] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 45b34cfd2e4d4db88ac4eaa456352863; no voters: 
I20260709 12:56:31.957942  1424 raft_consensus.cc:2804] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:31.959143  1424 raft_consensus.cc:697] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 LEADER]: Becoming Leader. State: Replica: 45b34cfd2e4d4db88ac4eaa456352863, State: Running, Role: LEADER
I20260709 12:56:31.963316  1225 raft_consensus.cc:515] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:31.963160  1424 consensus_queue.cc:237] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:31.968376  1078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "718f7071fe17452cb46abd3ed705b860"
I20260709 12:56:31.969048  1078 raft_consensus.cc:3055] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:56:31.969528  1078 raft_consensus.cc:740] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 718f7071fe17452cb46abd3ed705b860, State: Running, Role: LEADER
I20260709 12:56:31.970463  1078 consensus_queue.cc:260] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:31.971594  1078 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:31.975314   976 catalog_manager.cc:5697] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 reported cstate change: term changed from 2 to 3, leader changed from 718f7071fe17452cb46abd3ed705b860 (127.0.107.193) to 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:31.977896  1077 raft_consensus.cc:1275] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Refusing update from remote peer 3b253bf935f34ff7a68e9899522dd3e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.979547  1225 leader_election.cc:290] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 5 election: Requested vote from peers 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963), 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305)
I20260709 12:56:31.979612  1375 consensus_queue.cc:1048] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:31.982502  1153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9072f77ad39480192d363bad64c2476" candidate_uuid: "3b253bf935f34ff7a68e9899522dd3e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "45b34cfd2e4d4db88ac4eaa456352863"
I20260709 12:56:31.983114  1153 raft_consensus.cc:3060] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:31.993899  1078 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 5.
I20260709 12:56:31.995052  1193 leader_election.cc:304] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b253bf935f34ff7a68e9899522dd3e5, 718f7071fe17452cb46abd3ed705b860; no voters: 
I20260709 12:56:31.996130  1375 raft_consensus.cc:2804] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:56:31.996673  1375 raft_consensus.cc:697] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 5 LEADER]: Becoming Leader. State: Replica: 3b253bf935f34ff7a68e9899522dd3e5, State: Running, Role: LEADER
I20260709 12:56:31.997498  1375 consensus_queue.cc:237] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } }
I20260709 12:56:31.999542  1153 raft_consensus.cc:2468] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b253bf935f34ff7a68e9899522dd3e5 in term 5.
I20260709 12:56:32.011649   974 catalog_manager.cc:5697] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 reported cstate change: term changed from 3 to 4, leader changed from 718f7071fe17452cb46abd3ed705b860 (127.0.107.193) to 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "45b34cfd2e4d4db88ac4eaa456352863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:32.013471   973 catalog_manager.cc:5697] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 reported cstate change: term changed from 4 to 5, leader changed from 718f7071fe17452cb46abd3ed705b860 (127.0.107.193) to 3b253bf935f34ff7a68e9899522dd3e5 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "3b253bf935f34ff7a68e9899522dd3e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "718f7071fe17452cb46abd3ed705b860" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:32.425309   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:32.431200   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:56:32.436198  1225 raft_consensus.cc:1275] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Refusing update from remote peer 45b34cfd2e4d4db88ac4eaa456352863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:32.438992  1424 consensus_queue.cc:1048] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:56:32.445506  1193 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:56:32.451617  1193 consensus_peers.cc:597] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 -> Peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Couldn't send request to peer 718f7071fe17452cb46abd3ed705b860. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:56:32.460670  1119 consensus_peers.cc:597] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 -> Peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Couldn't send request to peer 718f7071fe17452cb46abd3ed705b860. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:56:32.465626  1119 consensus_peers.cc:597] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 -> Peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Couldn't send request to peer 718f7071fe17452cb46abd3ed705b860. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:32.485121   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:56:32.485236  1193 consensus_peers.cc:597] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 -> Peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Couldn't send request to peer 718f7071fe17452cb46abd3ed705b860. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:32.485973   431 tablet_replica.cc:333] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
I20260709 12:56:32.486611   431 raft_consensus.cc:2243] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.487345   431 raft_consensus.cc:2272] T 846b3cd9925547f88c8ad23543e4415c P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.489256   431 tablet_replica.cc:333] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
I20260709 12:56:32.489831   431 raft_consensus.cc:2243] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.490227   431 raft_consensus.cc:2272] T d9072f77ad39480192d363bad64c2476 P 718f7071fe17452cb46abd3ed705b860 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.491858   431 tablet_replica.cc:333] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
I20260709 12:56:32.492409   431 raft_consensus.cc:2243] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.493418   431 raft_consensus.cc:2272] T 0099362892064a75bcad7f83433f00d4 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.495692   431 tablet_replica.cc:333] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
I20260709 12:56:32.496493   431 raft_consensus.cc:2243] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.497051   431 raft_consensus.cc:2272] T 2c017b10905b4ee7817fc66f10eddbe5 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.499138   431 tablet_replica.cc:333] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
W20260709 12:56:32.499137  1193 consensus_peers.cc:597] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 -> Peer 718f7071fe17452cb46abd3ed705b860 (127.0.107.193:43963): Couldn't send request to peer 718f7071fe17452cb46abd3ed705b860. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:32.499856   431 raft_consensus.cc:2243] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.500300   431 raft_consensus.cc:2272] T d3a6d66216044b54bd9922b4b2f3113c P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.502065   431 tablet_replica.cc:333] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
I20260709 12:56:32.502583   431 raft_consensus.cc:2243] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.502964   431 raft_consensus.cc:2272] T 7256e50637b84a8baa7e1699e10abf49 P 718f7071fe17452cb46abd3ed705b860 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.504592   431 tablet_replica.cc:333] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
I20260709 12:56:32.505167   431 raft_consensus.cc:2243] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.505942   431 raft_consensus.cc:2272] T 8e8cebfe89b34676bbe58074be045245 P 718f7071fe17452cb46abd3ed705b860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.507707   431 tablet_replica.cc:333] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
I20260709 12:56:32.508320   431 raft_consensus.cc:2243] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.509131   431 raft_consensus.cc:2272] T aad029edc95b42efb337a8729eb7e5bb P 718f7071fe17452cb46abd3ed705b860 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.510804   431 tablet_replica.cc:333] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
I20260709 12:56:32.511258   431 raft_consensus.cc:2243] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.511670   431 raft_consensus.cc:2272] T cee261776aaa405095de2df38e2c91b2 P 718f7071fe17452cb46abd3ed705b860 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.513443   431 tablet_replica.cc:333] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860: stopping tablet replica
I20260709 12:56:32.513861   431 raft_consensus.cc:2243] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.514230   431 raft_consensus.cc:2272] T 7eeab2e6ed17483db4a6a5fda2e86726 P 718f7071fe17452cb46abd3ed705b860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.522639  1153 raft_consensus.cc:1275] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 5 FOLLOWER]: Refusing update from remote peer 3b253bf935f34ff7a68e9899522dd3e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:56:32.524029  1430 consensus_queue.cc:1048] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b34cfd2e4d4db88ac4eaa456352863" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:56:32.538957   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:56:32.559648   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 12:56:32.566816  1193 consensus_peers.cc:597] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 -> Peer 45b34cfd2e4d4db88ac4eaa456352863 (127.0.107.194:46305): Couldn't send request to peer 45b34cfd2e4d4db88ac4eaa456352863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:32.580380  1225 raft_consensus.cc:1275] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Refusing update from remote peer 45b34cfd2e4d4db88ac4eaa456352863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:32.581863  1424 consensus_queue.cc:1048] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b253bf935f34ff7a68e9899522dd3e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:32.589040   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:32.590003   431 tablet_replica.cc:333] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.590737   431 raft_consensus.cc:2243] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.591722   431 raft_consensus.cc:2272] T 2c017b10905b4ee7817fc66f10eddbe5 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.594575   431 tablet_replica.cc:333] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.595131   431 raft_consensus.cc:2243] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.595642   431 raft_consensus.cc:2272] T 7eeab2e6ed17483db4a6a5fda2e86726 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.598346   431 tablet_replica.cc:333] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.598902   431 raft_consensus.cc:2243] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.599227   431 raft_consensus.cc:2272] T 846b3cd9925547f88c8ad23543e4415c P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.600754   431 tablet_replica.cc:333] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.601190   431 raft_consensus.cc:2243] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.601524   431 raft_consensus.cc:2272] T d9072f77ad39480192d363bad64c2476 P 45b34cfd2e4d4db88ac4eaa456352863 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.603399   431 tablet_replica.cc:333] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.603816   431 raft_consensus.cc:2243] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.604128   431 raft_consensus.cc:2272] T 0099362892064a75bcad7f83433f00d4 P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.605702   431 tablet_replica.cc:333] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.606144   431 raft_consensus.cc:2243] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.606519   431 raft_consensus.cc:2272] T 8e8cebfe89b34676bbe58074be045245 P 45b34cfd2e4d4db88ac4eaa456352863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.608166   431 tablet_replica.cc:333] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.608603   431 raft_consensus.cc:2243] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.609333   431 raft_consensus.cc:2272] T 7256e50637b84a8baa7e1699e10abf49 P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.611075   431 tablet_replica.cc:333] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.611519   431 raft_consensus.cc:2243] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.611893   431 raft_consensus.cc:2272] T d3a6d66216044b54bd9922b4b2f3113c P 45b34cfd2e4d4db88ac4eaa456352863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.613436   431 tablet_replica.cc:333] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.613858   431 raft_consensus.cc:2243] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.614521   431 raft_consensus.cc:2272] T cee261776aaa405095de2df38e2c91b2 P 45b34cfd2e4d4db88ac4eaa456352863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.616331   431 tablet_replica.cc:333] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863: stopping tablet replica
I20260709 12:56:32.616816   431 raft_consensus.cc:2243] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.617216   431 raft_consensus.cc:2272] T aad029edc95b42efb337a8729eb7e5bb P 45b34cfd2e4d4db88ac4eaa456352863 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.644512   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:56:32.662177   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:56:32.682817   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:32.683446   431 tablet_replica.cc:333] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.684027   431 raft_consensus.cc:2243] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.684500   431 raft_consensus.cc:2272] T 2c017b10905b4ee7817fc66f10eddbe5 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.686271   431 tablet_replica.cc:333] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.686779   431 raft_consensus.cc:2243] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.687177   431 raft_consensus.cc:2272] T cee261776aaa405095de2df38e2c91b2 P 3b253bf935f34ff7a68e9899522dd3e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.689158   431 tablet_replica.cc:333] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.689627   431 raft_consensus.cc:2243] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.690002   431 raft_consensus.cc:2272] T aad029edc95b42efb337a8729eb7e5bb P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.691462   431 tablet_replica.cc:333] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.691989   431 raft_consensus.cc:2243] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.692369   431 raft_consensus.cc:2272] T 0099362892064a75bcad7f83433f00d4 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.693822   431 tablet_replica.cc:333] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.694281   431 raft_consensus.cc:2243] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.694970   431 raft_consensus.cc:2272] T d9072f77ad39480192d363bad64c2476 P 3b253bf935f34ff7a68e9899522dd3e5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.696986   431 tablet_replica.cc:333] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.697482   431 raft_consensus.cc:2243] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.698159   431 raft_consensus.cc:2272] T d3a6d66216044b54bd9922b4b2f3113c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.699693   431 tablet_replica.cc:333] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.700171   431 raft_consensus.cc:2243] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.700568   431 raft_consensus.cc:2272] T 7256e50637b84a8baa7e1699e10abf49 P 3b253bf935f34ff7a68e9899522dd3e5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.702703   431 tablet_replica.cc:333] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.703245   431 raft_consensus.cc:2243] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.703624   431 raft_consensus.cc:2272] T 8e8cebfe89b34676bbe58074be045245 P 3b253bf935f34ff7a68e9899522dd3e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.705344   431 tablet_replica.cc:333] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.705827   431 raft_consensus.cc:2243] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:32.706231   431 raft_consensus.cc:2272] T 846b3cd9925547f88c8ad23543e4415c P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.707791   431 tablet_replica.cc:333] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5: stopping tablet replica
I20260709 12:56:32.708226   431 raft_consensus.cc:2243] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.709080   431 raft_consensus.cc:2272] T 7eeab2e6ed17483db4a6a5fda2e86726 P 3b253bf935f34ff7a68e9899522dd3e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.736701   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:56:32.754060   431 master.cc:562] Master@127.0.107.254:38933 shutting down...
I20260709 12:56:32.770995   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:56:32.771569   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:32.771982   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 360f44d25b514ef2892e88bf6685c657: stopping tablet replica
I20260709 12:56:32.791095   431 master.cc:584] Master@127.0.107.254:38933 shutdown complete.
3b253bf935f34ff7a68e9899522dd3e5  1
45b34cfd2e4d4db88ac4eaa456352863  4
718f7071fe17452cb46abd3ed705b860  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10612 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:56:32.829825   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43765
I20260709 12:56:32.830862   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:32.836525  1445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:32.836565  1446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:32.837275  1448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:32.837822   431 server_base.cc:1061] running on GCE node
I20260709 12:56:32.838546   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:32.838757   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:32.838904   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601792838886 us; error 0 us; skew 500 ppm
I20260709 12:56:32.839383   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:32.841611   431 webserver.cc:533] Webserver started at http://127.0.107.254:42187/ using document root <none> and password file <none>
I20260709 12:56:32.842082   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:32.842275   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:32.842547   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:32.843600   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/master-0-root/instance:
uuid: "ab5bd50f45be44c4afe02e363e8322ae"
format_stamp: "Formatted at 2026-07-09 12:56:32 on dist-test-slave-73vh"
I20260709 12:56:32.847801   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:56:32.850953  1453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:32.851778   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:56:32.851999   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/master-0-root
uuid: "ab5bd50f45be44c4afe02e363e8322ae"
format_stamp: "Formatted at 2026-07-09 12:56:32 on dist-test-slave-73vh"
I20260709 12:56:32.852231   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:32.865200   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:32.866274   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:32.903160   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43765
I20260709 12:56:32.903263  1504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43765 every 8 connection(s)
I20260709 12:56:32.907174  1505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:32.917093  1505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Bootstrap starting.
I20260709 12:56:32.921504  1505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:32.925496  1505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: No bootstrap required, opened a new log
I20260709 12:56:32.927592  1505 raft_consensus.cc:359] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5bd50f45be44c4afe02e363e8322ae" member_type: VOTER }
I20260709 12:56:32.927973  1505 raft_consensus.cc:385] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:32.928196  1505 raft_consensus.cc:740] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab5bd50f45be44c4afe02e363e8322ae, State: Initialized, Role: FOLLOWER
I20260709 12:56:32.928830  1505 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5bd50f45be44c4afe02e363e8322ae" member_type: VOTER }
I20260709 12:56:32.929404  1505 raft_consensus.cc:399] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:56:32.929629  1505 raft_consensus.cc:493] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:56:32.929891  1505 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:32.933852  1505 raft_consensus.cc:515] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5bd50f45be44c4afe02e363e8322ae" member_type: VOTER }
I20260709 12:56:32.934345  1505 leader_election.cc:304] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab5bd50f45be44c4afe02e363e8322ae; no voters: 
I20260709 12:56:32.935405  1505 leader_election.cc:290] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:56:32.935685  1508 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:32.937090  1508 raft_consensus.cc:697] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 1 LEADER]: Becoming Leader. State: Replica: ab5bd50f45be44c4afe02e363e8322ae, State: Running, Role: LEADER
I20260709 12:56:32.937757  1508 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5bd50f45be44c4afe02e363e8322ae" member_type: VOTER }
I20260709 12:56:32.938354  1505 sys_catalog.cc:565] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:56:32.942747  1509 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab5bd50f45be44c4afe02e363e8322ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5bd50f45be44c4afe02e363e8322ae" member_type: VOTER } }
I20260709 12:56:32.942813  1510 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab5bd50f45be44c4afe02e363e8322ae. Latest consensus state: current_term: 1 leader_uuid: "ab5bd50f45be44c4afe02e363e8322ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab5bd50f45be44c4afe02e363e8322ae" member_type: VOTER } }
I20260709 12:56:32.943635  1510 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:32.943584  1509 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:32.946656  1515 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:56:32.951324  1515 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:56:32.954689   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:56:32.960188  1515 catalog_manager.cc:1383] Generated new cluster ID: a5908cc15f4e4fbca11c9f2d156a2791
I20260709 12:56:32.960476  1515 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:56:32.973981  1515 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:56:32.975248  1515 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:56:32.992594  1515 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Generated new TSK 0
I20260709 12:56:32.993242  1515 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:56:33.021497   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:33.027292  1526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:33.028936  1527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:33.031927  1529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:33.032833   431 server_base.cc:1061] running on GCE node
I20260709 12:56:33.034252   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:33.034442   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:33.034570   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601793034559 us; error 0 us; skew 500 ppm
I20260709 12:56:33.035041   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:33.037282   431 webserver.cc:533] Webserver started at http://127.0.107.193:45375/ using document root <none> and password file <none>
I20260709 12:56:33.037704   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:33.037858   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:33.038062   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:33.039050   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/instance:
uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
format_stamp: "Formatted at 2026-07-09 12:56:33 on dist-test-slave-73vh"
I20260709 12:56:33.043608   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:56:33.046631  1534 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:33.047369   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:56:33.047640   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
format_stamp: "Formatted at 2026-07-09 12:56:33 on dist-test-slave-73vh"
I20260709 12:56:33.047890   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:33.068395   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:33.069677   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:33.071143   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:33.073402   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:33.073585   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:33.073858   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:33.074011   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:33.117599   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39997
I20260709 12:56:33.117727  1596 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39997 every 8 connection(s)
I20260709 12:56:33.122443   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:33.129923  1602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:33.131340  1601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:33.132200  1604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:33.132567   431 server_base.cc:1061] running on GCE node
I20260709 12:56:33.133808   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:33.133991   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:33.134150   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601793134134 us; error 0 us; skew 500 ppm
I20260709 12:56:33.134583   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:33.136919   431 webserver.cc:533] Webserver started at http://127.0.107.194:45261/ using document root <none> and password file <none>
I20260709 12:56:33.137527   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:33.137764   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:33.138078   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:33.139462   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/instance:
uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
format_stamp: "Formatted at 2026-07-09 12:56:33 on dist-test-slave-73vh"
I20260709 12:56:33.139539  1597 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43765
I20260709 12:56:33.139887  1597 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:33.140566  1597 heartbeater.cc:507] Master 127.0.107.254:43765 requested a full tablet report, sending...
I20260709 12:56:33.142650  1470 ts_manager.cc:194] Registered new tserver with Master: 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:56:33.144506   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:56:33.144917  1470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58410
I20260709 12:56:33.148250  1609 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:33.149041   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:56:33.149369   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root
uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
format_stamp: "Formatted at 2026-07-09 12:56:33 on dist-test-slave-73vh"
I20260709 12:56:33.149624   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:33.176635   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:33.177763   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:33.179097   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:33.181317   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:33.181509   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:33.181746   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:33.181905   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:33.219610   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33881
I20260709 12:56:33.219723  1671 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33881 every 8 connection(s)
I20260709 12:56:33.224398   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:33.232034  1675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:33.234072  1676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:33.235841  1672 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43765
I20260709 12:56:33.236382  1672 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:33.237286   431 server_base.cc:1061] running on GCE node
I20260709 12:56:33.237546  1672 heartbeater.cc:507] Master 127.0.107.254:43765 requested a full tablet report, sending...
W20260709 12:56:33.238170  1678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:33.239262   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:33.239542   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:33.239773   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601793239739 us; error 0 us; skew 500 ppm
I20260709 12:56:33.239817  1470 ts_manager.cc:194] Registered new tserver with Master: 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:33.240778   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:33.241935  1470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58424
I20260709 12:56:33.243848   431 webserver.cc:533] Webserver started at http://127.0.107.195:34411/ using document root <none> and password file <none>
I20260709 12:56:33.244375   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:33.244604   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:33.244951   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:33.246122   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/instance:
uuid: "20c9ad12e0d0435f95be2eda5b653b39"
format_stamp: "Formatted at 2026-07-09 12:56:33 on dist-test-slave-73vh"
I20260709 12:56:33.250892   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:56:33.254304  1683 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:33.255098   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:56:33.255394   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root
uuid: "20c9ad12e0d0435f95be2eda5b653b39"
format_stamp: "Formatted at 2026-07-09 12:56:33 on dist-test-slave-73vh"
I20260709 12:56:33.255681   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:33.265990   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:33.267122   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:33.268460   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:33.270680   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:33.270912   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:33.271139   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:33.271306   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:33.309001   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:36649
I20260709 12:56:33.309083  1745 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:36649 every 8 connection(s)
I20260709 12:56:33.322013  1746 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43765
I20260709 12:56:33.322358  1746 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:33.323105  1746 heartbeater.cc:507] Master 127.0.107.254:43765 requested a full tablet report, sending...
I20260709 12:56:33.324911  1470 ts_manager.cc:194] Registered new tserver with Master: 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:33.325258   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013165154s
I20260709 12:56:33.326643  1470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58430
I20260709 12:56:33.350030  1470 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58438:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:56:33.356477  1470 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:56:33.555578  1711 tablet_service.cc:1511] Processing CreateTablet for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:56:33.557106  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.562713  1637 tablet_service.cc:1511] Processing CreateTablet for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:56:33.564093  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.566998  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 65bdb5c7faf24eb08b41f32ba12e1932 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:56:33.567943  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 30729cf665ff46d199eb9632bd1f5ad1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:56:33.568434  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bdb5c7faf24eb08b41f32ba12e1932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.569330  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30729cf665ff46d199eb9632bd1f5ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.576670  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 30729cf665ff46d199eb9632bd1f5ad1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:56:33.578155  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30729cf665ff46d199eb9632bd1f5ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.578342  1708 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaf4486c502440fb4b5bc1ef7cc7256 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:56:33.579664  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaf4486c502440fb4b5bc1ef7cc7256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.581902  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 65bdb5c7faf24eb08b41f32ba12e1932 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:56:33.583247  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bdb5c7faf24eb08b41f32ba12e1932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.585824  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaf4486c502440fb4b5bc1ef7cc7256 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:56:33.587188  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaf4486c502440fb4b5bc1ef7cc7256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.589787  1707 tablet_service.cc:1511] Processing CreateTablet for tablet acc3fcdecc7546fe92075e15e904c331 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:56:33.591224  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3fcdecc7546fe92075e15e904c331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.591671  1628 tablet_service.cc:1511] Processing CreateTablet for tablet b302e4f74a6c4ff2915495d3ac0982bc (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:56:33.592964  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302e4f74a6c4ff2915495d3ac0982bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.593919  1630 tablet_service.cc:1511] Processing CreateTablet for tablet a3e979717db64b77b569522980fab6af (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:56:33.595216  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e979717db64b77b569522980fab6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.597817  1631 tablet_service.cc:1511] Processing CreateTablet for tablet 87fb4f5285564d94ab4d48e9ec00f31b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:56:33.599128  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fb4f5285564d94ab4d48e9ec00f31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.601735  1632 tablet_service.cc:1511] Processing CreateTablet for tablet 27982349e557426eb54944f0699b5f79 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:56:33.602998  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27982349e557426eb54944f0699b5f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.589879  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 39b62689c0094341b01c7263292dd753 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:56:33.605918  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b62689c0094341b01c7263292dd753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.605717  1633 tablet_service.cc:1511] Processing CreateTablet for tablet acc3fcdecc7546fe92075e15e904c331 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:56:33.607014  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3fcdecc7546fe92075e15e904c331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.659891  1628 tablet_service.cc:1511] Processing CreateTablet for tablet 46fb86b9f3304b99a092fa35dffe1813 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:56:33.661242  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46fb86b9f3304b99a092fa35dffe1813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.663582  1632 tablet_service.cc:1511] Processing CreateTablet for tablet c5064e0cc33a4a9383fca6c8ee736c18 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:56:33.668396  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5064e0cc33a4a9383fca6c8ee736c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.671878  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 061154c4edb1414ca27eef7f6a49a794 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:56:33.675436  1762 tablet_bootstrap.cc:492] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:33.676115  1761 tablet_bootstrap.cc:492] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:33.677400  1708 tablet_service.cc:1511] Processing CreateTablet for tablet 27982349e557426eb54944f0699b5f79 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:56:33.678346  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27982349e557426eb54944f0699b5f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.681828  1630 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:56:33.682580  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 87fb4f5285564d94ab4d48e9ec00f31b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:56:33.683774  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fb4f5285564d94ab4d48e9ec00f31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.689716  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 52bc0b3e08ea4bd78b344b833b97faed (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:56:33.694837  1706 tablet_service.cc:1511] Processing CreateTablet for tablet a3e979717db64b77b569522980fab6af (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:56:33.696137  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e979717db64b77b569522980fab6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.697816  1705 tablet_service.cc:1511] Processing CreateTablet for tablet 39b62689c0094341b01c7263292dd753 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:56:33.698021  1703 tablet_service.cc:1511] Processing CreateTablet for tablet 46fb86b9f3304b99a092fa35dffe1813 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:56:33.699153  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b62689c0094341b01c7263292dd753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.700043  1631 tablet_service.cc:1511] Processing CreateTablet for tablet a598709808884384ad6ce3e99aa4345a (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:56:33.701195  1702 tablet_service.cc:1511] Processing CreateTablet for tablet c5064e0cc33a4a9383fca6c8ee736c18 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:56:33.701713  1704 tablet_service.cc:1511] Processing CreateTablet for tablet b302e4f74a6c4ff2915495d3ac0982bc (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:56:33.703214  1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5064e0cc33a4a9383fca6c8ee736c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.703310  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061154c4edb1414ca27eef7f6a49a794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.703899  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.704941  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bc0b3e08ea4bd78b344b833b97faed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.705602  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a598709808884384ad6ce3e99aa4345a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.709333  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302e4f74a6c4ff2915495d3ac0982bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.713323  1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46fb86b9f3304b99a092fa35dffe1813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.727875  1707 tablet_service.cc:1511] Processing CreateTablet for tablet 52bc0b3e08ea4bd78b344b833b97faed (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:56:33.729175  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bc0b3e08ea4bd78b344b833b97faed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.735953  1762 tablet_bootstrap.cc:654] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:33.739713  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 075b6c0f44a54d0cb3e8050968db2158 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:56:33.739737  1761 tablet_bootstrap.cc:654] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:33.740759  1632 tablet_service.cc:1511] Processing CreateTablet for tablet 57f5c2cabd34469aa65eff4ffae3e350 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:56:33.741781  1637 tablet_service.cc:1511] Processing CreateTablet for tablet af922e165f0c427eacd26ca4bc111d76 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:56:33.741209  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075b6c0f44a54d0cb3e8050968db2158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.699169  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac8464a8a2c438c8cdaf74b18d51098 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:56:33.733708  1711 tablet_service.cc:1511] Processing CreateTablet for tablet af922e165f0c427eacd26ca4bc111d76 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:56:33.751077  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af922e165f0c427eacd26ca4bc111d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.751232  1630 tablet_service.cc:1511] Processing CreateTablet for tablet 3df7e2e5458047a9a8b0d6a07577bbbe (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:56:33.762176  1631 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed697fc3d1e49f2ac09064ed3b8abc1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:56:33.763661  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af922e165f0c427eacd26ca4bc111d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.764704  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac8464a8a2c438c8cdaf74b18d51098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.766330  1562 tablet_service.cc:1511] Processing CreateTablet for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:56:33.767688  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.768059  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f5c2cabd34469aa65eff4ffae3e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.771935  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 30729cf665ff46d199eb9632bd1f5ad1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:56:33.773859  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 65bdb5c7faf24eb08b41f32ba12e1932 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:56:33.775321  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30729cf665ff46d199eb9632bd1f5ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.778430  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaf4486c502440fb4b5bc1ef7cc7256 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:56:33.780347  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaf4486c502440fb4b5bc1ef7cc7256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.781932  1553 tablet_service.cc:1511] Processing CreateTablet for tablet b302e4f74a6c4ff2915495d3ac0982bc (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:56:33.781898  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 27982349e557426eb54944f0699b5f79 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:56:33.783712  1556 tablet_service.cc:1511] Processing CreateTablet for tablet 87fb4f5285564d94ab4d48e9ec00f31b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:56:33.785653  1555 tablet_service.cc:1511] Processing CreateTablet for tablet a3e979717db64b77b569522980fab6af (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:56:33.787616  1554 tablet_service.cc:1511] Processing CreateTablet for tablet 39b62689c0094341b01c7263292dd753 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:56:33.789734  1558 tablet_service.cc:1511] Processing CreateTablet for tablet acc3fcdecc7546fe92075e15e904c331 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:56:33.790267  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 997bea07114b4964bbe0c9bc9185a7f4 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:56:33.791046  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bdb5c7faf24eb08b41f32ba12e1932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.797150  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:56:33.797727  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302e4f74a6c4ff2915495d3ac0982bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.798517  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.816808  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27982349e557426eb54944f0699b5f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.821012  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fb4f5285564d94ab4d48e9ec00f31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.825738  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 6d01fa5de23643a7bc42ad00178a7f51 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:56:33.827790  1705 tablet_service.cc:1511] Processing CreateTablet for tablet a598709808884384ad6ce3e99aa4345a (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:56:33.822335  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 57f5c2cabd34469aa65eff4ffae3e350 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:56:33.829329  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a598709808884384ad6ce3e99aa4345a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.821470  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df7e2e5458047a9a8b0d6a07577bbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.831712  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997bea07114b4964bbe0c9bc9185a7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.832326  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 061154c4edb1414ca27eef7f6a49a794 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:56:33.833654  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d01fa5de23643a7bc42ad00178a7f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.838470  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed697fc3d1e49f2ac09064ed3b8abc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.849817  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3fcdecc7546fe92075e15e904c331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.851642  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b62689c0094341b01c7263292dd753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.852979  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e979717db64b77b569522980fab6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.857827  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 99331ae0325b4de6bd6d097c96af6d6c (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:56:33.858419  1762 tablet_bootstrap.cc:492] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:33.858908  1762 ts_tablet_manager.cc:1403] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.184s	user 0.011s	sys 0.004s
I20260709 12:56:33.859097  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99331ae0325b4de6bd6d097c96af6d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.866568  1705 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed697fc3d1e49f2ac09064ed3b8abc1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:56:33.867117  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 99331ae0325b4de6bd6d097c96af6d6c (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:56:33.867838  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed697fc3d1e49f2ac09064ed3b8abc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.869760  1762 raft_consensus.cc:359] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:33.870496  1762 raft_consensus.cc:385] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:33.870800  1762 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:33.871661  1762 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:33.873158  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f5c2cabd34469aa65eff4ffae3e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.875808  1765 tablet_bootstrap.cc:492] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:33.882197  1708 tablet_service.cc:1511] Processing CreateTablet for tablet 3df7e2e5458047a9a8b0d6a07577bbbe (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:56:33.883495  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df7e2e5458047a9a8b0d6a07577bbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.885716  1628 tablet_service.cc:1511] Processing CreateTablet for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:56:33.887012  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.886673  1702 tablet_service.cc:1511] Processing CreateTablet for tablet 997bea07114b4964bbe0c9bc9185a7f4 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:56:33.887216  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99331ae0325b4de6bd6d097c96af6d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.887938  1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997bea07114b4964bbe0c9bc9185a7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.891189  1761 tablet_bootstrap.cc:492] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:33.891767  1761 ts_tablet_manager.cc:1403] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.013s
I20260709 12:56:33.894867  1761 raft_consensus.cc:359] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:33.896981  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061154c4edb1414ca27eef7f6a49a794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.891307  1765 tablet_bootstrap.cc:654] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:33.914424  1630 tablet_service.cc:1511] Processing CreateTablet for tablet 089ef23951ac45c3a80b53b6e8127c61 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:56:33.922329  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089ef23951ac45c3a80b53b6e8127c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.915557  1555 tablet_service.cc:1511] Processing CreateTablet for tablet 46fb86b9f3304b99a092fa35dffe1813 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:56:33.916517  1703 tablet_service.cc:1511] Processing CreateTablet for tablet 075b6c0f44a54d0cb3e8050968db2158 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:56:33.919046  1672 heartbeater.cc:499] Master 127.0.107.254:43765 was elected leader, sending a full tablet report...
I20260709 12:56:33.919809  1707 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac8464a8a2c438c8cdaf74b18d51098 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:56:33.925367  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46fb86b9f3304b99a092fa35dffe1813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.928766  1761 raft_consensus.cc:385] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:33.929514  1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075b6c0f44a54d0cb3e8050968db2158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.935742  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:56:33.937069  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac8464a8a2c438c8cdaf74b18d51098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.929122  1761 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:33.940230  1761 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:33.939590  1554 tablet_service.cc:1511] Processing CreateTablet for tablet c5064e0cc33a4a9383fca6c8ee736c18 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:56:33.941627  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:56:33.942396  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5064e0cc33a4a9383fca6c8ee736c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.944672  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.949892  1762 ts_tablet_manager.cc:1434] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.091s	user 0.014s	sys 0.000s
W20260709 12:56:33.950181  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:33.951105  1762 tablet_bootstrap.cc:492] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:33.954628  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 295d06aa958a45069eef5737c8adf1ff (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:56:33.955966  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295d06aa958a45069eef5737c8adf1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.957635  1558 tablet_service.cc:1511] Processing CreateTablet for tablet 52bc0b3e08ea4bd78b344b833b97faed (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:56:33.961907  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bc0b3e08ea4bd78b344b833b97faed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.963160  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 963d2113f061422e874d4718ed8d9538 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:56:33.964488  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 963d2113f061422e874d4718ed8d9538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.966177  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 075b6c0f44a54d0cb3e8050968db2158 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:56:33.974838  1762 tablet_bootstrap.cc:654] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:33.974865  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075b6c0f44a54d0cb3e8050968db2158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.979249  1637 tablet_service.cc:1511] Processing CreateTablet for tablet fdd982fdd5b6440bbcf0eaf350f5124f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:56:33.986958  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 6d01fa5de23643a7bc42ad00178a7f51 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:56:33.987061  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 089ef23951ac45c3a80b53b6e8127c61 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:56:33.988384  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089ef23951ac45c3a80b53b6e8127c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.994627  1705 tablet_service.cc:1511] Processing CreateTablet for tablet 1b56889944b24c9cb46eb080b37a2d4b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:56:33.995831  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b56889944b24c9cb46eb080b37a2d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:33.997175  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd982fdd5b6440bbcf0eaf350f5124f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:56:34.008893  1456 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 47776.2us
I20260709 12:56:34.017887  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 89071a75dff1449588d2f1f4d1b1fb15 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:56:34.039294  1630 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccb6bb6402c4cdf9f065c72d521dc44 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:56:34.040980  1766 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:34.049273  1766 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.051214  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89071a75dff1449588d2f1f4d1b1fb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.051882  1766 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:34.052954  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d01fa5de23643a7bc42ad00178a7f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.054471  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 963d2113f061422e874d4718ed8d9538 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:56:34.056617  1562 tablet_service.cc:1511] Processing CreateTablet for tablet a598709808884384ad6ce3e99aa4345a (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:56:34.050748  1554 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac8464a8a2c438c8cdaf74b18d51098 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:56:34.061151  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 295d06aa958a45069eef5737c8adf1ff (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:56:34.042506  1703 tablet_service.cc:1511] Processing CreateTablet for tablet d5a66d6152a24cf08a833d30477e5bbe (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:56:34.050352  1556 tablet_service.cc:1511] Processing CreateTablet for tablet af922e165f0c427eacd26ca4bc111d76 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:56:34.070158  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccb6bb6402c4cdf9f065c72d521dc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.072263  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.088162  1768 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:34.088259  1746 heartbeater.cc:499] Master 127.0.107.254:43765 was elected leader, sending a full tablet report...
I20260709 12:56:34.088758  1768 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.089010  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 1b56889944b24c9cb46eb080b37a2d4b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:56:34.090175  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b56889944b24c9cb46eb080b37a2d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.091506  1768 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:34.063148  1633 tablet_service.cc:1511] Processing CreateTablet for tablet d5a66d6152a24cf08a833d30477e5bbe (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:56:34.101402  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac8464a8a2c438c8cdaf74b18d51098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.113709  1761 ts_tablet_manager.cc:1434] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.222s	user 0.007s	sys 0.018s
I20260709 12:56:34.113487  1631 tablet_service.cc:1511] Processing CreateTablet for tablet 218ace78ff9d4582bd0fa7fe82f9654f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:56:34.118201  1708 tablet_service.cc:1511] Processing CreateTablet for tablet fdd982fdd5b6440bbcf0eaf350f5124f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:56:34.120461  1553 tablet_service.cc:1511] Processing CreateTablet for tablet 57f5c2cabd34469aa65eff4ffae3e350 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:56:34.124361  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed697fc3d1e49f2ac09064ed3b8abc1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:56:34.119843  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 061154c4edb1414ca27eef7f6a49a794 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:56:34.137135  1761 tablet_bootstrap.cc:492] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:34.137833  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed697fc3d1e49f2ac09064ed3b8abc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.138064  1555 tablet_service.cc:1511] Processing CreateTablet for tablet 3df7e2e5458047a9a8b0d6a07577bbbe (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:56:34.139407  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df7e2e5458047a9a8b0d6a07577bbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.140344  1702 tablet_service.cc:1511] Processing CreateTablet for tablet 89071a75dff1449588d2f1f4d1b1fb15 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:56:34.146709  1762 tablet_bootstrap.cc:492] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:34.147377  1597 heartbeater.cc:499] Master 127.0.107.254:43765 was elected leader, sending a full tablet report...
I20260709 12:56:34.106581  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 963d2113f061422e874d4718ed8d9538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.152427  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a66d6152a24cf08a833d30477e5bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.153918  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218ace78ff9d4582bd0fa7fe82f9654f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.160207  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:34.161860  1612 leader_election.cc:343] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:34.173731  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccb6bb6402c4cdf9f065c72d521dc44 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:56:34.174322  1632 tablet_service.cc:1511] Processing CreateTablet for tablet 0d36382528fc4b5680388922224bdfa3 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:56:34.174739  1765 tablet_bootstrap.cc:492] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:34.175046  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccb6bb6402c4cdf9f065c72d521dc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.175253  1765 ts_tablet_manager.cc:1403] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.300s	user 0.013s	sys 0.015s
I20260709 12:56:34.178165  1765 raft_consensus.cc:359] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.151407  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 997bea07114b4964bbe0c9bc9185a7f4 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:56:34.182126  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997bea07114b4964bbe0c9bc9185a7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.179229  1762 ts_tablet_manager.cc:1403] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.228s	user 0.006s	sys 0.019s
I20260709 12:56:34.178853  1765 raft_consensus.cc:385] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:34.185096  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295d06aa958a45069eef5737c8adf1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.183350  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 6d01fa5de23643a7bc42ad00178a7f51 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:56:34.188992  1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a66d6152a24cf08a833d30477e5bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.189760  1762 raft_consensus.cc:359] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.190469  1762 raft_consensus.cc:385] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:34.190740  1762 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
W20260709 12:56:34.200918  1456 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 93568us
I20260709 12:56:34.201390  1765 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:34.202296  1765 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.207777  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd982fdd5b6440bbcf0eaf350f5124f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.212334  1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89071a75dff1449588d2f1f4d1b1fb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.182785  1629 tablet_service.cc:1511] Processing CreateTablet for tablet c680cef608164c689f7de9b00b60e72d (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:56:34.223129  1762 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.231226  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f5c2cabd34469aa65eff4ffae3e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.231896  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061154c4edb1414ca27eef7f6a49a794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.235754  1707 tablet_service.cc:1511] Processing CreateTablet for tablet 218ace78ff9d4582bd0fa7fe82f9654f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:56:34.239718  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af922e165f0c427eacd26ca4bc111d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.240935  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a598709808884384ad6ce3e99aa4345a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.251371  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d01fa5de23643a7bc42ad00178a7f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.257879  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218ace78ff9d4582bd0fa7fe82f9654f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.266047  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:34.267861  1686 leader_election.cc:343] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:34.275727  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c680cef608164c689f7de9b00b60e72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.282337  1628 tablet_service.cc:1511] Processing CreateTablet for tablet 9d74d4e4a65d434897c3095399228ce1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:56:34.283762  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d74d4e4a65d434897c3095399228ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.290205  1636 tablet_service.cc:1511] Processing CreateTablet for tablet fe107547ec8e475786b8fa8f8c789648 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:56:34.296149  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe107547ec8e475786b8fa8f8c789648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.298414  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 0d36382528fc4b5680388922224bdfa3 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:56:34.299746  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d36382528fc4b5680388922224bdfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.302707  1765 ts_tablet_manager.cc:1434] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.007s
I20260709 12:56:34.302518  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 35c533e32b324f8f80c12f5380f0c92d (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:56:34.303668  1765 tablet_bootstrap.cc:492] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:34.306649  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d36382528fc4b5680388922224bdfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.315747  1554 tablet_service.cc:1511] Processing CreateTablet for tablet 99331ae0325b4de6bd6d097c96af6d6c (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:56:34.307273  1630 tablet_service.cc:1511] Processing CreateTablet for tablet bdbdfb43cea249489bc1a1b1cc104254 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:56:34.330519  1558 tablet_service.cc:1511] Processing CreateTablet for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:56:34.332278  1705 tablet_service.cc:1511] Processing CreateTablet for tablet c680cef608164c689f7de9b00b60e72d (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:56:34.333570  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c680cef608164c689f7de9b00b60e72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.333489  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:34.335052  1612 leader_election.cc:343] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:34.335491  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:34.336109  1708 tablet_service.cc:1511] Processing CreateTablet for tablet 9d74d4e4a65d434897c3095399228ce1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:56:34.336637  1766 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:34.337365  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d74d4e4a65d434897c3095399228ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.337390  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbdfb43cea249489bc1a1b1cc104254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.338147  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c533e32b324f8f80c12f5380f0c92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.350862  1704 tablet_service.cc:1511] Processing CreateTablet for tablet fe107547ec8e475786b8fa8f8c789648 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:56:34.355958  1634 tablet_service.cc:1511] Processing CreateTablet for tablet a008f8fc81244052803539fc7317853b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:56:34.352088  1637 tablet_service.cc:1511] Processing CreateTablet for tablet 85c93ae6dea242bf9de5cf30087783be (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:56:34.359618  1762 ts_tablet_manager.cc:1434] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.172s	user 0.004s	sys 0.003s
I20260709 12:56:34.360762  1762 tablet_bootstrap.cc:492] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:34.361012  1709 tablet_service.cc:1511] Processing CreateTablet for tablet bdbdfb43cea249489bc1a1b1cc104254 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:56:34.362257  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbdfb43cea249489bc1a1b1cc104254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.362093  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 35c533e32b324f8f80c12f5380f0c92d (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:56:34.359788  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c93ae6dea242bf9de5cf30087783be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.363291  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c533e32b324f8f80c12f5380f0c92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.371160  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.372475  1631 tablet_service.cc:1511] Processing CreateTablet for tablet b51b349fdba540c3a8c0e167720c3a7c (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:56:34.374814  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51b349fdba540c3a8c0e167720c3a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.377081  1761 tablet_bootstrap.cc:654] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:34.377243  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe107547ec8e475786b8fa8f8c789648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.384011  1703 tablet_service.cc:1511] Processing CreateTablet for tablet 85c93ae6dea242bf9de5cf30087783be (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:56:34.384290  1553 tablet_service.cc:1511] Processing CreateTablet for tablet 089ef23951ac45c3a80b53b6e8127c61 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:56:34.385577  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089ef23951ac45c3a80b53b6e8127c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.391608  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 295d06aa958a45069eef5737c8adf1ff (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:56:34.394382  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295d06aa958a45069eef5737c8adf1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.396003  1766 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:34.422621  1766 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.424634  1766 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:34.425522  1762 tablet_bootstrap.cc:654] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:34.426846  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:34.427997  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:34.428558  1708 tablet_service.cc:1511] Processing CreateTablet for tablet a008f8fc81244052803539fc7317853b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 12:56:34.429553  1612 leader_election.cc:343] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:34.430686  1612 leader_election.cc:343] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:34.431102  1612 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:34.432137  1766 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:34.396375  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 963d2113f061422e874d4718ed8d9538 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:56:34.403635  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:34.405731  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a008f8fc81244052803539fc7317853b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.433414  1555 tablet_service.cc:1511] Processing CreateTablet for tablet fdd982fdd5b6440bbcf0eaf350f5124f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:56:34.434791  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd982fdd5b6440bbcf0eaf350f5124f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.432319  1709 tablet_service.cc:1511] Processing CreateTablet for tablet b51b349fdba540c3a8c0e167720c3a7c (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 12:56:34.437338  1684 leader_election.cc:343] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:34.437814  1684 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:34.439056  1771 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:34.440292  1556 tablet_service.cc:1511] Processing CreateTablet for tablet 0d36382528fc4b5680388922224bdfa3 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:56:34.449398  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 963d2113f061422e874d4718ed8d9538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.421327  1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c93ae6dea242bf9de5cf30087783be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.452092  1777 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:34.420523  1765 tablet_bootstrap.cc:654] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:34.459012  1777 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.461431  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51b349fdba540c3a8c0e167720c3a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.461608  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99331ae0325b4de6bd6d097c96af6d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.467672  1777 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:34.483654  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d36382528fc4b5680388922224bdfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.490103  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a008f8fc81244052803539fc7317853b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.498345  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 89071a75dff1449588d2f1f4d1b1fb15 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:56:34.505414  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89071a75dff1449588d2f1f4d1b1fb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.499089  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 508332d25a2b4288bc6411b566044758 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:56:34.509516  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508332d25a2b4288bc6411b566044758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.510573  1707 tablet_service.cc:1511] Processing CreateTablet for tablet a3d04144cd804a9b886ecfd1a986ec95 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:56:34.473196  1632 tablet_service.cc:1511] Processing CreateTablet for tablet 4da9bedf7aba45139d86ca314258a105 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:56:34.511938  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d04144cd804a9b886ecfd1a986ec95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.512020  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da9bedf7aba45139d86ca314258a105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.507112  1702 tablet_service.cc:1511] Processing CreateTablet for tablet 508332d25a2b4288bc6411b566044758 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:56:34.513453  1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508332d25a2b4288bc6411b566044758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.517654  1633 tablet_service.cc:1511] Processing CreateTablet for tablet a3d04144cd804a9b886ecfd1a986ec95 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:56:34.519002  1762 tablet_bootstrap.cc:492] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:34.519683  1762 ts_tablet_manager.cc:1403] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.159s	user 0.020s	sys 0.016s
I20260709 12:56:34.521232  1634 tablet_service.cc:1511] Processing CreateTablet for tablet e271944afc3846f9b26d682a57b58ce8 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:56:34.522601  1553 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccb6bb6402c4cdf9f065c72d521dc44 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:56:34.523074  1762 raft_consensus.cc:359] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.523901  1762 raft_consensus.cc:385] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:34.524276  1762 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:34.518985  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d04144cd804a9b886ecfd1a986ec95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.505625  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 4da9bedf7aba45139d86ca314258a105 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:56:34.523941  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccb6bb6402c4cdf9f065c72d521dc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.525266  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e271944afc3846f9b26d682a57b58ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.523936  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 45ae77627c4743fc864bb7da44bb00b3 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:56:34.530524  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ae77627c4743fc864bb7da44bb00b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.533327  1762 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.541996  1562 tablet_service.cc:1511] Processing CreateTablet for tablet 218ace78ff9d4582bd0fa7fe82f9654f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:56:34.543401  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218ace78ff9d4582bd0fa7fe82f9654f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.546336  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da9bedf7aba45139d86ca314258a105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.546759  1761 tablet_bootstrap.cc:492] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:34.547278  1761 ts_tablet_manager.cc:1403] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.410s	user 0.009s	sys 0.003s
I20260709 12:56:34.549908  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 1b56889944b24c9cb46eb080b37a2d4b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:56:34.549218  1762 ts_tablet_manager.cc:1434] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:56:34.552229  1762 tablet_bootstrap.cc:492] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:34.551143  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b56889944b24c9cb46eb080b37a2d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.552050  1761 raft_consensus.cc:359] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.572103  1762 tablet_bootstrap.cc:654] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:34.572891  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 45ae77627c4743fc864bb7da44bb00b3 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:56:34.574365  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ae77627c4743fc864bb7da44bb00b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.574739  1561 tablet_service.cc:1511] Processing CreateTablet for tablet d5a66d6152a24cf08a833d30477e5bbe (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:56:34.578653  1705 tablet_service.cc:1511] Processing CreateTablet for tablet e271944afc3846f9b26d682a57b58ce8 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:56:34.564977  1761 raft_consensus.cc:385] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:34.581032  1761 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:34.580247  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e271944afc3846f9b26d682a57b58ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.581580  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 88ae4cb056ac43519786f1fb62431bc4 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:56:34.595801  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a66d6152a24cf08a833d30477e5bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.597779  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ae4cb056ac43519786f1fb62431bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.581943  1761 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.602147  1637 tablet_service.cc:1511] Processing CreateTablet for tablet 26cba50eaa264fd889cd8a4587b03948 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:56:34.603590  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cba50eaa264fd889cd8a4587b03948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.602551  1761 ts_tablet_manager.cc:1434] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.055s	user 0.002s	sys 0.007s
I20260709 12:56:34.608562  1708 tablet_service.cc:1511] Processing CreateTablet for tablet 88ae4cb056ac43519786f1fb62431bc4 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:56:34.638036  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ae4cb056ac43519786f1fb62431bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.638559  1628 tablet_service.cc:1511] Processing CreateTablet for tablet 598f1b27b4ab45cfac5cc13489b2e687 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:56:34.639882  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598f1b27b4ab45cfac5cc13489b2e687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.649829  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:34.650575  1647 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:34.652098  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:34.653062  1777 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:34.653457  1777 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:34.653841  1777 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:34.665205  1761 tablet_bootstrap.cc:492] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:34.667186  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:34.667929  1721 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:34.633873  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 26cba50eaa264fd889cd8a4587b03948 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:56:34.670024  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cba50eaa264fd889cd8a4587b03948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.678727  1766 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:34.679700  1766 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.681135  1556 tablet_service.cc:1511] Processing CreateTablet for tablet fe107547ec8e475786b8fa8f8c789648 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:56:34.682684  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe107547ec8e475786b8fa8f8c789648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.684232  1766 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:34.685913  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:34.686302  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 598f1b27b4ab45cfac5cc13489b2e687 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:56:34.686364  1559 tablet_service.cc:1511] Processing CreateTablet for tablet c680cef608164c689f7de9b00b60e72d (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:56:34.687803  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598f1b27b4ab45cfac5cc13489b2e687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.687892  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c680cef608164c689f7de9b00b60e72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.689533  1761 tablet_bootstrap.cc:654] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:34.689391  1612 leader_election.cc:343] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:34.688297  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:34.692049  1612 leader_election.cc:343] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:34.693471  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:34.696882  1766 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:34.711624  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 523c299f124340818ee040d8a887dba6 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:56:34.713165  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 523c299f124340818ee040d8a887dba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.721992  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 523c299f124340818ee040d8a887dba6 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:56:34.724444  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 523c299f124340818ee040d8a887dba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.728430  1630 tablet_service.cc:1511] Processing CreateTablet for tablet a2aea8dafba3428dbb6d189666a9957b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:56:34.730042  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2aea8dafba3428dbb6d189666a9957b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.744347  1709 tablet_service.cc:1511] Processing CreateTablet for tablet a2aea8dafba3428dbb6d189666a9957b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:56:34.747934  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2aea8dafba3428dbb6d189666a9957b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.746061  1777 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.752992  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:34.755693  1647 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:34.757850  1555 tablet_service.cc:1511] Processing CreateTablet for tablet 9d74d4e4a65d434897c3095399228ce1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:56:34.759207  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d74d4e4a65d434897c3095399228ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.767446  1553 tablet_service.cc:1511] Processing CreateTablet for tablet 35c533e32b324f8f80c12f5380f0c92d (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:56:34.768931  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c533e32b324f8f80c12f5380f0c92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.771937  1777 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:34.773633  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:34.774369  1721 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:34.775667  1765 tablet_bootstrap.cc:492] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:34.776154  1765 ts_tablet_manager.cc:1403] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.473s	user 0.011s	sys 0.007s
I20260709 12:56:34.779130  1765 raft_consensus.cc:359] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.779903  1765 raft_consensus.cc:385] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:34.780192  1765 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:34.789992  1558 tablet_service.cc:1511] Processing CreateTablet for tablet a008f8fc81244052803539fc7317853b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:56:34.807796  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a008f8fc81244052803539fc7317853b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.795967  1632 tablet_service.cc:1511] Processing CreateTablet for tablet 86e8c2c317414ecda8dce8d5284c74d1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:56:34.812222  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e8c2c317414ecda8dce8d5284c74d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.812132  1707 tablet_service.cc:1511] Processing CreateTablet for tablet 86e8c2c317414ecda8dce8d5284c74d1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:56:34.813751  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e8c2c317414ecda8dce8d5284c74d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.793581  1557 tablet_service.cc:1511] Processing CreateTablet for tablet b51b349fdba540c3a8c0e167720c3a7c (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:56:34.784569  1559 tablet_service.cc:1511] Processing CreateTablet for tablet bdbdfb43cea249489bc1a1b1cc104254 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:56:34.814613  1762 tablet_bootstrap.cc:492] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:34.809567  1554 tablet_service.cc:1511] Processing CreateTablet for tablet 85c93ae6dea242bf9de5cf30087783be (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:56:34.815353  1762 ts_tablet_manager.cc:1403] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.263s	user 0.015s	sys 0.008s
I20260709 12:56:34.809966  1562 tablet_service.cc:1511] Processing CreateTablet for tablet 4da9bedf7aba45139d86ca314258a105 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:56:34.819712  1762 raft_consensus.cc:359] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.820509  1762 raft_consensus.cc:385] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:34.820858  1762 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:34.821734  1762 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.824463  1762 ts_tablet_manager.cc:1434] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:56:34.796594  1765 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.831698  1561 tablet_service.cc:1511] Processing CreateTablet for tablet a3d04144cd804a9b886ecfd1a986ec95 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:56:34.838119  1765 ts_tablet_manager.cc:1434] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.003s
I20260709 12:56:34.841086  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbdfb43cea249489bc1a1b1cc104254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.844549  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c93ae6dea242bf9de5cf30087783be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.846072  1721 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:34.847380  1647 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:34.847522  1537 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:34.848527  1777 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:34.862283  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d04144cd804a9b886ecfd1a986ec95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.865360  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51b349fdba540c3a8c0e167720c3a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.878471  1556 tablet_service.cc:1511] Processing CreateTablet for tablet 45ae77627c4743fc864bb7da44bb00b3 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:56:34.883196  1765 tablet_bootstrap.cc:492] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:34.886250  1630 tablet_service.cc:1511] Processing CreateTablet for tablet 13d708096220406385b27d464c8725f2 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:56:34.888108  1555 tablet_service.cc:1511] Processing CreateTablet for tablet 508332d25a2b4288bc6411b566044758 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:56:34.892324  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da9bedf7aba45139d86ca314258a105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.894098  1761 tablet_bootstrap.cc:492] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:34.895736  1559 tablet_service.cc:1511] Processing CreateTablet for tablet e271944afc3846f9b26d682a57b58ce8 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:56:34.900799  1762 tablet_bootstrap.cc:492] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:34.906994  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508332d25a2b4288bc6411b566044758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.900035  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 88ae4cb056ac43519786f1fb62431bc4 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:56:34.906466  1761 ts_tablet_manager.cc:1403] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.241s	user 0.053s	sys 0.078s
I20260709 12:56:34.912856  1762 tablet_bootstrap.cc:654] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:34.913546  1761 raft_consensus.cc:359] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.914788  1761 raft_consensus.cc:385] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:34.915263  1761 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:34.916718  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ae77627c4743fc864bb7da44bb00b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.916510  1761 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.921766  1761 ts_tablet_manager.cc:1434] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:56:34.922415  1771 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:34.932044  1771 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:34.932991  1560 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45012 (request call id 34) took 1074 ms. Trace:
I20260709 12:56:34.933637  1560 rpcz_store.cc:276] 0709 12:56:33.858171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:34.468104 (+609933us) service_pool.cc:224] Handling call
0709 12:56:34.550713 (+ 82609us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:34.550803 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:34.708792 (+157989us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:34.929001 (+220209us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:34.932913 (+  3912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:34.936079  1771 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:34.927165  1632 tablet_service.cc:1511] Processing CreateTablet for tablet 5a33c093dd1a4a51a63ade534efa70f8 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:56:34.936811  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:34.927891  1705 tablet_service.cc:1511] Processing CreateTablet for tablet 5a33c093dd1a4a51a63ade534efa70f8 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:56:34.928925  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d708096220406385b27d464c8725f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.942268  1761 tablet_bootstrap.cc:492] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:34.930296  1777 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:34.917949  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e271944afc3846f9b26d682a57b58ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.908200  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 13d708096220406385b27d464c8725f2 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:56:34.945994  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a33c093dd1a4a51a63ade534efa70f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:56:34.953663  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:34.953781  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a33c093dd1a4a51a63ade534efa70f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.954836  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 26cba50eaa264fd889cd8a4587b03948 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:56:34.946460  1777 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:34.947726  1686 leader_election.cc:343] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:34.939908  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:34.949177  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ae4cb056ac43519786f1fb62431bc4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:56:34.963627  1684 leader_election.cc:343] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:34.964309  1684 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:34.965969  1771 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:34.966909  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d708096220406385b27d464c8725f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.939829  1553 tablet_service.cc:1511] Processing CreateTablet for tablet 598f1b27b4ab45cfac5cc13489b2e687 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:56:34.977887  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598f1b27b4ab45cfac5cc13489b2e687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.980795  1628 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5c0052ddab4e69a58f0da887bba56e (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:56:34.985795  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5c0052ddab4e69a58f0da887bba56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.986653  1562 tablet_service.cc:1511] Processing CreateTablet for tablet 523c299f124340818ee040d8a887dba6 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:56:34.983860  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5c0052ddab4e69a58f0da887bba56e (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:56:34.988804  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5c0052ddab4e69a58f0da887bba56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.988389  1637 tablet_service.cc:1511] Processing CreateTablet for tablet db00224dfea24cb2a0a2400d9b4a907f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:56:34.990299  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db00224dfea24cb2a0a2400d9b4a907f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:34.984156  1761 tablet_bootstrap.cc:654] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.003820  1765 tablet_bootstrap.cc:654] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.016743  1711 tablet_service.cc:1511] Processing CreateTablet for tablet db00224dfea24cb2a0a2400d9b4a907f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:56:35.026629  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cba50eaa264fd889cd8a4587b03948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:35.027514  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db00224dfea24cb2a0a2400d9b4a907f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:35.032071  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 523c299f124340818ee040d8a887dba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:35.039609  1470 catalog_manager.cc:5697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:35.067073  1762 tablet_bootstrap.cc:492] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:35.067795  1762 ts_tablet_manager.cc:1403] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.234s	user 0.024s	sys 0.013s
I20260709 12:56:35.070820  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 86e8c2c317414ecda8dce8d5284c74d1 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:56:35.085544  1777 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.087563  1777 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.097642  1558 tablet_service.cc:1511] Processing CreateTablet for tablet a2aea8dafba3428dbb6d189666a9957b (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:56:35.084971  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e8c2c317414ecda8dce8d5284c74d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:35.083081  1766 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.102630  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 5a33c093dd1a4a51a63ade534efa70f8 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:56:35.104787  1766 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.107859  1761 tablet_bootstrap.cc:492] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:35.108501  1761 ts_tablet_manager.cc:1403] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.167s	user 0.035s	sys 0.037s
I20260709 12:56:35.109607  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:35.109054  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:35.111248  1572 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:35.114929  1555 tablet_service.cc:1511] Processing CreateTablet for tablet 13d708096220406385b27d464c8725f2 (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:56:35.117096  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:35.119014  1766 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.119869  1766 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:35.127207  1777 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.128057  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a33c093dd1a4a51a63ade534efa70f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:35.127830  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:35.129724  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2aea8dafba3428dbb6d189666a9957b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:35.133191  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:35.137411  1537 leader_election.cc:343] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.125532  1766 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:35.153918  1554 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5c0052ddab4e69a58f0da887bba56e (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:56:35.160636  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 43689.5us
W20260709 12:56:35.161641  1612 leader_election.cc:343] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.158221  1766 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.100963  1762 raft_consensus.cc:359] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.166821  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d708096220406385b27d464c8725f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:35.174700  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5c0052ddab4e69a58f0da887bba56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:35.186520  1761 raft_consensus.cc:359] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.187708  1761 raft_consensus.cc:385] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.188182  1761 raft_consensus.cc:740] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.190124  1765 tablet_bootstrap.cc:492] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:35.213303  1765 ts_tablet_manager.cc:1403] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.330s	user 0.026s	sys 0.013s
I20260709 12:56:35.169361  1762 raft_consensus.cc:385] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.208871  1556 tablet_service.cc:1511] Processing CreateTablet for tablet db00224dfea24cb2a0a2400d9b4a907f (DEFAULT_TABLE table=test-workload [id=a8543a44953d40aba702514824998735]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:56:35.216856  1762 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.217988  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db00224dfea24cb2a0a2400d9b4a907f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:35.218060  1762 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.218762  1765 raft_consensus.cc:359] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.219782  1765 raft_consensus.cc:385] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.220218  1765 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.221416  1765 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.213528  1761 consensus_queue.cc:260] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.225317  1765 ts_tablet_manager.cc:1434] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:56:35.226750  1765 tablet_bootstrap.cc:492] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:35.230914  1762 ts_tablet_manager.cc:1434] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.163s	user 0.004s	sys 0.011s
I20260709 12:56:35.232200  1761 ts_tablet_manager.cc:1434] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.123s	user 0.005s	sys 0.007s
I20260709 12:56:35.232422  1762 tablet_bootstrap.cc:492] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:35.233865  1761 tablet_bootstrap.cc:492] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:35.241199  1765 tablet_bootstrap.cc:654] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.253202  1765 tablet_bootstrap.cc:492] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:35.253880  1765 ts_tablet_manager.cc:1403] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 12:56:35.260422  1766 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.262573  1647 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:35.266885  1762 tablet_bootstrap.cc:654] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.267514  1761 tablet_bootstrap.cc:654] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.267654  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:35.269629  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:35.271965  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:56:35.274503  1612 leader_election.cc:343] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.275484  1572 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.258980  1765 raft_consensus.cc:359] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.278254  1765 raft_consensus.cc:385] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.278755  1765 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.263484  1766 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.279995  1765 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.284344  1765 ts_tablet_manager.cc:1434] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.004s
I20260709 12:56:35.285933  1765 tablet_bootstrap.cc:492] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:35.296307  1761 tablet_bootstrap.cc:492] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:35.297055  1761 ts_tablet_manager.cc:1403] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.012s
I20260709 12:56:35.299055  1765 tablet_bootstrap.cc:654] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.302579  1761 raft_consensus.cc:359] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.303726  1761 raft_consensus.cc:385] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.304170  1761 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.305853  1761 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.309007  1762 tablet_bootstrap.cc:492] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:35.309687  1762 ts_tablet_manager.cc:1403] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.036s
I20260709 12:56:35.310068  1761 ts_tablet_manager.cc:1434] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.007s
I20260709 12:56:35.310228  1765 tablet_bootstrap.cc:492] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:35.311161  1765 ts_tablet_manager.cc:1403] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.016s
I20260709 12:56:35.313297  1761 tablet_bootstrap.cc:492] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:35.314821  1762 raft_consensus.cc:359] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.315743  1762 raft_consensus.cc:385] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.315780  1765 raft_consensus.cc:359] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.316478  1762 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.316747  1765 raft_consensus.cc:385] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.317171  1765 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.317694  1762 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.318130  1765 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.320871  1765 ts_tablet_manager.cc:1434] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:56:35.321177  1762 ts_tablet_manager.cc:1434] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.005s
I20260709 12:56:35.321961  1765 tablet_bootstrap.cc:492] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:35.322642  1762 tablet_bootstrap.cc:492] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:35.333763  1765 tablet_bootstrap.cc:654] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.337915  1762 tablet_bootstrap.cc:654] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.354389  1761 tablet_bootstrap.cc:654] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.356081  1762 tablet_bootstrap.cc:492] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:35.357003  1762 ts_tablet_manager.cc:1403] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.019s
I20260709 12:56:35.359345  1765 tablet_bootstrap.cc:492] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:35.359849  1765 ts_tablet_manager.cc:1403] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.015s
I20260709 12:56:35.362293  1762 raft_consensus.cc:359] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.363204  1762 raft_consensus.cc:385] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.364044  1765 raft_consensus.cc:359] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.364553  1762 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.364794  1765 raft_consensus.cc:385] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.364807  1761 tablet_bootstrap.cc:492] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:35.365243  1765 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.365644  1761 ts_tablet_manager.cc:1403] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.015s
I20260709 12:56:35.366250  1765 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.365741  1762 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.367542  1572 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:35.368501  1777 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:35.369504  1765 ts_tablet_manager.cc:1434] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.011s
I20260709 12:56:35.371487  1765 tablet_bootstrap.cc:492] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:35.373008  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:35.375061  1791 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:35.375751  1791 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:35.377096  1791 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.378759  1762 ts_tablet_manager.cc:1434] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 12:56:35.380254  1762 tablet_bootstrap.cc:492] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:35.393262  1761 raft_consensus.cc:359] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.393939  1761 raft_consensus.cc:385] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.394189  1761 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.394829  1761 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.397259  1761 ts_tablet_manager.cc:1434] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 12:56:35.399035  1761 tablet_bootstrap.cc:492] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:35.399217  1762 tablet_bootstrap.cc:654] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.402627  1470 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:35.392480  1765 tablet_bootstrap.cc:654] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.408838  1777 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:35.411353  1761 tablet_bootstrap.cc:654] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.416914  1777 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.417896  1777 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.421085  1771 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.421808  1771 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.425693  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:35.426065  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:35.428257  1686 leader_election.cc:343] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:35.435909  1535 leader_election.cc:343] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.438238  1771 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:35.439437  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:35.441282  1684 leader_election.cc:343] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.441973  1684 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:35.445717  1777 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.446133  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:35.446592  1771 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:35.448238  1537 leader_election.cc:343] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.449002  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:35.451231  1777 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:35.459539  1765 tablet_bootstrap.cc:492] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:35.460371  1765 ts_tablet_manager.cc:1403] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.089s	user 0.024s	sys 0.041s
I20260709 12:56:35.468981  1765 raft_consensus.cc:359] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.469885  1777 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:35.470161  1765 raft_consensus.cc:385] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.470742  1765 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.471912  1765 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.475973  1765 ts_tablet_manager.cc:1434] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:56:35.477471  1765 tablet_bootstrap.cc:492] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:35.477612  1771 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.478410  1771 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.483546  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:35.484748  1572 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:35.489312  1765 tablet_bootstrap.cc:654] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.489367  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:35.491482  1684 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:35.492434  1762 tablet_bootstrap.cc:492] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:35.492275  1771 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:35.493168  1762 ts_tablet_manager.cc:1403] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.046s
I20260709 12:56:35.493492  1771 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.497241  1762 raft_consensus.cc:359] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.498085  1762 raft_consensus.cc:385] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.498476  1762 raft_consensus.cc:740] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.499279  1762 consensus_queue.cc:260] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.507416  1762 ts_tablet_manager.cc:1434] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:56:35.508289  1762 tablet_bootstrap.cc:492] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:35.519224  1762 tablet_bootstrap.cc:654] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.531790  1761 tablet_bootstrap.cc:492] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:35.532552  1761 ts_tablet_manager.cc:1403] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.134s	user 0.031s	sys 0.033s
I20260709 12:56:35.539330  1761 raft_consensus.cc:359] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.540345  1761 raft_consensus.cc:385] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.540812  1761 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.541999  1761 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.548002  1761 ts_tablet_manager.cc:1434] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 12:56:35.556452  1761 tablet_bootstrap.cc:492] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:35.558856  1762 tablet_bootstrap.cc:492] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:35.559974  1762 ts_tablet_manager.cc:1403] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.016s
I20260709 12:56:35.563788  1791 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.564854  1765 tablet_bootstrap.cc:492] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:35.565599  1765 ts_tablet_manager.cc:1403] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.007s
I20260709 12:56:35.566658  1762 raft_consensus.cc:359] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.567289  1762 raft_consensus.cc:385] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.567587  1762 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.564410  1791 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.568482  1762 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.573100  1765 raft_consensus.cc:359] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.573861  1765 raft_consensus.cc:385] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.574155  1765 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.574863  1765 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.575336  1762 ts_tablet_manager.cc:1434] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:56:35.574828  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:35.577232  1762 tablet_bootstrap.cc:492] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:35.577219  1720 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:35.579068  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:35.580626  1771 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:35.581435  1791 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:56:35.584488  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:35.582068  1766 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:35.585886  1762 tablet_bootstrap.cc:654] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.586148  1766 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:35.586664  1766 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.585918  1761 tablet_bootstrap.cc:654] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:35.588788  1612 leader_election.cc:343] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.577569  1765 ts_tablet_manager.cc:1434] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:56:35.591675  1765 tablet_bootstrap.cc:492] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:35.592971  1791 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.595120  1791 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.596926  1785 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.597628  1785 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.598870  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:35.599668  1572 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:35.602279  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:35.602435  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:35.603173  1646 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:35.603570  1785 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:35.604394  1537 leader_election.cc:343] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.606801  1765 tablet_bootstrap.cc:654] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.609107  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:35.598047  1791 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.612525  1791 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.613144  1791 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.619306  1762 tablet_bootstrap.cc:492] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:35.619871  1762 ts_tablet_manager.cc:1403] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.004s
I20260709 12:56:35.616086  1791 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.611599  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:35.623449  1761 tablet_bootstrap.cc:492] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:35.625941  1785 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:35.626608  1785 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:35.627182  1785 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.627816  1765 tablet_bootstrap.cc:492] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:35.628229  1765 ts_tablet_manager.cc:1403] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.005s
I20260709 12:56:35.628469  1762 raft_consensus.cc:359] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.629635  1762 raft_consensus.cc:385] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.629823  1761 ts_tablet_manager.cc:1403] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.004s
I20260709 12:56:35.633165  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:35.634028  1761 raft_consensus.cc:359] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.634740  1761 raft_consensus.cc:385] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.629916  1762 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.635725  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:35.635901  1762 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.636747  1572 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:35.637319  1791 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:35.635035  1761 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.637921  1791 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:35.638482  1791 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.638610  1761 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.641571  1762 ts_tablet_manager.cc:1434] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 12:56:35.642701  1762 tablet_bootstrap.cc:492] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:35.645335  1761 ts_tablet_manager.cc:1434] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 12:56:35.646227  1761 tablet_bootstrap.cc:492] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
W20260709 12:56:35.647562  1612 leader_election.cc:343] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.647830  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:35.648481  1720 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:35.654160  1761 tablet_bootstrap.cc:654] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.657310  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:35.639008  1765 raft_consensus.cc:359] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.659032  1816 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:35.659305  1765 raft_consensus.cc:385] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.659588  1816 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:35.659852  1765 raft_consensus.cc:740] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.660148  1816 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.660990  1765 consensus_queue.cc:260] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.667157  1765 ts_tablet_manager.cc:1434] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.004s
I20260709 12:56:35.668041  1762 tablet_bootstrap.cc:654] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.668213  1765 tablet_bootstrap.cc:492] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:35.672511  1761 tablet_bootstrap.cc:492] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:35.674701  1761 ts_tablet_manager.cc:1403] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.003s
I20260709 12:56:35.679020  1761 raft_consensus.cc:359] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.679839  1761 raft_consensus.cc:385] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.680150  1761 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.682585  1765 tablet_bootstrap.cc:654] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.684970  1766 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.680948  1761 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.687433  1813 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.688189  1813 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.689404  1766 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:56:35.689007  1785 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.690399  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:35.691310  1720 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.694020  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:35.691243  1761 ts_tablet_manager.cc:1434] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:56:35.694573  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:35.692116  1813 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.695420  1647 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:35.695533  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:56:35.697578  1537 leader_election.cc:343] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.697863  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:35.695091  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:35.698335  1785 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.698787  1572 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.700790  1719 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:35.699857  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:35.703008  1761 tablet_bootstrap.cc:492] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:35.704838  1785 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:35.705317  1785 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:35.705771  1785 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.711097  1761 tablet_bootstrap.cc:654] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.719228  1762 tablet_bootstrap.cc:492] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:35.719730  1762 ts_tablet_manager.cc:1403] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.077s	user 0.005s	sys 0.022s
I20260709 12:56:35.720717  1813 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.721395  1813 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.726904  1813 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.727782  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:35.728672  1647 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:35.730005  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:35.731010  1762 raft_consensus.cc:359] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.731858  1762 raft_consensus.cc:385] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.732084  1762 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.732101  1535 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:35.733131  1762 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:35.733925  1537 leader_election.cc:343] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.735247  1813 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:35.735780  1762 ts_tablet_manager.cc:1434] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:56:35.735752  1813 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:35.736403  1813 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.738175  1761 tablet_bootstrap.cc:492] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:35.738745  1761 ts_tablet_manager.cc:1403] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.013s
I20260709 12:56:35.743468  1771 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.743146  1761 raft_consensus.cc:359] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.744153  1771 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.744853  1761 raft_consensus.cc:385] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.745234  1761 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.746271  1761 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.748955  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:35.749795  1771 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:35.750735  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:35.751207  1686 leader_election.cc:343] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.752466  1761 ts_tablet_manager.cc:1434] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:56:35.752904  1765 tablet_bootstrap.cc:492] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
W20260709 12:56:35.752746  1684 leader_election.cc:343] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.753315  1765 ts_tablet_manager.cc:1403] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.023s
I20260709 12:56:35.753399  1684 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:35.753901  1761 tablet_bootstrap.cc:492] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:35.755864  1765 raft_consensus.cc:359] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.756603  1765 raft_consensus.cc:385] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:35.757113  1765 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:35.757529  1771 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:35.758491  1765 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.763803  1766 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:35.764882  1761 tablet_bootstrap.cc:654] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.765906  1765 ts_tablet_manager.cc:1434] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:56:35.766005  1762 tablet_bootstrap.cc:492] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:35.767340  1765 tablet_bootstrap.cc:492] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:35.779297  1765 tablet_bootstrap.cc:654] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.780663  1771 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.781347  1771 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.783388  1572 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:35.784493  1791 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.785238  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:35.786490  1766 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:35.789028  1646 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:35.784600  1785 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.789835  1720 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:35.792469  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:35.791424  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:35.793562  1572 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:35.793445  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:35.793236  1816 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.794472  1777 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:35.801254  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:35.802035  1808 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.802162  1721 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.803020  1808 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.805728  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:35.806604  1646 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.797178  1791 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.797116  1785 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.814847  1762 tablet_bootstrap.cc:654] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:35.810938  1766 raft_consensus.cc:697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:35.817404  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:35.817654  1766 consensus_queue.cc:237] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } }
I20260709 12:56:35.818238  1572 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:35.827009  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:35.828024  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:35.828241  1816 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.833050  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:35.821137  1771 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:35.828872  1647 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:35.838279  1771 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.834223  1645 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:35.839563  1684 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:35.841984  1771 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.842454  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:35.843254  1572 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.823963  1808 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:35.845129  1771 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:35.847643  1771 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:35.848223  1771 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:35.848613  1771 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.855146  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:35.856459  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:35.872498  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:35.873379  1720 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.878039  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:35.888371  1771 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:35.891676  1686 leader_election.cc:343] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.890482  1721 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
W20260709 12:56:35.899176  1684 leader_election.cc:343] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.901285  1537 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:35.904172  1771 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:35.906683  1777 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:35.859504  1808 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:35.904172  1785 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:35.916654  1808 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:35.924424  1808 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.924237  1813 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.926142  1571 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:35.927886  1813 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.907526  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:35.938613  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:35.939898  1721 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:56:35.926867  1612 leader_election.cc:343] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:35.928663  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:35.900447  1684 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:35.930361  1785 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:35.992465  1785 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:35.989486  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:35.994268  1647 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.002203  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:36.002794  1645 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:36.004050  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:36.004998  1785 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:36.005854  1785 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:36.000211  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:36.009618  1537 leader_election.cc:343] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.000842  1570 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:36.000864  1813 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.011200  1813 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.013234  1826 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:36.007989  1762 tablet_bootstrap.cc:492] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:36.014741  1762 ts_tablet_manager.cc:1403] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.257s	user 0.010s	sys 0.011s
I20260709 12:56:36.013234  1813 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:35.977582  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:36.016798  1761 tablet_bootstrap.cc:492] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:36.017242  1761 ts_tablet_manager.cc:1403] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.264s	user 0.004s	sys 0.031s
W20260709 12:56:36.013150  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 114023us
W20260709 12:56:36.021454  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 94612.6us
I20260709 12:56:36.022490  1791 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:36.023166  1791 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:36.025198  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:36.015673  1785 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:35.971719  1777 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:36.030361  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:36.030941  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:36.031282  1537 leader_election.cc:343] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.033418  1762 raft_consensus.cc:359] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.038549  1762 raft_consensus.cc:385] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.018720  1646 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:36.038866  1762 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.040392  1762 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.042621  1762 ts_tablet_manager.cc:1434] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:56:36.043669  1762 tablet_bootstrap.cc:492] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:36.044824  1824 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.045519  1824 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.046994  1644 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:36.049237  1572 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:36.050357  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:36.046959  1761 raft_consensus.cc:359] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.053229  1761 raft_consensus.cc:385] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.053509  1761 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.052704  1813 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:36.056445  1829 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.056355  1813 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:36.057384  1813 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.057322  1829 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.053531  1684 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:36.061255  1761 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.060595  1829 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.047823  1785 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.077785  1761 ts_tablet_manager.cc:1434] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.060s	user 0.001s	sys 0.010s
I20260709 12:56:36.070482  1720 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:36.079807  1761 tablet_bootstrap.cc:492] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:36.082597  1828 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:36.082994  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:36.073359  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:36.078338  1777 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.085234  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:36.083853  1644 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.087895  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:36.088121  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:36.088754  1718 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:36.089969  1766 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:36.090377  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:36.088994  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:36.095180  1828 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.096971  1766 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:36.090977  1647 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
W20260709 12:56:36.091071  1537 leader_election.cc:343] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.087201  1785 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.079367  1824 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.095870  1828 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.085582  1765 tablet_bootstrap.cc:492] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
W20260709 12:56:36.099735  1612 leader_election.cc:343] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.105334  1765 ts_tablet_manager.cc:1403] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.338s	user 0.024s	sys 0.088s
W20260709 12:56:36.106189  1612 leader_election.cc:343] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.108011  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:36.111827  1535 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:36.114492  1785 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:36.115038  1828 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:36.115224  1785 raft_consensus.cc:697] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:36.098560  1766 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.117269  1785 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.119797  1824 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:36.120383  1824 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:36.119653  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:36.118880  1467 catalog_manager.cc:5697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:36.124447  1762 tablet_bootstrap.cc:654] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.130246  1644 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
W20260709 12:56:36.131035  1686 leader_election.cc:343] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.140574  1813 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.142365  1572 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:36.110321  1808 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.120970  1824 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.117373  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:36.194855  1765 raft_consensus.cc:359] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.195457  1765 raft_consensus.cc:385] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.195686  1765 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.196238  1765 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.198745  1813 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.199621  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:36.201954  1765 ts_tablet_manager.cc:1434] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.096s	user 0.013s	sys 0.008s
I20260709 12:56:36.201683  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:36.202438  1761 tablet_bootstrap.cc:654] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.203040  1765 tablet_bootstrap.cc:492] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
W20260709 12:56:36.204003  1684 leader_election.cc:343] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.204732  1813 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:36.204802  1684 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:36.205577  1813 raft_consensus.cc:697] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:36.206594  1828 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:36.207811  1766 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.208963  1813 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.208801  1470 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:36.221791  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:36.223523  1644 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.225071  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:36.232595  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:36.233592  1761 tablet_bootstrap.cc:492] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:36.234197  1761 ts_tablet_manager.cc:1403] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.007s
I20260709 12:56:36.222913  1808 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:36.233881  1824 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.241464  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:36.242431  1572 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:36.246274  1537 leader_election.cc:343] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.241701  1766 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:36.251045  1644 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:36.249091  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:36.247273  1829 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:56:36.252743  1684 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:36.256886  1765 tablet_bootstrap.cc:654] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.257890  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:56:36.258224  1612 leader_election.cc:343] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.261413  1785 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.262061  1785 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.260591  1761 raft_consensus.cc:359] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.264230  1761 raft_consensus.cc:385] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.264665  1761 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.248174  1824 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.268361  1762 tablet_bootstrap.cc:492] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:36.270051  1762 ts_tablet_manager.cc:1403] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.227s	user 0.006s	sys 0.014s
I20260709 12:56:36.268980  1761 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.273407  1761 ts_tablet_manager.cc:1434] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 12:56:36.273355  1785 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.266438  1808 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:36.274405  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:36.274574  1808 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:36.275647  1808 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.269155  1718 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.281646  1761 tablet_bootstrap.cc:492] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:36.280769  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:36.289429  1721 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:36.292500  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:36.293911  1785 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:36.294543  1785 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:36.294940  1572 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:36.295076  1785 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.298128  1647 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:36.300912  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:36.302220  1813 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:36.305203  1813 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:36.326102  1762 raft_consensus.cc:359] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.326885  1762 raft_consensus.cc:385] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.327241  1762 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.328158  1762 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.315079  1813 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.330765  1762 ts_tablet_manager.cc:1434] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
W20260709 12:56:36.331423  1535 leader_election.cc:343] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.345011  1762 tablet_bootstrap.cc:492] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:36.359261  1761 tablet_bootstrap.cc:654] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.360026  1718 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:36.373576  1766 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.374315  1766 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.369457  1785 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.385371  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:36.387023  1824 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:36.387924  1824 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:36.387063  1785 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.382637  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:36.389393  1824 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:36.393124  1612 leader_election.cc:343] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.396806  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:36.397565  1644 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.383153  1766 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.404933  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:36.407550  1612 leader_election.cc:343] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.408264  1612 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:36.390117  1470 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:36.409904  1791 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:36.410902  1644 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:36.418380  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:36.419919  1718 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.420337  1762 tablet_bootstrap.cc:654] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.388010  1468 catalog_manager.cc:5697] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:36.429284  1765 tablet_bootstrap.cc:492] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:36.429770  1765 ts_tablet_manager.cc:1403] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.227s	user 0.022s	sys 0.008s
I20260709 12:56:36.431106  1535 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:36.434077  1766 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:36.434700  1765 raft_consensus.cc:359] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.435513  1765 raft_consensus.cc:385] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.433138  1813 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:36.435869  1765 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.436566  1813 raft_consensus.cc:697] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:36.436980  1765 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.437713  1813 consensus_queue.cc:237] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.440339  1765 ts_tablet_manager.cc:1434] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 12:56:36.441639  1765 tablet_bootstrap.cc:492] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:36.441151  1467 catalog_manager.cc:5697] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:36.449337  1761 tablet_bootstrap.cc:492] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:36.454691  1467 catalog_manager.cc:5697] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:36.460482  1761 ts_tablet_manager.cc:1403] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.179s	user 0.024s	sys 0.039s
I20260709 12:56:36.466428  1467 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:36.467710  1718 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:36.476847  1761 raft_consensus.cc:359] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.477867  1761 raft_consensus.cc:385] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.478235  1761 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.479131  1765 tablet_bootstrap.cc:654] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.479348  1761 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.480002  1808 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.480877  1808 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.486390  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:36.487656  1572 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:36.492110  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:36.493279  1644 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:36.495467  1684 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:36.496855  1828 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.503510  1761 ts_tablet_manager.cc:1434] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.003s
I20260709 12:56:36.503943  1808 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:36.506464  1761 tablet_bootstrap.cc:492] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:36.505499  1468 catalog_manager.cc:5697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:36.507617  1813 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.508281  1813 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.512874  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:36.514850  1535 leader_election.cc:343] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.516589  1813 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.518772  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:36.519716  1718 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:36.521644  1537 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:36.522207  1828 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:36.523320  1813 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:36.523886  1813 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:36.525709  1762 tablet_bootstrap.cc:492] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:36.524945  1470 catalog_manager.cc:5697] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:36.526302  1762 ts_tablet_manager.cc:1403] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.182s	user 0.023s	sys 0.002s
I20260709 12:56:36.524495  1813 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.552784  1762 raft_consensus.cc:359] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.553634  1762 raft_consensus.cc:385] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.553889  1762 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.554625  1762 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.556448  1762 ts_tablet_manager.cc:1434] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:56:36.564725  1785 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:36.567618  1762 tablet_bootstrap.cc:492] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:36.567817  1813 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.565841  1765 tablet_bootstrap.cc:492] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:36.570228  1765 ts_tablet_manager.cc:1403] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.129s	user 0.027s	sys 0.066s
I20260709 12:56:36.572422  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:56:36.575603  1535 leader_election.cc:343] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.578359  1761 tablet_bootstrap.cc:654] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.578703  1762 tablet_bootstrap.cc:654] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.577266  1813 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.581653  1765 raft_consensus.cc:359] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.583012  1765 raft_consensus.cc:385] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.583391  1765 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.584302  1765 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.586892  1765 ts_tablet_manager.cc:1434] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:56:36.588438  1765 tablet_bootstrap.cc:492] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:36.597147  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:36.598062  1765 tablet_bootstrap.cc:654] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.597906  1720 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.599809  1762 tablet_bootstrap.cc:492] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:36.600379  1762 ts_tablet_manager.cc:1403] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.015s
I20260709 12:56:36.604188  1762 raft_consensus.cc:359] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.605028  1762 raft_consensus.cc:385] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.605358  1762 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.606334  1762 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.610983  1813 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.611572  1762 ts_tablet_manager.cc:1434] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:56:36.611699  1813 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.612900  1762 tablet_bootstrap.cc:492] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:36.615083  1813 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.616214  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:36.617229  1644 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:36.619172  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:36.620574  1813 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:36.621143  1813 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:36.621698  1813 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.638201  1762 tablet_bootstrap.cc:654] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:36.640194  1828 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.641062  1828 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.647163  1828 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:36.647581  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:36.649085  1644 raft_consensus.cc:2393] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:36.658439  1830 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:36.658835  1813 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.660625  1766 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:36.656314  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:36.664464  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:36.665239  1647 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.665097  1686 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:36.667119  1828 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:36.679520  1813 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:36.680751  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:36.682104  1647 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:36.683660  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:36.685719  1813 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:36.687862  1813 raft_consensus.cc:697] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:36.689292  1813 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.693132  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:56:36.696341  1537 leader_election.cc:343] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.705687  1720 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
W20260709 12:56:36.706449  1537 leader_election.cc:343] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:36.707243  1765 tablet_bootstrap.cc:492] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:36.707330  1828 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:36.707947  1765 ts_tablet_manager.cc:1403] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.120s	user 0.021s	sys 0.066s
I20260709 12:56:36.707724  1785 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:36.713457  1761 tablet_bootstrap.cc:492] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:36.713824  1762 tablet_bootstrap.cc:492] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:36.713924  1761 ts_tablet_manager.cc:1403] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.209s	user 0.045s	sys 0.060s
I20260709 12:56:36.717549  1762 ts_tablet_manager.cc:1403] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.009s
I20260709 12:56:36.718317  1765 raft_consensus.cc:359] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.719312  1765 raft_consensus.cc:385] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.720674  1765 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.725760  1762 raft_consensus.cc:359] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.726260  1762 raft_consensus.cc:385] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.753821  1537 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:36.785641  1761 raft_consensus.cc:359] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.726493  1762 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.790202  1762 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.791250  1761 raft_consensus.cc:385] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:36.791671  1761 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:36.792697  1813 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:36.792903  1761 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.790432  1766 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:36.795037  1813 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:36.795624  1813 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:36.797250  1761 ts_tablet_manager.cc:1434] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.083s	user 0.012s	sys 0.002s
I20260709 12:56:36.796998  1813 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.788376  1765 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:36.802794  1612 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:36.804158  1765 ts_tablet_manager.cc:1434] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.008s
I20260709 12:56:36.827301  1761 tablet_bootstrap.cc:492] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:36.836597  1762 ts_tablet_manager.cc:1434] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.119s	user 0.004s	sys 0.009s
I20260709 12:56:36.838178  1808 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:36.823297  1785 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:56:36.876453  1762 tablet_bootstrap.cc:492] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:36.885401  1785 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.885921  1785 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.897296  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:36.898180  1645 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:36.900256  1535 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:36.899716  1467 catalog_manager.cc:5697] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:36.905210  1867 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:36.906018  1867 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:36.906723  1867 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:36.873951  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 120606us
I20260709 12:56:36.920816  1766 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:36.921420  1766 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:36.931183  1765 tablet_bootstrap.cc:492] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:36.944518  1872 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:36.991094  1816 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:36.996387  1830 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:56:37.004695  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:37.007010  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:37.007390  1720 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:36.994524  1785 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:37.012411  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:37.000602  1766 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:37.016546  1612 leader_election.cc:343] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:37.017789  1816 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:37.018213  1816 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:37.018640  1816 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:37.022078  1761 tablet_bootstrap.cc:654] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:37.034981  1867 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.038591  1867 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:37.040797  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:37.041429  1647 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:37.043023  1762 tablet_bootstrap.cc:654] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:37.077495  1766 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:37.078239  1766 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.079205  1816 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.081849  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:37.086090  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:37.087129  1721 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:37.088675  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:37.089996  1824 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:37.051097  1647 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:37.093956  1828 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:37.096697  1816 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:37.098883  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:37.102445  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:37.104851  1828 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.110066  1828 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:37.094839  1766 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:37.114566  1761 tablet_bootstrap.cc:492] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:37.115020  1761 ts_tablet_manager.cc:1403] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.288s	user 0.016s	sys 0.012s
W20260709 12:56:37.113668  1612 leader_election.cc:343] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:37.112773  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:37.119413  1765 tablet_bootstrap.cc:654] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:37.119026  1761 raft_consensus.cc:359] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.119766  1761 raft_consensus.cc:385] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:37.119637  1535 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:37.120136  1761 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:37.118036  1719 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:37.120870  1879 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:37.121654  1879 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:37.122642  1879 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.123390  1762 tablet_bootstrap.cc:492] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
W20260709 12:56:37.123628  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 199584us
I20260709 12:56:37.123852  1762 ts_tablet_manager.cc:1403] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.281s	user 0.039s	sys 0.016s
I20260709 12:56:37.128813  1828 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:37.133104  1824 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:37.134110  1761 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.140959  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:37.142486  1718 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:37.143177  1762 raft_consensus.cc:359] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.143826  1762 raft_consensus.cc:385] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:37.144091  1762 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:37.145210  1762 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.146817  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:37.147324  1762 ts_tablet_manager.cc:1434] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:56:37.146415  1761 ts_tablet_manager.cc:1434] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:56:37.151458  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:37.152254  1762 tablet_bootstrap.cc:492] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:37.162477  1761 tablet_bootstrap.cc:492] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:37.170275  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:56:37.172734  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:37.188855  1470 catalog_manager.cc:5697] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
W20260709 12:56:37.209906  1537 leader_election.cc:343] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:37.214367  1765 tablet_bootstrap.cc:492] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:37.214860  1765 ts_tablet_manager.cc:1403] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.320s	user 0.017s	sys 0.026s
W20260709 12:56:37.214224  1537 leader_election.cc:343] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:37.215368  1828 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:37.217648  1761 tablet_bootstrap.cc:654] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:37.217842  1765 raft_consensus.cc:359] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.219735  1765 raft_consensus.cc:385] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:37.220072  1765 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:37.220741  1765 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.225274  1765 ts_tablet_manager.cc:1434] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:56:37.226596  1765 tablet_bootstrap.cc:492] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:37.231721  1879 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:37.235980  1719 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:37.237378  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:37.238188  1824 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:37.238731  1824 raft_consensus.cc:697] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:37.239770  1824 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.240759  1879 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:56:37.244403  1537 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:37.245679  1867 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:37.247010  1867 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:37.260267  1762 tablet_bootstrap.cc:654] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:37.260360  1879 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:56:37.260702  1470 catalog_manager.cc:5697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:37.274731  1765 tablet_bootstrap.cc:654] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:37.296689  1761 tablet_bootstrap.cc:492] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:37.297219  1761 ts_tablet_manager.cc:1403] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.136s	user 0.019s	sys 0.005s
I20260709 12:56:37.308099  1470 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:37.310840  1828 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:37.311592  1828 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.323081  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:37.323961  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:37.324635  1684 leader_election.cc:343] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:37.327036  1686 leader_election.cc:343] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:37.327519  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:37.326104  1872 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:56:37.328349  1808 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:37.320132  1828 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:37.328313  1761 raft_consensus.cc:359] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.331589  1761 raft_consensus.cc:385] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:37.332851  1761 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:37.335698  1761 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.358811  1761 ts_tablet_manager.cc:1434] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.061s	user 0.015s	sys 0.004s
I20260709 12:56:37.392963  1761 tablet_bootstrap.cc:492] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:37.423269  1762 tablet_bootstrap.cc:492] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:37.428041  1762 ts_tablet_manager.cc:1403] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.280s	user 0.025s	sys 0.010s
I20260709 12:56:37.445147  1828 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:37.448930  1828 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.478655  1765 tablet_bootstrap.cc:492] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:37.481731  1765 ts_tablet_manager.cc:1403] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.255s	user 0.017s	sys 0.018s
I20260709 12:56:37.574946  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:37.582598  1816 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:37.590780  1785 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:37.610744  1762 raft_consensus.cc:359] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.617456  1762 raft_consensus.cc:385] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:37.618126  1762 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:37.598670  1785 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.624912  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:37.585213  1816 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:37.630810  1686 leader_election.cc:343] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:37.619493  1828 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:37.652475  1762 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.663576  1765 raft_consensus.cc:359] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.678671  1765 raft_consensus.cc:385] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:37.679561  1762 ts_tablet_manager.cc:1434] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.248s	user 0.026s	sys 0.000s
I20260709 12:56:37.667313  1816 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:37.681207  1765 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
W20260709 12:56:37.697701  1684 leader_election.cc:343] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:37.695248  1898 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 12:56:37.700511  1765 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.702322  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:37.690515  1785 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:37.710364  1765 ts_tablet_manager.cc:1434] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.226s	user 0.027s	sys 0.006s
I20260709 12:56:37.728122  1761 tablet_bootstrap.cc:654] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:37.699956  1684 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:37.736527  1762 tablet_bootstrap.cc:492] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:37.749308  1900 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:37.752215  1765 tablet_bootstrap.cc:492] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
W20260709 12:56:37.742337  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44765.2us
I20260709 12:56:37.786839  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:37.820808  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:37.846582  1766 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:37.852941  1902 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:37.884575  1902 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.851445  1766 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:37.978487  1902 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:37.985954  1766 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:37.987072  1872 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:37.996506  1765 tablet_bootstrap.cc:654] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:37.989625  1872 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.018409  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.039149  1762 tablet_bootstrap.cc:654] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.068725  1879 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:56:38.092787  1761 tablet_bootstrap.cc:492] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:38.093360  1761 ts_tablet_manager.cc:1403] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.702s	user 0.087s	sys 0.098s
W20260709 12:56:38.092752  1537 leader_election.cc:343] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.099573  1570 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.110471  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:38.112423  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:38.114893  1761 raft_consensus.cc:359] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.115564  1761 raft_consensus.cc:385] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.115845  1761 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
W20260709 12:56:38.116214  1535 leader_election.cc:343] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.116546  1761 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.119408  1761 ts_tablet_manager.cc:1434] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:56:38.120461  1761 tablet_bootstrap.cc:492] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:38.124229  1905 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.124763  1905 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.124888  1535 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:38.126386  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.127728  1879 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:38.129227  1647 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:38.132854  1905 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:38.134795  1612 leader_election.cc:343] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.136051  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:38.141495  1762 tablet_bootstrap.cc:492] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:38.141872  1762 ts_tablet_manager.cc:1403] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.410s	user 0.058s	sys 0.011s
I20260709 12:56:38.143007  1716 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
W20260709 12:56:38.145862  1612 leader_election.cc:343] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:38.147593  1612 leader_election.cc:343] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.148023  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:38.148767  1905 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:38.148825  1537 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:38.150076  1537 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:38.150882  1830 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:56:38.151249  1830 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:38.151093  1905 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:38.151600  1830 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:38.151750  1872 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:38.153645  1612 leader_election.cc:343] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.154193  1612 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:38.154887  1905 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:38.156358  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.157342  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:38.158003  1716 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:38.162009  1761 tablet_bootstrap.cc:654] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.165562  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:38.165998  1905 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:38.175098  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:38.181838  1762 raft_consensus.cc:359] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.182516  1762 raft_consensus.cc:385] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.182782  1762 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.184659  1762 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:38.190678  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:38.190936  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:38.210443  1762 ts_tablet_manager.cc:1434] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.001s
I20260709 12:56:38.212572  1766 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:56:38.214967  1766 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:38.215106  1762 tablet_bootstrap.cc:492] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:38.215386  1766 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:38.220918  1765 tablet_bootstrap.cc:492] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:38.221630  1765 ts_tablet_manager.cc:1403] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.488s	user 0.045s	sys 0.033s
I20260709 12:56:38.224956  1830 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.235420  1765 raft_consensus.cc:359] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.239925  1765 raft_consensus.cc:385] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.240756  1765 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.211426  1537 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:38.272858  1765 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.278926  1765 ts_tablet_manager.cc:1434] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.013s
W20260709 12:56:38.281141  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 71424.6us
I20260709 12:56:38.278959  1570 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:38.288966  1766 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.290046  1761 tablet_bootstrap.cc:492] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:38.290518  1761 ts_tablet_manager.cc:1403] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.170s	user 0.016s	sys 0.018s
I20260709 12:56:38.296917  1761 raft_consensus.cc:359] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.297673  1761 raft_consensus.cc:385] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.297976  1761 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.299510  1765 tablet_bootstrap.cc:492] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:38.299088  1761 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.294566  1830 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.302279  1761 ts_tablet_manager.cc:1434] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:56:38.306599  1762 tablet_bootstrap.cc:654] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.300765  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:38.312969  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:38.313979  1645 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:38.314113  1716 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:38.317659  1761 tablet_bootstrap.cc:492] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:38.322393  1872 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:38.335225  1765 tablet_bootstrap.cc:654] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.335594  1766 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.336601  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:38.337067  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:38.339421  1716 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:56:38.347492  1537 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:38.349059  1569 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:38.349552  1872 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:38.350116  1872 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:38.351162  1872 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.355080  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:38.356992  1761 tablet_bootstrap.cc:654] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.359953  1766 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:56:38.376547  1762 tablet_bootstrap.cc:492] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:38.377104  1762 ts_tablet_manager.cc:1403] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.162s	user 0.018s	sys 0.001s
I20260709 12:56:38.391434  1762 raft_consensus.cc:359] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.392587  1762 raft_consensus.cc:385] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.392915  1762 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.393740  1762 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.395779  1470 catalog_manager.cc:5697] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:38.401902  1762 ts_tablet_manager.cc:1434] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:56:38.403522  1762 tablet_bootstrap.cc:492] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:38.432963  1762 tablet_bootstrap.cc:654] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.434293  1765 tablet_bootstrap.cc:492] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:38.434702  1761 tablet_bootstrap.cc:492] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:38.434863  1765 ts_tablet_manager.cc:1403] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.136s	user 0.015s	sys 0.023s
I20260709 12:56:38.435190  1761 ts_tablet_manager.cc:1403] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.003s
I20260709 12:56:38.437220  1808 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.437693  1808 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.440694  1761 raft_consensus.cc:359] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.441557  1761 raft_consensus.cc:385] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.441888  1761 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.442456  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.438823  1765 raft_consensus.cc:359] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.442654  1761 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.444110  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:38.444123  1765 raft_consensus.cc:385] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.445565  1765 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
W20260709 12:56:38.446606  1684 leader_election.cc:343] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.446750  1765 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:38.447697  1686 leader_election.cc:343] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.448329  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:38.450309  1808 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:38.451579  1765 ts_tablet_manager.cc:1434] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 12:56:38.458140  1765 tablet_bootstrap.cc:492] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:38.460275  1762 tablet_bootstrap.cc:492] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:38.460824  1762 ts_tablet_manager.cc:1403] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.019s
I20260709 12:56:38.461782  1808 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:38.464330  1762 raft_consensus.cc:359] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.467555  1762 raft_consensus.cc:385] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.467923  1762 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.468776  1762 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.473202  1761 ts_tablet_manager.cc:1434] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.038s	user 0.018s	sys 0.001s
I20260709 12:56:38.477452  1765 tablet_bootstrap.cc:654] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.477525  1761 tablet_bootstrap.cc:492] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:38.480218  1762 ts_tablet_manager.cc:1434] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:56:38.481431  1762 tablet_bootstrap.cc:492] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:38.485688  1926 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.486338  1761 tablet_bootstrap.cc:654] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.486363  1926 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.492096  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:38.495151  1926 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:38.498577  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.500349  1762 tablet_bootstrap.cc:654] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.500692  1684 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:38.502375  1927 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:38.506310  1720 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.517462  1761 tablet_bootstrap.cc:492] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:38.518134  1761 ts_tablet_manager.cc:1403] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.000s
I20260709 12:56:38.522902  1761 raft_consensus.cc:359] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.523648  1761 raft_consensus.cc:385] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.523972  1761 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.524853  1761 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.527565  1761 ts_tablet_manager.cc:1434] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:56:38.529749  1761 tablet_bootstrap.cc:492] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:38.530550  1765 tablet_bootstrap.cc:492] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:38.531059  1765 ts_tablet_manager.cc:1403] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.017s
I20260709 12:56:38.534751  1765 raft_consensus.cc:359] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.535508  1765 raft_consensus.cc:385] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.535805  1765 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.539896  1762 tablet_bootstrap.cc:492] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:38.540498  1762 ts_tablet_manager.cc:1403] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.007s
I20260709 12:56:38.545177  1762 raft_consensus.cc:359] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.546051  1762 raft_consensus.cc:385] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.546412  1762 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.547410  1762 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.536590  1765 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.555843  1761 tablet_bootstrap.cc:654] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.562855  1765 ts_tablet_manager.cc:1434] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:56:38.572528  1765 tablet_bootstrap.cc:492] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:38.579999  1762 ts_tablet_manager.cc:1434] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.004s
I20260709 12:56:38.582062  1765 tablet_bootstrap.cc:654] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.585134  1761 tablet_bootstrap.cc:492] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:38.593861  1761 ts_tablet_manager.cc:1403] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.025s
I20260709 12:56:38.602015  1762 tablet_bootstrap.cc:492] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:38.597883  1761 raft_consensus.cc:359] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.603320  1927 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.603894  1927 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.608052  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.609203  1645 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:38.609457  1762 tablet_bootstrap.cc:654] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.610526  1684 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:38.608583  1927 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:38.611423  1926 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:38.602870  1761 raft_consensus.cc:385] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.611881  1926 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:38.612020  1761 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.612434  1926 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.610725  1872 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.613189  1761 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.613494  1872 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.615690  1872 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.616444  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.617699  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:38.617937  1535 leader_election.cc:343] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.618389  1716 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:38.620087  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:38.620918  1569 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:38.621296  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:38.622766  1877 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:38.623354  1877 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:38.623915  1877 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.627517  1765 tablet_bootstrap.cc:492] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:38.628154  1765 ts_tablet_manager.cc:1403] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.011s
I20260709 12:56:38.627720  1761 ts_tablet_manager.cc:1434] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:56:38.629899  1926 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.631892  1765 raft_consensus.cc:359] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.632607  1765 raft_consensus.cc:385] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.632946  1765 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.633826  1765 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.634399  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:38.635226  1646 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.636219  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:38.636909  1569 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.640228  1872 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.641016  1872 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.641680  1915 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.642627  1761 tablet_bootstrap.cc:492] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:38.642266  1915 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.647780  1569 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:38.647953  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:38.650614  1535 leader_election.cc:343] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.651875  1646 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:38.653661  1684 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:38.654803  1927 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:38.655421  1927 raft_consensus.cc:697] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:38.654958  1877 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.656541  1927 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.661345  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.662173  1645 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:38.662748  1766 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.663446  1766 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.663913  1535 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:38.665119  1830 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:38.665637  1830 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:38.666409  1872 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.673789  1926 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:38.686625  1877 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.689330  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:38.690215  1719 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.690517  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:38.686836  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:38.687229  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:38.695178  1717 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
W20260709 12:56:38.693784  1535 leader_election.cc:343] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:38.696655  1612 leader_election.cc:343] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.678483  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:38.696933  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:38.697732  1720 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:38.698103  1762 tablet_bootstrap.cc:492] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:38.670403  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:38.698751  1570 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:38.666150  1830 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.700196  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:38.701511  1824 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:38.702205  1824 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:38.702865  1824 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.695405  1765 ts_tablet_manager.cc:1434] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.001s
I20260709 12:56:38.697971  1877 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:38.689129  1915 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.709128  1877 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:38.709708  1877 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.710141  1765 tablet_bootstrap.cc:492] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:38.687973  1766 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.714509  1762 ts_tablet_manager.cc:1403] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.002s
I20260709 12:56:38.722213  1877 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.717243  1824 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.721184  1830 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.725934  1762 raft_consensus.cc:359] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.726929  1762 raft_consensus.cc:385] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.727108  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:38.727632  1762 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.728852  1830 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.729076  1762 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.732281  1645 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.732630  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:38.733390  1717 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.735014  1877 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.736725  1765 tablet_bootstrap.cc:654] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.734714  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:38.739168  1720 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.739763  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:38.740585  1646 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.731820  1719 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:38.750133  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:38.751317  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:38.752072  1570 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:38.752043  1720 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
W20260709 12:56:38.752329  1612 leader_election.cc:343] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.752741  1761 tablet_bootstrap.cc:654] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.753960  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:38.754714  1824 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.756320  1877 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:38.757148  1877 raft_consensus.cc:697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:38.758522  1877 consensus_queue.cc:237] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.762341  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:38.763607  1645 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:38.768766  1824 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.769598  1646 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:38.769511  1824 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.771034  1470 catalog_manager.cc:5697] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:38.771991  1535 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:38.773044  1915 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:38.767928  1570 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:38.773697  1915 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:38.775138  1915 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.776407  1717 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:38.777806  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:38.778929  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:56:38.780592  1612 leader_election.cc:343] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.782846  1762 ts_tablet_manager.cc:1434] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.004s
I20260709 12:56:38.782122  1824 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.859181  1762 tablet_bootstrap.cc:492] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:38.835582  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:38.861919  1612 leader_election.cc:343] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.862624  1824 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.862700  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:38.863242  1824 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.785051  1766 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:38.865733  1824 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:38.866946  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:38.784157  1872 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:38.879859  1765 tablet_bootstrap.cc:492] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:38.880153  1872 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:38.867952  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:38.880709  1612 leader_election.cc:343] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.874033  1941 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:38.881861  1612 leader_election.cc:343] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:38.873621  1766 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:38.880347  1765 ts_tablet_manager.cc:1403] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.171s	user 0.017s	sys 0.009s
I20260709 12:56:38.881172  1872 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.875662  1762 tablet_bootstrap.cc:654] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.882254  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:38.875900  1646 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:38.884786  1941 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:38.885618  1879 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:38.885674  1765 raft_consensus.cc:359] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.886534  1765 raft_consensus.cc:385] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.886849  1765 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.887538  1765 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.888365  1761 tablet_bootstrap.cc:492] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:38.888900  1761 ts_tablet_manager.cc:1403] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.247s	user 0.017s	sys 0.023s
I20260709 12:56:38.890543  1766 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.893127  1761 raft_consensus.cc:359] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.894070  1761 raft_consensus.cc:385] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.894366  1761 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.895862  1765 ts_tablet_manager.cc:1434] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:56:38.895386  1761 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.902149  1761 ts_tablet_manager.cc:1434] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:56:38.909742  1765 tablet_bootstrap.cc:492] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:38.910854  1927 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.911160  1762 tablet_bootstrap.cc:492] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:38.911629  1762 ts_tablet_manager.cc:1403] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.005s
I20260709 12:56:38.911494  1927 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.915562  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:38.916109  1927 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:38.916882  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.917531  1762 raft_consensus.cc:359] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.918164  1762 raft_consensus.cc:385] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.918426  1762 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.919194  1717 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:38.919049  1762 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.919041  1684 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:38.920957  1927 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:38.922056  1765 tablet_bootstrap.cc:654] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.922176  1762 ts_tablet_manager.cc:1434] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:56:38.922453  1877 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:38.923375  1761 tablet_bootstrap.cc:492] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:38.925529  1762 tablet_bootstrap.cc:492] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:38.922348  1470 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:38.942320  1762 tablet_bootstrap.cc:654] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.943140  1761 tablet_bootstrap.cc:654] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:38.950716  1765 tablet_bootstrap.cc:492] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:38.951320  1765 ts_tablet_manager.cc:1403] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.014s
I20260709 12:56:38.949095  1468 catalog_manager.cc:5697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:38.965646  1765 raft_consensus.cc:359] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.966555  1765 raft_consensus.cc:385] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.966887  1765 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.967638  1761 tablet_bootstrap.cc:492] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:38.967537  1765 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.968266  1761 ts_tablet_manager.cc:1403] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.000s
I20260709 12:56:38.973078  1765 ts_tablet_manager.cc:1434] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.007s
I20260709 12:56:38.974717  1765 tablet_bootstrap.cc:492] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:38.982872  1927 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:38.983446  1927 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.988514  1927 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:38.988602  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:38.988816  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:38.989791  1761 raft_consensus.cc:359] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.990670  1761 raft_consensus.cc:385] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:38.990487  1646 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:38.991050  1761 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:38.992059  1761 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:38.992835  1684 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:38.989630  1570 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:38.994990  1761 ts_tablet_manager.cc:1434] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:56:38.987509  1468 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:38.996203  1761 tablet_bootstrap.cc:492] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:38.997404  1468 catalog_manager.cc:5697] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:39.001235  1927 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:39.001776  1927 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:39.002278  1927 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.010637  1762 tablet_bootstrap.cc:492] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:39.008737  1765 tablet_bootstrap.cc:654] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.011269  1762 ts_tablet_manager.cc:1403] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.020s
I20260709 12:56:39.022068  1927 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.023522  1762 raft_consensus.cc:359] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.024525  1762 raft_consensus.cc:385] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.024804  1762 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.025542  1762 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.027690  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:39.028208  1762 ts_tablet_manager.cc:1434] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.007s
I20260709 12:56:39.028612  1570 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.030841  1927 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:39.027729  1761 tablet_bootstrap.cc:654] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.031646  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:39.032440  1646 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.042950  1915 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:39.043824  1915 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.048158  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:39.049288  1762 tablet_bootstrap.cc:492] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:39.050454  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:39.052573  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:39.053687  1872 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:39.054965  1915 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:39.055883  1646 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:39.058017  1684 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:39.059424  1927 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:39.060209  1927 raft_consensus.cc:697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:39.061637  1927 consensus_queue.cc:237] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.083250  1570 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:39.086233  1765 tablet_bootstrap.cc:492] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:39.086849  1765 ts_tablet_manager.cc:1403] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.033s
I20260709 12:56:39.089244  1761 tablet_bootstrap.cc:492] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:39.089735  1761 ts_tablet_manager.cc:1403] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.094s	user 0.018s	sys 0.028s
I20260709 12:56:39.093355  1762 tablet_bootstrap.cc:654] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.093432  1761 raft_consensus.cc:359] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.094266  1761 raft_consensus.cc:385] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.094554  1761 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.098385  1761 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.099362  1717 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.101076  1761 ts_tablet_manager.cc:1434] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 12:56:39.102865  1761 tablet_bootstrap.cc:492] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:39.114161  1468 catalog_manager.cc:5697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:39.117034  1926 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:39.105230  1927 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:39.118551  1927 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.119736  1926 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.134485  1927 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:39.136356  1765 raft_consensus.cc:359] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.136934  1926 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:39.138110  1761 tablet_bootstrap.cc:654] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.139731  1765 raft_consensus.cc:385] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.140004  1765 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.140465  1765 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.141068  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:39.145901  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:39.146492  1646 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:39.148487  1927 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:39.152261  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:39.153558  1765 ts_tablet_manager.cc:1434] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:56:39.153712  1808 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:39.154196  1808 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:39.151669  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:39.158025  1570 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:39.157120  1808 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.161861  1765 tablet_bootstrap.cc:492] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
W20260709 12:56:39.163530  1686 leader_election.cc:343] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:39.163452  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:39.165045  1646 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:39.174063  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:39.175135  1570 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.196009  1927 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:39.198429  1927 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:39.198069  1808 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.201401  1762 tablet_bootstrap.cc:492] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:39.201728  1762 ts_tablet_manager.cc:1403] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.010s
I20260709 12:56:39.198928  1927 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.208719  1958 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:39.209442  1808 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:39.209542  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:39.210410  1646 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.214165  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:39.219619  1765 tablet_bootstrap.cc:654] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:39.229501  1686 leader_election.cc:343] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:39.242250  1927 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.246788  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:39.247491  1572 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.250276  1762 raft_consensus.cc:359] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.250803  1762 raft_consensus.cc:385] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.251180  1762 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.252786  1927 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:39.255600  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:39.256311  1647 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.267380  1762 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:39.265969  1535 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:39.272105  1761 tablet_bootstrap.cc:492] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:39.272632  1761 ts_tablet_manager.cc:1403] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.170s	user 0.017s	sys 0.027s
I20260709 12:56:39.282480  1646 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:39.283110  1761 raft_consensus.cc:359] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.283771  1761 raft_consensus.cc:385] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.284017  1761 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.284834  1762 ts_tablet_manager.cc:1434] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.001s
I20260709 12:56:39.284690  1761 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.285043  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:39.286672  1761 ts_tablet_manager.cc:1434] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:56:39.287194  1958 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:39.287945  1647 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:39.289469  1761 tablet_bootstrap.cc:492] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:39.298554  1766 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:39.299031  1766 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.301260  1766 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:39.305581  1572 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:39.309902  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:39.309957  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:39.372983  1717 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
W20260709 12:56:39.374001  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 64212us
I20260709 12:56:39.349020  1958 raft_consensus.cc:697] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:39.352437  1762 tablet_bootstrap.cc:492] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:39.377005  1765 tablet_bootstrap.cc:492] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:39.377586  1765 ts_tablet_manager.cc:1403] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.219s	user 0.008s	sys 0.018s
I20260709 12:56:39.373836  1927 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:39.379757  1927 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:39.379678  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:39.380896  1766 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:39.313359  1915 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.074s
I20260709 12:56:39.386660  1941 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:39.386831  1766 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:39.383279  1927 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.392042  1766 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.394384  1765 raft_consensus.cc:359] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.395172  1765 raft_consensus.cc:385] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.396776  1765 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.397724  1765 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.395897  1761 tablet_bootstrap.cc:654] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.403478  1765 ts_tablet_manager.cc:1434] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:56:39.401149  1941 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.415477  1941 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:39.417294  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:39.421931  1765 tablet_bootstrap.cc:492] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:39.400727  1958 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:39.426856  1612 leader_election.cc:343] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:39.423976  1719 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.433370  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:39.432821  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:39.433799  1915 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:56:39.441723  1766 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:39.458525  1612 leader_election.cc:343] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:39.459197  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:56:39.459583  1612 leader_election.cc:343] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:39.484532  1766 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:39.490599  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:39.493646  1762 tablet_bootstrap.cc:654] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.493819  1941 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:39.489625  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:39.559154  1765 tablet_bootstrap.cc:654] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.562907  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:39.569628  1717 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:39.561337  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 70240.6us
I20260709 12:56:39.621379  1761 tablet_bootstrap.cc:492] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:39.622022  1761 ts_tablet_manager.cc:1403] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.333s	user 0.010s	sys 0.014s
I20260709 12:56:39.628329  1877 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:39.629084  1877 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:39.623364  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 109569us
I20260709 12:56:39.629500  1717 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:39.656984  1761 raft_consensus.cc:359] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.657807  1761 raft_consensus.cc:385] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.658141  1761 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.658839  1761 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.659448  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:39.638823  1612 leader_election.cc:343] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:39.666946  1761 ts_tablet_manager.cc:1434] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.001s
I20260709 12:56:39.671049  1647 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:39.672472  1761 tablet_bootstrap.cc:492] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:39.677330  1467 catalog_manager.cc:5697] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:39.681119  1964 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:39.683229  1765 tablet_bootstrap.cc:492] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:39.683797  1765 ts_tablet_manager.cc:1403] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.262s	user 0.026s	sys 0.021s
I20260709 12:56:39.686816  1877 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:39.689718  1941 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:39.690369  1941 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.693367  1941 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:39.696962  1968 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:39.700136  1941 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:39.700899  1762 tablet_bootstrap.cc:492] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:39.701422  1762 ts_tablet_manager.cc:1403] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.353s	user 0.044s	sys 0.047s
I20260709 12:56:39.702517  1765 raft_consensus.cc:359] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.703510  1765 raft_consensus.cc:385] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.703938  1765 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.704480  1762 raft_consensus.cc:359] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.705169  1762 raft_consensus.cc:385] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.705425  1762 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.702739  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:39.705657  1765 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.707963  1872 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:39.717729  1765 ts_tablet_manager.cc:1434] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 12:56:39.718992  1765 tablet_bootstrap.cc:492] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:39.721580  1761 tablet_bootstrap.cc:654] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.722005  1941 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:39.722759  1941 raft_consensus.cc:697] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:39.723210  1872 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:39.724854  1941 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.728971  1762 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.729795  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:39.741232  1762 ts_tablet_manager.cc:1434] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.003s
I20260709 12:56:39.742619  1762 tablet_bootstrap.cc:492] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:39.756445  1717 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:39.763022  1967 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:39.768694  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:39.785117  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:39.780570  1537 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:39.797883  1872 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.804803  1958 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:56:39.803735  1647 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.835883  1958 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:39.898869  1468 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:39.865777  1612 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:39.927246  1872 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:39.929152  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 86437.6us
I20260709 12:56:39.948261  1762 tablet_bootstrap.cc:654] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.950789  1765 tablet_bootstrap.cc:654] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.970561  1761 tablet_bootstrap.cc:492] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:39.971164  1761 ts_tablet_manager.cc:1403] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.299s	user 0.015s	sys 0.030s
I20260709 12:56:39.974777  1761 raft_consensus.cc:359] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.975685  1761 raft_consensus.cc:385] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.975955  1761 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.976580  1761 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:39.977780  1926 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:39.998821  1761 ts_tablet_manager.cc:1434] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:56:40.000012  1761 tablet_bootstrap.cc:492] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:40.037528  1927 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:56:40.037941  1872 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.045327  1872 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.063565  1927 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:56:40.067260  1941 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:40.078765  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:40.079778  1645 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:40.082197  1958 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.082851  1958 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.086767  1535 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:40.076025  1872 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:40.117745  1926 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.118523  1926 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.123564  1468 catalog_manager.cc:5697] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:56:40.147454  1765 tablet_bootstrap.cc:492] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:40.148162  1765 ts_tablet_manager.cc:1403] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.429s	user 0.022s	sys 0.025s
I20260709 12:56:40.154281  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:40.155316  1717 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:40.162077  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:40.163779  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:40.166499  1762 tablet_bootstrap.cc:492] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:40.166921  1762 ts_tablet_manager.cc:1403] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.425s	user 0.003s	sys 0.023s
I20260709 12:56:40.169546  1926 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:40.153637  1968 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.170445  1968 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.171015  1968 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.184170  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:40.185261  1684 leader_election.cc:343] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.160071  1958 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:40.189359  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:40.190271  1645 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:40.192732  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:40.204734  1926 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.205492  1926 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.219990  1926 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:40.215142  1686 leader_election.cc:343] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.230274  1686 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:40.231777  1927 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:40.253535  1968 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.257359  1572 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:40.245319  1765 raft_consensus.cc:359] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.259613  1765 raft_consensus.cc:385] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.259920  1765 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
W20260709 12:56:40.227950  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53768.6us
I20260709 12:56:40.263273  1761 tablet_bootstrap.cc:654] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.265210  1968 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:40.327823  1765 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.331440  1762 raft_consensus.cc:359] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.332955  1762 raft_consensus.cc:385] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.333246  1762 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.333981  1762 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.336287  1762 ts_tablet_manager.cc:1434] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.169s	user 0.005s	sys 0.000s
I20260709 12:56:40.344069  1765 ts_tablet_manager.cc:1434] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.196s	user 0.013s	sys 0.013s
I20260709 12:56:40.345561  1765 tablet_bootstrap.cc:492] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:40.347342  1926 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:40.337909  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 64061.5us
I20260709 12:56:40.349027  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:40.355922  1720 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:40.357292  1762 tablet_bootstrap.cc:492] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:40.359963  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:40.360805  1645 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.363487  1926 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:56:40.361644  1612 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:40.366003  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:40.368866  1941 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:40.369339  1570 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:40.371536  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:40.386292  1645 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:40.388095  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:40.389220  1958 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.390085  1958 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:40.391194  1958 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.392151  1765 tablet_bootstrap.cc:654] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.398769  1762 tablet_bootstrap.cc:654] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.405344  1535 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:40.407403  1968 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:40.411715  1761 tablet_bootstrap.cc:492] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:40.412201  1761 ts_tablet_manager.cc:1403] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.412s	user 0.021s	sys 0.037s
I20260709 12:56:40.416599  1761 raft_consensus.cc:359] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.417233  1761 raft_consensus.cc:385] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.417501  1761 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.418146  1761 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.420486  1761 ts_tablet_manager.cc:1434] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:56:40.421533  1761 tablet_bootstrap.cc:492] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:40.423522  1765 tablet_bootstrap.cc:492] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:40.424047  1765 ts_tablet_manager.cc:1403] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.005s
I20260709 12:56:40.428630  1765 raft_consensus.cc:359] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.431524  1762 tablet_bootstrap.cc:492] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:40.432055  1762 ts_tablet_manager.cc:1403] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.075s	user 0.004s	sys 0.012s
I20260709 12:56:40.433064  1761 tablet_bootstrap.cc:654] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.433467  1469 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:40.435698  1762 raft_consensus.cc:359] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.429411  1765 raft_consensus.cc:385] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.436993  1765 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.437747  1765 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.440342  1762 raft_consensus.cc:385] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.440723  1762 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.441424  1762 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.444993  1941 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.445555  1941 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.446108  1765 ts_tablet_manager.cc:1434] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.005s
I20260709 12:56:40.447324  1765 tablet_bootstrap.cc:492] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:40.449783  1762 ts_tablet_manager.cc:1434] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.003s
I20260709 12:56:40.450963  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:40.450963  1762 tablet_bootstrap.cc:492] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:40.454747  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:40.448462  1941 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:40.456787  1612 leader_election.cc:343] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:40.463249  1612 leader_election.cc:343] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.463837  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:40.465276  1941 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:40.471028  1761 tablet_bootstrap.cc:492] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:40.471457  1761 ts_tablet_manager.cc:1403] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.029s
I20260709 12:56:40.474048  1765 tablet_bootstrap.cc:654] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.474903  1761 raft_consensus.cc:359] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.475626  1761 raft_consensus.cc:385] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.475934  1761 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.476680  1761 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.478602  1761 ts_tablet_manager.cc:1434] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:56:40.479755  1761 tablet_bootstrap.cc:492] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:40.480955  1762 tablet_bootstrap.cc:654] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.493292  1765 tablet_bootstrap.cc:492] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:40.493693  1765 ts_tablet_manager.cc:1403] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.047s	user 0.004s	sys 0.012s
I20260709 12:56:40.494541  1762 tablet_bootstrap.cc:492] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:40.494968  1762 ts_tablet_manager.cc:1403] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.009s
I20260709 12:56:40.495586  1761 tablet_bootstrap.cc:654] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.498939  1762 raft_consensus.cc:359] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.499432  1762 raft_consensus.cc:385] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.499655  1762 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.500247  1762 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.501775  1762 ts_tablet_manager.cc:1434] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:56:40.502507  1762 tablet_bootstrap.cc:492] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:40.502033  1765 raft_consensus.cc:359] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.502986  1765 raft_consensus.cc:385] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.503331  1765 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.509778  1762 tablet_bootstrap.cc:654] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.512693  1765 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.515014  1765 ts_tablet_manager.cc:1434] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 12:56:40.516254  1765 tablet_bootstrap.cc:492] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:40.524997  1765 tablet_bootstrap.cc:654] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.529062  1761 tablet_bootstrap.cc:492] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:40.529449  1761 ts_tablet_manager.cc:1403] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.027s
I20260709 12:56:40.532163  1761 raft_consensus.cc:359] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.532974  1761 raft_consensus.cc:385] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.532866  1958 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.533346  1761 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.533492  1958 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.536660  1761 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.540970  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:40.541747  1645 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:40.546311  1761 ts_tablet_manager.cc:1434] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:56:40.546375  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:40.547549  1761 tablet_bootstrap.cc:492] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:40.549039  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:40.550212  1926 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.550709  1926 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.551213  1926 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:40.562958  1686 leader_election.cc:343] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.575408  1941 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.576107  1941 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.579277  1941 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:40.536492  1958 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:40.581939  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:40.582954  1719 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:40.583766  1926 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.585422  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:40.586364  1570 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:40.588748  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:40.590092  1941 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.590651  1941 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.591358  1761 tablet_bootstrap.cc:654] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.593693  1941 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.598304  1762 tablet_bootstrap.cc:492] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:40.605420  1762 ts_tablet_manager.cc:1403] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.103s	user 0.027s	sys 0.032s
I20260709 12:56:40.607416  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:40.608390  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:40.609392  1645 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.611692  1762 raft_consensus.cc:359] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.612434  1762 raft_consensus.cc:385] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.612757  1762 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.613512  1762 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.616840  1926 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:56:40.619943  1686 leader_election.cc:343] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.623586  1941 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.628261  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:40.629199  1570 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.630268  1765 tablet_bootstrap.cc:492] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:40.630771  1765 ts_tablet_manager.cc:1403] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.115s	user 0.019s	sys 0.031s
I20260709 12:56:40.632220  1762 ts_tablet_manager.cc:1434] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:56:40.633490  1762 tablet_bootstrap.cc:492] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:40.640470  1645 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:40.642624  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:40.646349  1761 tablet_bootstrap.cc:492] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:40.646847  1761 ts_tablet_manager.cc:1403] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.005s
I20260709 12:56:40.648587  1926 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.651161  1926 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:40.652892  1926 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.654839  1761 raft_consensus.cc:359] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.655627  1761 raft_consensus.cc:385] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.655197  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:40.655936  1761 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.656160  1719 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.656750  1761 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.665206  1765 raft_consensus.cc:359] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.666072  1765 raft_consensus.cc:385] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.666394  1765 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.667157  1765 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.654304  1941 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:40.668467  1570 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:40.669718  1762 tablet_bootstrap.cc:654] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.671249  1761 ts_tablet_manager.cc:1434] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:56:40.672308  1761 tablet_bootstrap.cc:492] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:40.672511  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:40.674145  1941 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.674768  1941 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:40.676100  1941 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.678805  1719 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:40.693908  1469 catalog_manager.cc:5697] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:40.700870  1765 ts_tablet_manager.cc:1434] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.007s
I20260709 12:56:40.710024  1761 tablet_bootstrap.cc:654] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.718117  1765 tablet_bootstrap.cc:492] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:40.720160  1469 catalog_manager.cc:5697] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:40.724097  1762 tablet_bootstrap.cc:492] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:40.724550  1762 ts_tablet_manager.cc:1403] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.012s
I20260709 12:56:40.731020  1762 raft_consensus.cc:359] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.731500  1762 raft_consensus.cc:385] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.731736  1762 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.732328  1762 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.734691  1762 ts_tablet_manager.cc:1434] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:56:40.736071  1762 tablet_bootstrap.cc:492] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:40.742267  1765 tablet_bootstrap.cc:654] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:40.742916  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:40.746330  1762 tablet_bootstrap.cc:654] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.747172  1761 tablet_bootstrap.cc:492] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:40.747761  1761 ts_tablet_manager.cc:1403] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.001s
I20260709 12:56:40.753367  1761 raft_consensus.cc:359] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.754204  1761 raft_consensus.cc:385] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.754516  1761 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.755235  1762 tablet_bootstrap.cc:492] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:40.755118  1761 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.755643  1762 ts_tablet_manager.cc:1403] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.002s
I20260709 12:56:40.757237  1761 ts_tablet_manager.cc:1434] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:56:40.758091  1761 tablet_bootstrap.cc:492] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:40.762436  1926 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.762956  1762 raft_consensus.cc:359] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.762974  1926 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.763908  1762 raft_consensus.cc:385] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.764307  1762 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.770668  1762 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.773015  1761 tablet_bootstrap.cc:654] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.774274  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:40.776398  1686 leader_election.cc:343] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.780745  1762 ts_tablet_manager.cc:1434] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 12:56:40.781965  1762 tablet_bootstrap.cc:492] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:40.784548  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:40.785943  1684 leader_election.cc:343] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.786324  1684 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:40.787119  1958 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:40.788194  1926 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:40.796535  1765 tablet_bootstrap.cc:492] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:40.796787  1762 tablet_bootstrap.cc:654] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.797032  1765 ts_tablet_manager.cc:1403] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.007s
I20260709 12:56:40.799312  1765 raft_consensus.cc:359] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.800010  1765 raft_consensus.cc:385] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.800294  1765 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.801281  1761 tablet_bootstrap.cc:492] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:40.800902  1765 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.801457  1762 tablet_bootstrap.cc:492] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:40.801702  1761 ts_tablet_manager.cc:1403] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.044s	user 0.002s	sys 0.018s
I20260709 12:56:40.801865  1762 ts_tablet_manager.cc:1403] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.005s
I20260709 12:56:40.803249  1765 ts_tablet_manager.cc:1434] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:56:40.804100  1761 raft_consensus.cc:359] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.804306  1762 raft_consensus.cc:359] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.804735  1761 raft_consensus.cc:385] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.804795  1765 tablet_bootstrap.cc:492] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:40.804982  1762 raft_consensus.cc:385] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.805086  1761 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.805513  1762 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.805769  1761 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.806164  1762 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.811452  1765 tablet_bootstrap.cc:654] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.811760  1761 ts_tablet_manager.cc:1434] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:56:40.812696  1761 tablet_bootstrap.cc:492] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:40.813617  1762 ts_tablet_manager.cc:1434] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:56:40.814743  1762 tablet_bootstrap.cc:492] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:40.820796  2007 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.821419  1762 tablet_bootstrap.cc:654] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.821264  2007 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.823817  2007 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:40.824553  1761 tablet_bootstrap.cc:654] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.826836  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:40.827401  1979 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.827837  1979 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.828050  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:40.829736  1979 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:40.830397  1537 leader_election.cc:343] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.832237  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:40.833734  1535 leader_election.cc:343] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.834302  1535 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:40.834935  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:40.835532  1979 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:40.835851  1644 raft_consensus.cc:2393] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:40.837088  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:40.838167  1979 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.846402  1765 tablet_bootstrap.cc:492] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:40.846724  1979 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:40.847008  1765 ts_tablet_manager.cc:1403] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.008s
I20260709 12:56:40.850709  1765 raft_consensus.cc:359] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.851789  1765 raft_consensus.cc:385] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.852118  1765 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.854226  1765 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.855650  1926 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.856331  1761 tablet_bootstrap.cc:492] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:40.856822  1761 ts_tablet_manager.cc:1403] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.008s
I20260709 12:56:40.856958  1926 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.857762  1765 ts_tablet_manager.cc:1434] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:56:40.858848  1765 tablet_bootstrap.cc:492] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:40.860225  1761 raft_consensus.cc:359] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.863997  1761 raft_consensus.cc:385] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.864311  1761 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.865276  1761 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.867647  1761 ts_tablet_manager.cc:1434] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:56:40.868839  1761 tablet_bootstrap.cc:492] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:40.869881  1765 tablet_bootstrap.cc:654] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.874217  1808 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.874993  1808 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.878221  1761 tablet_bootstrap.cc:654] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.885231  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:40.886214  1645 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:40.878218  1762 tablet_bootstrap.cc:492] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:40.889175  1762 ts_tablet_manager.cc:1403] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.075s	user 0.026s	sys 0.015s
I20260709 12:56:40.889559  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:40.890915  1926 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:40.891701  1958 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.900453  1958 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.901051  1958 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.892685  1762 raft_consensus.cc:359] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.906359  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:40.907378  1569 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:40.906394  1762 raft_consensus.cc:385] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.909118  1762 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.909663  1808 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:40.909919  1762 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.899713  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:40.917220  2007 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.917938  2007 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.917042  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:40.923141  1645 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:40.926012  1684 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:40.927525  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:40.927945  2007 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:40.928292  1645 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:40.928681  1762 ts_tablet_manager.cc:1434] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 12:56:40.930188  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:40.930573  1762 tablet_bootstrap.cc:492] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:40.931351  2007 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.931874  2007 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.932330  2007 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:40.933763  1686 leader_election.cc:343] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.937683  1926 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.939738  1926 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.940433  1926 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.969525  1761 tablet_bootstrap.cc:492] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:40.970144  1761 ts_tablet_manager.cc:1403] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.017s
I20260709 12:56:40.986563  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:40.987077  1719 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:40.989056  2033 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.989526  2033 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.991031  1762 tablet_bootstrap.cc:654] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.993919  1958 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.997337  1958 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:40.998370  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:40.998248  1761 raft_consensus.cc:359] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:40.998912  1761 raft_consensus.cc:385] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.998908  1645 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.000253  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:41.000440  1926 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.002122  1761 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.002547  1967 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:41.003551  1926 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:41.003675  1967 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.005553  2033 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:41.005553  1967 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.006961  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:41.007534  1645 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:41.007963  2033 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.008503  1761 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:41.009280  1612 leader_election.cc:343] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.009477  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:41.010035  1644 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.008826  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:41.012913  1647 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:41.013175  1761 ts_tablet_manager.cc:1434] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:56:41.013288  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:41.014189  2033 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:41.014394  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:41.014707  1761 tablet_bootstrap.cc:492] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
W20260709 12:56:41.015837  1686 leader_election.cc:343] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.016323  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:41.016978  1569 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.019049  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:41.018218  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:41.021623  1686 leader_election.cc:343] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.023620  1808 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.023718  2007 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.015172  1958 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:41.024060  1765 tablet_bootstrap.cc:492] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:41.014750  2033 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:41.024977  1958 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:41.026626  1958 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.028914  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:41.029495  1645 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.031579  1569 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:41.027776  1765 ts_tablet_manager.cc:1403] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.169s	user 0.045s	sys 0.070s
I20260709 12:56:41.036126  1958 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.038842  1719 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:41.027643  1644 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:41.038887  2033 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.040210  1684 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:41.044430  1761 tablet_bootstrap.cc:654] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.047175  2007 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.051819  1958 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:41.052547  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:41.053190  1716 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.053562  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:41.054378  1646 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.048707  1941 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:41.057377  1941 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.059545  1941 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.044759  1926 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:41.061106  1926 raft_consensus.cc:697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:41.061972  1926 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.064193  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:41.064582  1646 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
W20260709 12:56:41.065665  1612 leader_election.cc:343] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.066179  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:41.070537  1808 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:41.068868  1716 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:41.077790  1808 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:41.078671  1808 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.081117  1537 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:41.079392  1765 raft_consensus.cc:359] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.082769  1765 raft_consensus.cc:385] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.082943  1765 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.083868  2006 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:41.085387  2006 raft_consensus.cc:697] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:41.086817  1645 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:41.086213  2006 consensus_queue.cc:237] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.089514  1467 catalog_manager.cc:5697] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:41.091648  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:41.092406  1967 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:41.101260  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:41.101434  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:41.102381  1716 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:41.103638  1967 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:41.095600  1765 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.115221  1765 ts_tablet_manager.cc:1434] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 12:56:41.116510  1765 tablet_bootstrap.cc:492] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:41.104100  1967 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.121834  1967 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.124168  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:41.126385  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:41.127434  1941 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:41.127789  1941 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:41.128386  1941 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.124871  1570 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:41.129698  1612 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:41.112097  2040 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:41.127713  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:41.130892  2040 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:41.126494  1686 leader_election.cc:343] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.132385  1766 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:41.140813  1766 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:41.141281  1766 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:41.142129  1612 leader_election.cc:343] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.131837  1467 catalog_manager.cc:5697] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.132550  1967 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:56:41.143188  1941 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.146636  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:56:41.150640  1612 leader_election.cc:343] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.157075  1808 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:41.164593  1765 tablet_bootstrap.cc:654] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.165776  1941 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.185631  1469 catalog_manager.cc:5697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:41.191141  1469 catalog_manager.cc:5697] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:41.183652  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:41.195753  1716 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.207363  1761 tablet_bootstrap.cc:492] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:41.213853  1762 tablet_bootstrap.cc:492] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:41.214452  1762 ts_tablet_manager.cc:1403] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.284s	user 0.018s	sys 0.015s
I20260709 12:56:41.214452  1761 ts_tablet_manager.cc:1403] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.200s	user 0.017s	sys 0.008s
I20260709 12:56:41.218166  1762 raft_consensus.cc:359] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.218961  1762 raft_consensus.cc:385] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.219250  1762 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.219424  1765 tablet_bootstrap.cc:492] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:41.220093  1765 ts_tablet_manager.cc:1403] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.014s
I20260709 12:56:41.219938  1761 raft_consensus.cc:359] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.221402  1761 raft_consensus.cc:385] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.223078  1761 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.223928  1761 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.225486  2040 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:41.208986  1926 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:56:41.240132  1967 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:41.221249  1762 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.242352  1761 ts_tablet_manager.cc:1434] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 12:56:41.261148  1762 ts_tablet_manager.cc:1434] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.011s
I20260709 12:56:41.264976  1761 tablet_bootstrap.cc:492] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
W20260709 12:56:41.271911  1673 tablet.cc:2406] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:56:41.272611  1762 tablet_bootstrap.cc:492] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:41.273468  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:41.240840  1967 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.283915  1967 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.284969  1765 raft_consensus.cc:359] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.287048  1716 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:41.287448  1765 raft_consensus.cc:385] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.287916  1765 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.288702  1765 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:41.290514  1684 leader_election.cc:343] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.292106  1766 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.294376  1766 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.269899  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:41.299041  1686 leader_election.cc:343] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.299518  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:41.302919  1765 ts_tablet_manager.cc:1434] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.001s
I20260709 12:56:41.304548  2048 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:41.305114  2048 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.307610  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:41.315462  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:41.308465  1717 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:41.300448  2040 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:41.308485  2048 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.320724  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:41.322321  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:41.325933  1765 tablet_bootstrap.cc:492] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:41.327318  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:41.319476  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:41.329253  1570 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.335297  1967 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:41.337741  2050 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:41.338212  2050 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:41.338605  2050 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:41.343719  1612 leader_election.cc:343] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:41.347285  1612 leader_election.cc:343] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.346823  1967 raft_consensus.cc:697] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:41.350004  1571 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.350237  1967 consensus_queue.cc:237] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.354202  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:41.365005  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:41.378747  1612 leader_election.cc:343] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.398178  1761 tablet_bootstrap.cc:654] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.365149  2051 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 12:56:41.425235  1968 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:41.426352  1968 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:41.444016  1612 leader_election.cc:343] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.446220  1968 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.447137  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:41.450186  1941 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:41.457667  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:41.460304  1537 leader_election.cc:343] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.462491  1570 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:41.467207  1612 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:41.472734  2052 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:41.473359  2052 raft_consensus.cc:697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:41.475720  1762 tablet_bootstrap.cc:654] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.484724  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:41.474753  2052 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:41.489136  1535 leader_election.cc:343] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:41.489701  1535 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:41.491787  2054 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:41.515687  1468 catalog_manager.cc:5697] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.548496  1765 tablet_bootstrap.cc:654] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.559860  1761 tablet_bootstrap.cc:492] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:41.560323  1761 ts_tablet_manager.cc:1403] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.299s	user 0.020s	sys 0.015s
I20260709 12:56:41.573416  1761 raft_consensus.cc:359] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.573858  1761 raft_consensus.cc:385] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.574008  1761 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.574589  1761 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.513888  2050 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:41.584071  1686 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:41.590596  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:41.591647  1720 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.593483  1761 ts_tablet_manager.cc:1434] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:56:41.594506  1761 tablet_bootstrap.cc:492] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:41.593101  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:56:41.600620  1612 leader_election.cc:343] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:41.602583  1686 consensus_peers.cc:597] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:41.588150  2050 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.610375  2040 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:41.614393  2033 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:41.638413  2006 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.638705  1762 tablet_bootstrap.cc:492] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:41.639408  1762 ts_tablet_manager.cc:1403] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.369s	user 0.018s	sys 0.059s
I20260709 12:56:41.643271  1762 raft_consensus.cc:359] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.644141  1762 raft_consensus.cc:385] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.644438  1762 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.645237  1762 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.647094  1762 ts_tablet_manager.cc:1434] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:56:41.648205  1762 tablet_bootstrap.cc:492] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:41.651721  2033 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:41.654834  2033 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:41.658399  1765 tablet_bootstrap.cc:492] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:41.658846  1765 ts_tablet_manager.cc:1403] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.333s	user 0.035s	sys 0.006s
I20260709 12:56:41.659184  1762 tablet_bootstrap.cc:654] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.659509  1761 tablet_bootstrap.cc:654] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.650357  1720 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:41.672181  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:41.671401  1765 raft_consensus.cc:359] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.673629  1765 raft_consensus.cc:385] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.673934  1765 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.674661  1765 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.675575  1967 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:41.677501  1967 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:41.680728  1967 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.690726  1765 ts_tablet_manager.cc:1434] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.005s
I20260709 12:56:41.705343  1765 tablet_bootstrap.cc:492] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:41.702454  2054 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:41.710212  1762 tablet_bootstrap.cc:492] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:41.710594  1762 ts_tablet_manager.cc:1403] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.017s
I20260709 12:56:41.738632  1761 tablet_bootstrap.cc:492] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:41.739208  1761 ts_tablet_manager.cc:1403] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.007s
I20260709 12:56:41.743429  1761 raft_consensus.cc:359] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.744144  1761 raft_consensus.cc:385] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.746915  1761 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.747658  1761 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.749610  1761 ts_tablet_manager.cc:1434] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:56:41.750898  1761 tablet_bootstrap.cc:492] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:41.797335  1762 raft_consensus.cc:359] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.798171  1762 raft_consensus.cc:385] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.798485  1762 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:41.799249  1762 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.805802  1762 ts_tablet_manager.cc:1434] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.095s	user 0.015s	sys 0.020s
I20260709 12:56:41.806850  1762 tablet_bootstrap.cc:492] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:41.807327  1765 tablet_bootstrap.cc:654] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.810881  1468 catalog_manager.cc:5697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.812686  1761 tablet_bootstrap.cc:654] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.812974  1979 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:41.813623  1979 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.829963  1967 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:41.835937  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:41.888705  2033 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:41.889602  2033 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.897616  1979 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:41.906287  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:41.907158  2033 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:41.908061  1762 tablet_bootstrap.cc:654] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:41.918828  1537 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:41.915777  1765 tablet_bootstrap.cc:492] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:41.955803  1765 ts_tablet_manager.cc:1403] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.251s	user 0.008s	sys 0.046s
I20260709 12:56:41.957285  2054 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:41.969777  1765 raft_consensus.cc:359] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.970718  1765 raft_consensus.cc:385] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.971030  1765 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
W20260709 12:56:41.972663  1612 consensus_peers.cc:597] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:41.971837  1765 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.978152  1469 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.973167  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:41.915210  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:41.981276  1570 raft_consensus.cc:2393] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:41.982555  1765 ts_tablet_manager.cc:1434] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:56:41.982698  1761 tablet_bootstrap.cc:492] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:41.983109  1761 ts_tablet_manager.cc:1403] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.232s	user 0.029s	sys 0.016s
I20260709 12:56:41.983500  1765 tablet_bootstrap.cc:492] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:41.993288  1761 raft_consensus.cc:359] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:41.994155  1761 raft_consensus.cc:385] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:41.994479  1761 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.010561  1686 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.012773  1719 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.024534  2033 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.015131  1761 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.031147  1761 ts_tablet_manager.cc:1434] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.006s
I20260709 12:56:42.032230  1761 tablet_bootstrap.cc:492] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:42.043272  2050 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.043960  2050 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.045933  2052 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:42.048105  2050 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.035684  1967 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.049054  1967 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.051877  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.053491  1967 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.054384  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:42.053591  1612 leader_election.cc:343] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:42.059614  1612 leader_election.cc:343] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.065315  2074 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.072336  2074 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.079734  2074 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.081009  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.082171  1720 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:42.085172  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:42.086004  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:42.085697  2052 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:42.089246  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.089968  1715 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:42.092008  2040 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.092290  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.092715  2040 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.094370  2007 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.096673  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:42.102605  1765 tablet_bootstrap.cc:654] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.103657  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.104609  1719 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:42.108856  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.109092  2040 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:42.110504  1762 tablet_bootstrap.cc:492] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:42.111012  1762 ts_tablet_manager.cc:1403] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.304s	user 0.027s	sys 0.088s
I20260709 12:56:42.111928  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:42.112357  1761 tablet_bootstrap.cc:654] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.112565  1645 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:42.119216  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:42.125038  2033 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:42.125471  2033 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:42.125916  2033 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:42.128763  1686 leader_election.cc:343] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.132210  1762 raft_consensus.cc:359] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.133435  1762 raft_consensus.cc:385] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.133723  1762 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.134857  1762 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.105486  1967 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:42.135329  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:42.141902  1762 ts_tablet_manager.cc:1434] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 12:56:42.141418  2050 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:42.142724  2050 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:42.143052  1762 tablet_bootstrap.cc:492] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:42.143175  2050 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.137307  1926 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.144943  1926 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.139249  1967 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:42.174032  2033 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.180668  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.186679  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:42.187942  1926 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:42.188141  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:42.187342  2033 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:42.157392  1967 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:42.195866  1684 leader_election.cc:343] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.197487  1571 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.194700  2007 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:42.209249  1686 leader_election.cc:343] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.209976  1686 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.213353  1926 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.218439  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:42.217504  2050 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:42.224027  1686 leader_election.cc:343] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.225787  1645 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:42.226485  1761 tablet_bootstrap.cc:492] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:42.226984  1761 ts_tablet_manager.cc:1403] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.195s	user 0.022s	sys 0.033s
I20260709 12:56:42.231068  2050 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.210621  1967 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.232369  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.260430  1926 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.260514  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:42.260833  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:42.261874  1716 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:56:42.264870  1612 leader_election.cc:343] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.265748  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:42.269965  2050 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:42.271610  2052 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.279475  1762 tablet_bootstrap.cc:654] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.281862  1761 raft_consensus.cc:359] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.282701  1761 raft_consensus.cc:385] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.283030  1761 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.289991  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:42.280373  1967 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.294754  1761 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:42.296131  1612 leader_election.cc:343] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.298101  1761 ts_tablet_manager.cc:1434] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 12:56:42.306699  1765 tablet_bootstrap.cc:492] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:42.307639  1765 ts_tablet_manager.cc:1403] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.324s	user 0.016s	sys 0.012s
I20260709 12:56:42.308913  2080 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:42.310169  1761 tablet_bootstrap.cc:492] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:42.310954  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:42.311537  1720 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.313796  1765 raft_consensus.cc:359] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.314549  1765 raft_consensus.cc:385] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.315165  1765 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.316181  1765 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.336239  1720 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:42.337527  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:42.338258  2080 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:42.338857  2080 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:42.339522  1761 tablet_bootstrap.cc:654] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.340039  2080 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.358155  1761 tablet_bootstrap.cc:492] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:42.358659  1761 ts_tablet_manager.cc:1403] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.003s
I20260709 12:56:42.339653  1765 ts_tablet_manager.cc:1434] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 12:56:42.366677  1765 tablet_bootstrap.cc:492] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:42.372164  1761 raft_consensus.cc:359] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.373066  1761 raft_consensus.cc:385] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.373500  1761 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.375299  1762 tablet_bootstrap.cc:492] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:42.375903  1762 ts_tablet_manager.cc:1403] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.233s	user 0.023s	sys 0.008s
I20260709 12:56:42.380033  1762 raft_consensus.cc:359] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.380760  1762 raft_consensus.cc:385] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.381028  1762 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.381843  1762 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.384343  1762 ts_tablet_manager.cc:1434] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:56:42.385454  1762 tablet_bootstrap.cc:492] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:42.392234  1761 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.392725  1468 catalog_manager.cc:5697] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:42.394856  1762 tablet_bootstrap.cc:654] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.394548  1761 ts_tablet_manager.cc:1434] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:56:42.398439  1761 tablet_bootstrap.cc:492] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:42.400252  1765 tablet_bootstrap.cc:654] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.407347  1979 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.407951  1979 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.410162  1979 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.412127  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:42.413453  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.414278  1719 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:42.415419  1537 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.417030  1979 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.422376  1761 tablet_bootstrap.cc:654] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.426399  1765 tablet_bootstrap.cc:492] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:42.426769  1765 ts_tablet_manager.cc:1403] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.008s
I20260709 12:56:42.430518  1765 raft_consensus.cc:359] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.431057  1765 raft_consensus.cc:385] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.431272  1765 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.431851  1765 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.433673  1765 ts_tablet_manager.cc:1434] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:56:42.434563  1765 tablet_bootstrap.cc:492] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:42.438374  1926 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.438794  1926 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.439241  1765 tablet_bootstrap.cc:654] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.442063  1762 tablet_bootstrap.cc:492] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:42.442505  1762 ts_tablet_manager.cc:1403] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.011s
I20260709 12:56:42.443676  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.444013  1979 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.444572  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:42.444919  1686 leader_election.cc:343] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.444401  1926 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:42.442993  1761 tablet_bootstrap.cc:492] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:42.445976  1761 ts_tablet_manager.cc:1403] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.009s
W20260709 12:56:42.446779  1684 leader_election.cc:343] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.447242  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.447283  1762 raft_consensus.cc:359] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.448199  1762 raft_consensus.cc:385] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.448551  1762 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.448331  1926 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.448791  1761 raft_consensus.cc:359] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.449471  1761 raft_consensus.cc:385] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.449765  1761 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.450416  1761 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.452359  1761 ts_tablet_manager.cc:1434] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:56:42.457104  1761 tablet_bootstrap.cc:492] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:42.455209  1762 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.469784  1762 ts_tablet_manager.cc:1434] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 12:56:42.470747  1762 tablet_bootstrap.cc:492] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:42.470929  1761 tablet_bootstrap.cc:654] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.478160  1765 tablet_bootstrap.cc:492] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:42.478672  1765 ts_tablet_manager.cc:1403] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.010s
I20260709 12:56:42.481408  1765 raft_consensus.cc:359] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.482172  1765 raft_consensus.cc:385] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.482453  1765 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.483158  1765 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.485473  1765 ts_tablet_manager.cc:1434] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:56:42.486325  1765 tablet_bootstrap.cc:492] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:42.490070  1762 tablet_bootstrap.cc:654] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.493003  1765 tablet_bootstrap.cc:654] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.496219  1761 tablet_bootstrap.cc:492] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:42.496765  1761 ts_tablet_manager.cc:1403] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.009s
I20260709 12:56:42.500547  1761 raft_consensus.cc:359] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.501385  1761 raft_consensus.cc:385] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.501681  1761 raft_consensus.cc:740] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.502521  1761 consensus_queue.cc:260] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.505627  1761 ts_tablet_manager.cc:1434] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:56:42.506174  1765 tablet_bootstrap.cc:492] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:42.507169  1761 tablet_bootstrap.cc:492] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:42.507295  1765 ts_tablet_manager.cc:1403] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:56:42.511461  1765 raft_consensus.cc:359] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.512140  1765 raft_consensus.cc:385] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.512425  1765 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.513267  1765 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.514201  2052 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.515264  1762 tablet_bootstrap.cc:492] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:42.515630  1765 ts_tablet_manager.cc:1434] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:56:42.515820  1762 ts_tablet_manager.cc:1403] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.000s
I20260709 12:56:42.514814  2052 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.516776  1765 tablet_bootstrap.cc:492] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:42.518682  2052 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.519817  1762 raft_consensus.cc:359] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.522344  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.523355  1719 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:42.525777  1612 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:42.525987  1762 raft_consensus.cc:385] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.526358  1762 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.530448  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.531322  1762 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.531555  1572 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:42.530582  1761 tablet_bootstrap.cc:654] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.538328  2052 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:42.545367  2052 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:42.545918  2052 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.547186  1762 ts_tablet_manager.cc:1434] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 12:56:42.548995  1762 tablet_bootstrap.cc:492] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:42.556348  1765 tablet_bootstrap.cc:654] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.557919  2052 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.563469  2052 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.563480  1762 tablet_bootstrap.cc:654] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.567239  1761 tablet_bootstrap.cc:492] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:42.567780  1761 ts_tablet_manager.cc:1403] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.011s
I20260709 12:56:42.567780  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:42.569216  1571 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.571710  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:42.571884  1761 raft_consensus.cc:359] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.572424  1720 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.572577  1761 raft_consensus.cc:385] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.573130  1761 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.573918  1761 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.576339  1761 ts_tablet_manager.cc:1434] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:56:42.581600  1761 tablet_bootstrap.cc:492] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:42.583662  1765 tablet_bootstrap.cc:492] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:42.584896  2052 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.584126  1765 ts_tablet_manager.cc:1403] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.010s
I20260709 12:56:42.588805  1765 raft_consensus.cc:359] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.589430  1765 raft_consensus.cc:385] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.589202  2052 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.590162  1765 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.585681  1926 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.591933  1979 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.591663  1926 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.592543  1979 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.595630  1979 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.591195  1765 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.594336  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.598579  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:42.598675  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.599030  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.599696  1572 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:42.602726  1762 tablet_bootstrap.cc:492] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:42.603276  1762 ts_tablet_manager.cc:1403] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.003s
I20260709 12:56:42.603083  1720 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:42.605338  1761 tablet_bootstrap.cc:654] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.606012  1926 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:42.606925  2050 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.607518  2050 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.612862  1571 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:42.614888  1612 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:42.615098  2050 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.615903  2052 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.610162  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:42.618248  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:42.608736  1762 raft_consensus.cc:359] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.618980  1762 raft_consensus.cc:385] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.619167  1762 raft_consensus.cc:740] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.621479  2033 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:42.622011  2033 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:42.622282  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.622535  2033 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.618016  1647 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:42.624403  2050 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:42.625066  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.625926  1719 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:42.625149  2050 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:42.627632  2050 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.628407  1612 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:42.629943  2080 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:42.630478  2080 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:42.630885  2080 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.631728  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.632458  1572 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:42.644743  1765 ts_tablet_manager.cc:1434] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.059s	user 0.002s	sys 0.005s
I20260709 12:56:42.646164  1765 tablet_bootstrap.cc:492] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:42.655090  2080 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.659001  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:42.660956  1571 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.651103  1762 consensus_queue.cc:260] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.663306  1762 ts_tablet_manager.cc:1434] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.004s
I20260709 12:56:42.664443  1762 tablet_bootstrap.cc:492] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:42.669648  2080 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.676532  1569 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.676626  1537 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.678061  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:42.698271  1720 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.707023  2033 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.708717  1716 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:42.711692  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:42.713148  2052 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.720018  2033 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:42.721149  1761 tablet_bootstrap.cc:492] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:42.724020  1761 ts_tablet_manager.cc:1403] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.143s	user 0.027s	sys 0.021s
I20260709 12:56:42.722980  1762 tablet_bootstrap.cc:654] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.728075  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:42.729593  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:42.729758  1720 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:42.730369  1572 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.731019  1761 raft_consensus.cc:359] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.731513  1761 raft_consensus.cc:385] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.731683  1761 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.732123  1761 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.726178  1467 catalog_manager.cc:5697] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:42.732817  2007 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.734454  1612 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:42.741483  1761 ts_tablet_manager.cc:1434] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:56:42.736296  2050 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:42.745149  1765 tablet_bootstrap.cc:654] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.745770  1761 tablet_bootstrap.cc:492] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:42.747008  2050 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:42.752962  2050 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.755089  2080 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:42.770248  2052 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.786684  1572 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:42.798694  1571 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:42.804271  1926 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.804860  1926 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:42.805635  2105 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:56:42.807160  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:42.808282  2033 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:42.813011  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.814193  1468 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:42.815730  1646 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:42.817063  1926 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:42.808781  2033 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:42.831177  1765 tablet_bootstrap.cc:492] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:42.832059  1765 ts_tablet_manager.cc:1403] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.186s	user 0.024s	sys 0.001s
I20260709 12:56:42.832458  1762 tablet_bootstrap.cc:492] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:42.832896  1762 ts_tablet_manager.cc:1403] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.169s	user 0.017s	sys 0.008s
W20260709 12:56:42.833779  1686 leader_election.cc:343] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.835784  2033 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.837245  1762 raft_consensus.cc:359] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.837911  1762 raft_consensus.cc:385] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.838152  1762 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.838788  1762 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.842928  1762 ts_tablet_manager.cc:1434] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:56:42.843808  1762 tablet_bootstrap.cc:492] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:42.845567  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:42.846946  1761 tablet_bootstrap.cc:654] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:42.853478  1684 leader_election.cc:343] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.854128  1684 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.862975  2110 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.867213  2007 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.867703  2007 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.871582  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.871188  2007 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.872227  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:42.872632  1765 raft_consensus.cc:359] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.872249  1716 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:42.873440  1765 raft_consensus.cc:385] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.873787  1765 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
W20260709 12:56:42.874577  1535 leader_election.cc:343] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.874619  1765 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.875589  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.877089  2080 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.877496  2102 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:42.877538  2080 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.878005  2102 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:42.878417  2102 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.877538  1468 catalog_manager.cc:5697] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:42.879626  2080 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.886545  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.887147  1716 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:42.887809  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:42.888262  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:56:42.889091  1612 leader_election.cc:343] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.889437  2102 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.889804  2080 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:42.890209  2080 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:42.890529  2080 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.891899  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:42.892311  2102 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.877981  1765 ts_tablet_manager.cc:1434] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.010s
I20260709 12:56:42.892400  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:42.892964  1720 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:42.893173  1535 leader_election.cc:343] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.893430  1765 tablet_bootstrap.cc:492] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:42.899215  1720 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:56:42.900223  2102 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.900298  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.901332  2007 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:42.901991  2007 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:42.902391  1765 tablet_bootstrap.cc:654] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:42.903779  2107 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:56:42.903087  2007 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.916222  2080 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.922372  2080 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.923349  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:56:42.925259  1612 leader_election.cc:343] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.925418  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:42.926071  1716 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:42.928304  2074 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.928946  2074 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.935194  2074 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.936115  1762 tablet_bootstrap.cc:654] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.936806  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:42.937491  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:42.900753  2102 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.942404  1537 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.943310  2074 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.944311  2102 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:42.945012  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:42.946188  1535 leader_election.cc:343] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.947324  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:42.948751  1537 leader_election.cc:343] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.949191  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:42.950213  2102 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:42.956017  1716 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:42.957091  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:42.958506  2080 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:42.959578  2080 raft_consensus.cc:697] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:42.960875  2080 consensus_queue.cc:237] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.961836  1761 tablet_bootstrap.cc:492] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:42.963295  1761 ts_tablet_manager.cc:1403] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.219s	user 0.018s	sys 0.005s
I20260709 12:56:42.964301  1762 tablet_bootstrap.cc:492] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:42.964347  1765 tablet_bootstrap.cc:492] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:42.964848  1762 ts_tablet_manager.cc:1403] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.002s
I20260709 12:56:42.964942  1765 ts_tablet_manager.cc:1403] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.036s
I20260709 12:56:42.967268  1762 raft_consensus.cc:359] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.967859  1762 raft_consensus.cc:385] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.968111  1762 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.968271  2050 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:42.968722  1762 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.971359  1762 ts_tablet_manager.cc:1434] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:56:42.972198  1762 tablet_bootstrap.cc:492] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:42.974237  1468 catalog_manager.cc:5697] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:42.972823  1761 raft_consensus.cc:359] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.977800  1761 raft_consensus.cc:385] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.978114  1761 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.978904  1762 tablet_bootstrap.cc:654] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.978820  1761 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.968237  1765 raft_consensus.cc:359] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.980876  1765 raft_consensus.cc:385] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:42.981156  1765 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:42.981263  1761 ts_tablet_manager.cc:1434] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:56:42.981793  1765 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.983352  1761 tablet_bootstrap.cc:492] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:42.983752  1765 ts_tablet_manager.cc:1434] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.000s
I20260709 12:56:42.984740  1765 tablet_bootstrap.cc:492] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:42.989960  2110 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:42.990391  2110 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:42.994029  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:42.995370  1686 leader_election.cc:343] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:42.992511  2110 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:42.997216  1765 tablet_bootstrap.cc:654] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:42.999503  2080 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:43.001299  2080 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.003589  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:43.003803  2081 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:43.004488  1645 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:43.004523  2081 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.009936  2080 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:43.012377  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:43.014197  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:43.017326  1612 leader_election.cc:343] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:43.018893  2081 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:43.022531  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:43.023989  1717 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:43.024457  1684 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:43.025808  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:43.026914  1926 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:43.026983  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:43.027500  1926 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:43.027993  1926 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.035928  1761 tablet_bootstrap.cc:654] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:43.037163  1468 catalog_manager.cc:5697] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:43.039870  2050 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:43.040751  1612 leader_election.cc:343] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:43.041790  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:43.048743  2080 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:43.055155  1570 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.053391  2050 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:43.062049  1762 tablet_bootstrap.cc:492] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:43.064488  1762 ts_tablet_manager.cc:1403] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.092s	user 0.024s	sys 0.028s
I20260709 12:56:43.068370  1765 tablet_bootstrap.cc:492] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:43.068814  1765 ts_tablet_manager.cc:1403] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.084s	user 0.024s	sys 0.023s
I20260709 12:56:43.072984  1765 raft_consensus.cc:359] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.073666  1765 raft_consensus.cc:385] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:43.073942  1765 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:43.074626  1765 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.080698  1765 ts_tablet_manager.cc:1434] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:56:43.080606  1926 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.085414  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:43.087412  1765 tablet_bootstrap.cc:492] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
W20260709 12:56:43.088248  1686 leader_election.cc:343] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:43.090399  1926 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:43.094743  2081 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:43.095309  1761 tablet_bootstrap.cc:492] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:43.095749  1761 ts_tablet_manager.cc:1403] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.014s
I20260709 12:56:43.097894  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:43.098398  1645 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.099412  2110 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:43.099871  2110 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.102255  2110 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:43.105134  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:43.105798  1646 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:43.106668  1645 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:43.106739  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:43.107858  1762 raft_consensus.cc:359] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.109057  1762 raft_consensus.cc:385] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:43.109333  1762 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:43.109382  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:43.110378  1684 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:43.111807  2040 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:43.112212  2040 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:43.112586  2040 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.112913  1926 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:43.113363  1926 raft_consensus.cc:697] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:43.114456  1765 tablet_bootstrap.cc:654] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:43.114074  1926 consensus_queue.cc:237] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.118430  1761 raft_consensus.cc:359] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.110117  1762 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.120936  1762 ts_tablet_manager.cc:1434] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:56:43.121249  1761 raft_consensus.cc:385] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:43.121510  1761 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:43.122071  1761 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.124754  1762 tablet_bootstrap.cc:492] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:43.135493  1762 tablet_bootstrap.cc:654] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:43.137158  1765 tablet_bootstrap.cc:492] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:43.137179  1761 ts_tablet_manager.cc:1434] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 12:56:43.137717  1765 ts_tablet_manager.cc:1403] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.007s
I20260709 12:56:43.138509  1761 tablet_bootstrap.cc:492] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:43.138881  1469 catalog_manager.cc:5697] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
W20260709 12:56:43.146553  1686 leader_election.cc:343] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:43.152657  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:43.157110  1761 tablet_bootstrap.cc:654] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:43.176195  2050 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:43.176913  2050 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.179603  2050 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:43.185222  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:43.188076  2110 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:43.188736  2110 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.162551  2040 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.196667  2110 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:43.196784  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:43.197023  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:43.197696  1720 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
W20260709 12:56:43.198163  1612 leader_election.cc:343] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:43.199184  1684 leader_election.cc:343] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:43.218852  2081 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:43.223701  1765 raft_consensus.cc:359] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.225980  2050 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:56:43.230556  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:43.246803  1569 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:43.234071  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:43.234827  2040 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:43.235764  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:43.236614  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:43.250217  1645 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.251295  2050 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:43.251824  2050 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:43.245008  2074 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:43.252472  2050 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.253099  2074 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.256300  1765 raft_consensus.cc:385] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:43.259342  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:43.257481  2074 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:43.261291  1537 leader_election.cc:343] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:43.256593  1765 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:43.275950  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:43.272862  1765 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.279057  1765 ts_tablet_manager.cc:1434] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.000s
I20260709 12:56:43.280102  1765 tablet_bootstrap.cc:492] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:43.281605  2110 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:43.283447  2110 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:43.282546  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:43.285363  1686 leader_election.cc:343] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:43.294433  1535 leader_election.cc:343] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:43.307858  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:43.315208  2074 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:43.284276  2110 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.304225  1645 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:43.312470  2040 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:56:43.321296  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:43.322782  1926 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:43.323945  1926 raft_consensus.cc:697] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:43.324754  1926 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.403729  2074 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:43.404373  2074 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.411641  2074 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:43.429864  1979 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:43.430996  2102 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:43.431658  2102 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.433717  2102 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:43.433770  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:43.438086  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:43.439004  1715 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:56:43.442279  1537 leader_election.cc:343] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:43.491988  1762 tablet_bootstrap.cc:492] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:43.492661  1762 ts_tablet_manager.cc:1403] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.368s	user 0.127s	sys 0.204s
I20260709 12:56:43.495596  1762 raft_consensus.cc:359] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.496474  1762 raft_consensus.cc:385] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:43.496824  1762 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:43.497752  1762 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.499724  1762 ts_tablet_manager.cc:1434] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:56:43.500903  1762 tablet_bootstrap.cc:492] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:43.511530  1762 tablet_bootstrap.cc:654] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:43.529013  1761 tablet_bootstrap.cc:492] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:43.529650  1761 ts_tablet_manager.cc:1403] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.391s	user 0.012s	sys 0.011s
I20260709 12:56:43.537128  1761 raft_consensus.cc:359] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.538008  1761 raft_consensus.cc:385] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:43.538342  1761 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:43.539122  1761 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.542078  1761 ts_tablet_manager.cc:1434] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:56:43.543272  1761 tablet_bootstrap.cc:492] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:43.480139  2050 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.600960  1926 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:56:43.597132  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 45795.2us
I20260709 12:56:43.632023  2110 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.654958  2110 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:43.670735  1765 tablet_bootstrap.cc:654] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:43.657965  2050 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:43.675992  1761 tablet_bootstrap.cc:654] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:43.692631  1762 tablet_bootstrap.cc:492] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:43.693141  1762 ts_tablet_manager.cc:1403] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.193s	user 0.035s	sys 0.091s
I20260709 12:56:43.713261  1762 raft_consensus.cc:359] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.714154  1762 raft_consensus.cc:385] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:43.714447  1762 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:43.715297  1762 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:43.727028  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 123599us
W20260709 12:56:43.726980  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 149886us
I20260709 12:56:43.737246  1762 ts_tablet_manager.cc:1434] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 12:56:43.748950  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:43.765552  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:43.766328  1572 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.793459  1762 tablet_bootstrap.cc:492] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
W20260709 12:56:43.803213  1612 consensus_peers.cc:597] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:43.806319  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:43.813870  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:43.814669  1720 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.800680  2140 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:56:43.819541  1612 leader_election.cc:343] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:43.819628  1572 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:43.824411  1765 tablet_bootstrap.cc:492] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:43.825103  1765 ts_tablet_manager.cc:1403] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.545s	user 0.020s	sys 0.017s
W20260709 12:56:43.823719  1684 leader_election.cc:343] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:43.801235  2080 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:56:43.839555  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:43.840348  1646 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:43.846665  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:43.847308  1646 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:43.847332  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:43.827018  2140 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.873858  1926 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:56:43.875154  1686 consensus_peers.cc:597] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:43.878162  1926 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:43.881029  1765 raft_consensus.cc:359] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.885465  1765 raft_consensus.cc:385] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:43.885751  1765 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:43.878870  1926 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.884948  1720 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:43.919131  1765 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:43.935370  1765 ts_tablet_manager.cc:1434] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.110s	user 0.001s	sys 0.009s
W20260709 12:56:43.949288  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 73150.9us
I20260709 12:56:43.923594  2140 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:43.951558  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:43.971671  1765 tablet_bootstrap.cc:492] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:43.975776  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:43.976837  1979 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:43.977367  1979 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:43.977869  1979 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:43.979326  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:43.980099  1646 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
W20260709 12:56:43.983125  1686 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:43.986291  2152 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:56:43.988579  2052 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:43.965307  2150 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:43.998129  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:43.989256  2052 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:44.019448  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 43756.6us
I20260709 12:56:44.020814  1762 tablet_bootstrap.cc:654] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:43.987401  1469 catalog_manager.cc:5697] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:44.025928  2150 raft_consensus.cc:697] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:44.026724  2102 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:44.028079  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:44.033057  2074 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:44.042743  2150 consensus_queue.cc:237] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.055013  1761 tablet_bootstrap.cc:492] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:44.055599  1761 ts_tablet_manager.cc:1403] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.513s	user 0.020s	sys 0.015s
I20260709 12:56:44.057607  1684 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:44.063045  2140 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:44.089588  1765 tablet_bootstrap.cc:654] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:44.080740  2110 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:44.105094  1761 raft_consensus.cc:359] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.107960  1761 raft_consensus.cc:385] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:44.108330  1761 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
W20260709 12:56:44.108307  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 75582.6us
I20260709 12:56:44.109323  1761 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.098093  2110 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:44.117944  1761 ts_tablet_manager.cc:1434] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.001s
I20260709 12:56:44.132864  2074 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:44.134774  2052 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:44.111717  2110 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:44.141233  2040 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:44.142904  1979 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.146760  1761 tablet_bootstrap.cc:492] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
W20260709 12:56:44.147811  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 74034.7us
I20260709 12:56:44.147342  1571 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:44.154597  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:44.150759  1979 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:44.256855  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 101532us
W20260709 12:56:44.257153  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 101850us
I20260709 12:56:44.263190  2110 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.267150  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:44.267940  1719 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:44.269833  1762 tablet_bootstrap.cc:492] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:44.270581  1762 ts_tablet_manager.cc:1403] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.517s	user 0.022s	sys 0.030s
I20260709 12:56:44.279564  1762 raft_consensus.cc:359] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.280344  1762 raft_consensus.cc:385] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:44.280696  1762 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:44.281880  1762 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.282147  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:44.287029  1645 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:44.292595  1761 tablet_bootstrap.cc:654] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:44.293803  1645 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
W20260709 12:56:44.316570  1612 leader_election.cc:343] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:44.333612  2052 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:44.335886  1572 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:44.335800  2052 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.337771  2052 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:44.339500  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:44.340282  1566 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:44.344842  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:44.345081  2033 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:44.345500  1568 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:44.345741  2033 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.348352  2155 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:44.348929  2155 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.377864  1762 ts_tablet_manager.cc:1434] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.107s	user 0.009s	sys 0.000s
I20260709 12:56:44.379177  1762 tablet_bootstrap.cc:492] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
W20260709 12:56:44.382109  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 47868.4us
I20260709 12:56:44.385056  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:44.386308  2158 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:44.386977  2158 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:56:44.387621  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:44.406369  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:44.407256  1716 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:44.388617  2158 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.410159  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:44.416551  2159 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:56:44.419572  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:44.401326  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:44.389565  2155 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:44.413431  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:44.429194  1686 leader_election.cc:343] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:44.417683  2159 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.395710  2135 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:44.443145  2135 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:44.440378  2142 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:56:44.443749  2135 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:44.404578  2033 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:44.443856  2142 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:44.448594  2142 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:56:44.450525  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:44.457406  1761 tablet_bootstrap.cc:492] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:44.458012  1761 ts_tablet_manager.cc:1403] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.311s	user 0.014s	sys 0.018s
I20260709 12:56:44.451711  2150 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:44.464560  2150 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.467280  2159 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:44.469274  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:44.471566  1761 raft_consensus.cc:359] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.473146  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:44.472450  1761 raft_consensus.cc:385] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:44.473796  1761 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:44.474483  1537 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:44.394665  2110 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:44.472743  2033 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:56:44.451866  1568 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:44.484005  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:44.478363  2159 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:56:44.484931  2033 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:56:44.485467  2033 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:44.485960  2033 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:44.489267  2150 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:44.511695  1761 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.512187  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:44.516402  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:44.527004  1765 tablet_bootstrap.cc:492] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:44.532258  1761 ts_tablet_manager.cc:1434] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.074s	user 0.012s	sys 0.012s
I20260709 12:56:44.547670  1765 ts_tablet_manager.cc:1403] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.576s	user 0.036s	sys 0.049s
I20260709 12:56:44.513028  1714 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
W20260709 12:56:44.549717  1612 leader_election.cc:343] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:44.552349  1761 tablet_bootstrap.cc:492] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:44.554802  1762 tablet_bootstrap.cc:654] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:44.558607  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:44.561612  1647 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:44.569449  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:44.597273  2149 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:44.597652  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:44.655220  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 103844us
I20260709 12:56:44.598150  2149 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.669807  1765 raft_consensus.cc:359] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.670521  1765 raft_consensus.cc:385] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:44.670782  1765 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:44.671342  1765 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:44.675997  2171 log.cc:927] Time spent T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:56:44.693746  1684 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:44.696126  1765 ts_tablet_manager.cc:1434] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.148s	user 0.004s	sys 0.004s
I20260709 12:56:44.697055  2033 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.702056  2155 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:44.703028  2033 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:44.710855  1765 tablet_bootstrap.cc:492] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:44.722779  1761 tablet_bootstrap.cc:654] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:44.680007  2142 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.730341  1762 tablet_bootstrap.cc:492] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:44.731015  1762 ts_tablet_manager.cc:1403] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.352s	user 0.014s	sys 0.009s
I20260709 12:56:44.733222  1643 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:44.734184  2142 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:44.746152  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52514us
W20260709 12:56:44.754266  1684 leader_election.cc:343] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:44.754777  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:44.724849  2135 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.762156  2033 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:44.768225  2135 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:44.777514  1761 tablet_bootstrap.cc:492] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:44.778025  1761 ts_tablet_manager.cc:1403] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.226s	user 0.012s	sys 0.003s
I20260709 12:56:44.782294  1761 raft_consensus.cc:359] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.783066  1761 raft_consensus.cc:385] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:44.783339  1761 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:44.783977  1761 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.791563  1762 raft_consensus.cc:359] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.792357  1762 raft_consensus.cc:385] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:44.799950  1761 ts_tablet_manager.cc:1434] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:56:44.799916  1762 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:44.800988  1761 tablet_bootstrap.cc:492] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:44.800621  1762 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.814136  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:44.815057  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:44.815629  1721 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:44.815837  1572 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:44.812772  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:44.817714  1569 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:44.820693  1762 ts_tablet_manager.cc:1434] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.003s
I20260709 12:56:44.821798  1762 tablet_bootstrap.cc:492] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:44.794704  1765 tablet_bootstrap.cc:654] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:44.798586  2149 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:44.848713  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:44.850494  1719 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:44.852042  1572 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:44.834770  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:44.867908  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:44.868376  1719 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:44.875880  2152 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:44.876003  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:44.881910  2132 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:44.884472  1569 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:56:44.876415  2152 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.909847  2132 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:44.962332  2132 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:44.988831  2183 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:44.989455  2183 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:44.989954  2183 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:44.991453  1762 tablet_bootstrap.cc:654] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:44.986748  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 69533.9us
I20260709 12:56:45.014020  1761 tablet_bootstrap.cc:654] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:45.040486  2152 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:45.064930  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:56:45.066869  1612 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:56:45.073383  1684 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:45.071394  2152 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:45.085904  2152 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:45.087558  2152 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.101276  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:45.114217  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:45.111003  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:45.147107  2074 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:45.147946  2074 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.151423  2074 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:45.158931  2191 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:45.134140  2143 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:56:45.184790  1979 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:56:45.209939  1765 tablet_bootstrap.cc:492] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:45.210475  1765 ts_tablet_manager.cc:1403] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.500s	user 0.037s	sys 0.013s
I20260709 12:56:45.183981  2191 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:56:45.231141  1684 leader_election.cc:343] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:45.232450  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:45.237910  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:45.240882  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:45.241475  1570 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:45.237460  2033 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:56:45.246762  1612 leader_election.cc:343] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:45.254937  1765 raft_consensus.cc:359] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.229911  2183 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.255532  1765 raft_consensus.cc:385] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:45.240556  2185 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:56:45.257524  1765 raft_consensus.cc:740] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:45.258078  1765 consensus_queue.cc:260] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.261092  1765 ts_tablet_manager.cc:1434] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.002s
I20260709 12:56:45.261220  1762 tablet_bootstrap.cc:492] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:45.261678  1762 ts_tablet_manager.cc:1403] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.440s	user 0.005s	sys 0.021s
I20260709 12:56:45.261757  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:45.265576  2135 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:45.265967  2135 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:45.266284  2135 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:45.270092  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:45.273438  2135 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.275449  2135 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:45.275902  1568 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:45.279901  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:45.278347  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:45.276826  2183 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:45.275935  2191 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:45.295513  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:45.281008  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:45.300091  1645 raft_consensus.cc:2393] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:45.299114  1571 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:45.324353  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:45.327867  1537 leader_election.cc:343] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:45.328214  1537 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:56:45.328904  1686 leader_election.cc:343] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:45.329254  1686 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:45.330543  1612 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:45.331683  1761 tablet_bootstrap.cc:492] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:45.332093  1761 ts_tablet_manager.cc:1403] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.531s	user 0.022s	sys 0.016s
I20260709 12:56:45.336460  1765 tablet_bootstrap.cc:492] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
W20260709 12:56:45.338606  1612 leader_election.cc:343] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:45.332962  2142 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:45.332835  2155 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:45.353603  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:45.354146  1719 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:45.360854  1762 raft_consensus.cc:359] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.361544  1762 raft_consensus.cc:385] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:45.363164  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58430 (request call id 106) took 1563 ms. Trace:
I20260709 12:56:45.361797  1762 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:45.365119  1762 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.369566  1719 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:45.375541  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:45.415129  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:56:45.417765  1612 leader_election.cc:343] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:45.419925  1765 tablet_bootstrap.cc:654] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:45.417372  2152 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:45.430481  1762 ts_tablet_manager.cc:1434] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.169s	user 0.011s	sys 0.008s
I20260709 12:56:45.438477  1571 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:45.439081  2143 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:45.440557  1761 raft_consensus.cc:359] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.441439  1761 raft_consensus.cc:385] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:45.441785  1761 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:45.442675  1761 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.445709  2152 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:45.447127  2152 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.456034  1761 ts_tablet_manager.cc:1434] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.000s
I20260709 12:56:45.457182  1761 tablet_bootstrap.cc:492] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:45.463423  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:45.363613  1469 rpcz_store.cc:276] 0709 12:56:43.799956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:43.800656 (+   700us) service_pool.cc:224] Handling call
0709 12:56:45.363075 (+1562419us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:56:44.130158 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:56:44.131155 (+   997us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:56:44.131230 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:56:44.131286 (+    56us) tablet.cc:662] Decoding operations
0709 12:56:44.131976 (+   690us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:56:44.132081 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:56:44.132157 (+    76us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:56:44.132512 (+   355us) tablet.cc:701] Row locks acquired
0709 12:56:44.132548 (+    36us) write_op.cc:260] PREPARE: finished
0709 12:56:44.144835 (+ 12287us) write_op.cc:270] Start()
0709 12:56:44.150166 (+  5331us) write_op.cc:276] Timestamp: P: 1783601804144423 usec, L: 0
0709 12:56:44.150219 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:56:44.165192 (+ 14973us) log.cc:844] Serialized 540 byte log entry
0709 12:56:44.570102 (+404910us) op_driver.cc:464] REPLICATION: finished
0709 12:56:44.769341 (+199239us) write_op.cc:301] APPLY: starting
0709 12:56:44.769462 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:56:44.769632 (+   170us) tablet.cc:1370] finished BulkCheckPresence
0709 12:56:44.769850 (+   218us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:56:44.770143 (+   293us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:56:44.770424 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:56:44.770523 (+    99us) write_op.cc:312] APPLY: finished
0709 12:56:44.770831 (+   308us) log.cc:844] Serialized 22 byte log entry
0709 12:56:44.771915 (+  1084us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:56:44.772047 (+   132us) write_op.cc:454] Released schema lock
0709 12:56:44.772106 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:56:44.773546 (+  1440us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:56:44.773614 (+    68us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78783,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":197046,"apply.run_cpu_time_us":2409,"apply.run_wall_time_us":4185,"num_ops":1,"prepare.queue_time_us":80514,"prepare.run_cpu_time_us":25752,"prepare.run_wall_time_us":197664,"raft.queue_time_us":141638,"raft.run_cpu_time_us":20335,"raft.run_wall_time_us":135128,"replication_time_us":403565,"thread_start_us":251619,"threads_started":4,"wal-append.queue_time_us":125230}]]}
I20260709 12:56:45.491959  1762 tablet_bootstrap.cc:492] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:45.495898  1468 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58424 (request call id 104) took 1561 ms. Trace:
I20260709 12:56:45.496279  1468 rpcz_store.cc:276] 0709 12:56:43.934715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:43.935024 (+   309us) service_pool.cc:224] Handling call
0709 12:56:45.495827 (+1560803us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":539147,"reported_tablets":4}
I20260709 12:56:45.495589  2052 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:45.518402  1646 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:45.522889  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:45.520562  1467 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:56:45.531415  1467 catalog_manager.cc:5697] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:45.520941  2052 raft_consensus.cc:697] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:45.600680  2052 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.607903  1762 tablet_bootstrap.cc:654] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:45.624984  1761 tablet_bootstrap.cc:654] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:45.761775  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 50357.7us
I20260709 12:56:45.731387  2152 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:45.765651  2183 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:56:45.782428  1765 tablet_bootstrap.cc:492] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:45.782902  1765 ts_tablet_manager.cc:1403] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.450s	user 0.010s	sys 0.039s
W20260709 12:56:45.783634  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 70663.2us
I20260709 12:56:45.789091  1762 tablet_bootstrap.cc:492] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:45.789438  1762 ts_tablet_manager.cc:1403] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.298s	user 0.029s	sys 0.069s
I20260709 12:56:45.790629  1567 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:45.772992  2152 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.792052  2178 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:56:45.817695  1717 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:45.912793  2152 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:45.926931  2178 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:45.933104  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:45.937847  2110 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:45.938318  2110 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.940308  2110 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:45.937558  1762 raft_consensus.cc:359] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.941367  1762 raft_consensus.cc:385] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:45.941653  1762 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:45.942268  1762 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.943189  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:56:45.948108  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 134014us
I20260709 12:56:45.947913  1765 raft_consensus.cc:359] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.948833  1765 raft_consensus.cc:385] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:45.949126  1765 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:45.949851  1765 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:45.951802  1765 ts_tablet_manager.cc:1434] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.169s	user 0.011s	sys 0.003s
I20260709 12:56:45.952979  1765 tablet_bootstrap.cc:492] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:45.967689  1762 ts_tablet_manager.cc:1434] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.178s	user 0.009s	sys 0.005s
I20260709 12:56:45.973032  2052 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:45.982728  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:45.989347  1761 tablet_bootstrap.cc:492] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:45.990311  1761 ts_tablet_manager.cc:1403] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.533s	user 0.016s	sys 0.007s
W20260709 12:56:45.998330  1612 leader_election.cc:343] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.001403  1762 tablet_bootstrap.cc:492] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:46.007827  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:46.008806  1568 raft_consensus.cc:2393] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:46.011049  1565 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.012427  1761 raft_consensus.cc:359] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.013110  1761 raft_consensus.cc:385] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.013353  1761 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.013963  1761 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.015287  1761 ts_tablet_manager.cc:1434] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:56:46.016247  1761 tablet_bootstrap.cc:492] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:46.027534  1765 tablet_bootstrap.cc:654] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:46.034767  1612 leader_election.cc:343] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.041893  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:46.045413  2177 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:46.044353  1762 tablet_bootstrap.cc:654] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.054071  2152 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:56:46.062508  1761 tablet_bootstrap.cc:654] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.052569  1468 catalog_manager.cc:5697] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:56:46.094566  1686 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:46.095536  2149 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:46.179212  1612 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:46.181806  2149 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:46.183274  1469 catalog_manager.cc:5697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 2, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:46.186831  1469 catalog_manager.cc:5697] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:46.199151  1469 catalog_manager.cc:5697] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:46.200920  1469 catalog_manager.cc:5697] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:46.326308  1762 tablet_bootstrap.cc:492] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:46.329011  1761 tablet_bootstrap.cc:492] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:46.329540  1761 ts_tablet_manager.cc:1403] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.314s	user 0.008s	sys 0.020s
I20260709 12:56:46.333560  1761 raft_consensus.cc:359] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.334234  1761 raft_consensus.cc:385] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.334496  1761 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.335140  1761 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.328533  1762 ts_tablet_manager.cc:1403] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.327s	user 0.032s	sys 0.010s
I20260709 12:56:46.338287  1761 ts_tablet_manager.cc:1434] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:56:46.340497  1765 tablet_bootstrap.cc:492] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:46.341060  1765 ts_tablet_manager.cc:1403] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.388s	user 0.019s	sys 0.008s
I20260709 12:56:46.363231  1762 raft_consensus.cc:359] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.363895  1762 raft_consensus.cc:385] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.364136  1762 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.360188  2194 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:56:46.368253  1762 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.370117  1765 raft_consensus.cc:359] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.370714  1765 raft_consensus.cc:385] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.370961  1765 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.378355  1765 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.379009  2110 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.379639  2110 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.381618  1765 ts_tablet_manager.cc:1434] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.003s
I20260709 12:56:46.382287  2110 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:46.382691  1765 tablet_bootstrap.cc:492] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:46.386260  1762 ts_tablet_manager.cc:1434] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 12:56:46.387532  1762 tablet_bootstrap.cc:492] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:46.390625  1765 tablet_bootstrap.cc:654] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:46.391185  2228 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.077s	user 0.005s	sys 0.000s
I20260709 12:56:46.392900  2110 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.395406  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:56:46.397387  1684 leader_election.cc:343] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.393759  2110 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.401598  2074 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.402351  2074 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.404840  2110 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:46.406069  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:46.410558  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:46.410735  2074 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:46.422150  2230 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.003s
I20260709 12:56:46.425347  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:46.426208  1646 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:46.441639  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:46.446615  2155 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.447208  2155 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.447650  2155 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.439193  2189 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.451514  2189 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.444505  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:46.445292  2052 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:56:46.458527  2189 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:46.464448  1762 tablet_bootstrap.cc:654] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:46.468386  1686 leader_election.cc:343] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.468888  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:56:46.473225  1686 leader_election.cc:343] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.474378  1761 tablet_bootstrap.cc:492] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:46.481056  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:46.482018  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:46.482618  1714 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:46.478026  2110 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:46.489377  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:46.500976  1765 tablet_bootstrap.cc:492] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:46.501484  1765 ts_tablet_manager.cc:1403] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.119s	user 0.023s	sys 0.022s
W20260709 12:56:46.502727  1612 leader_election.cc:343] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.505196  1537 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:46.513492  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:46.515202  2158 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:46.516981  2152 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.517362  2152 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.517707  2152 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.519346  1765 raft_consensus.cc:359] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.522159  1765 raft_consensus.cc:385] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.522522  1765 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.532176  2152 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.535938  2152 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:46.536717  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:56:46.538306  1612 leader_election.cc:343] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.537456  2155 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.543394  1765 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.556859  1761 tablet_bootstrap.cc:654] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.559481  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:46.560137  1713 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.567875  1765 ts_tablet_manager.cc:1434] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.002s
I20260709 12:56:46.571676  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:46.572404  1646 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:46.597805  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:46.568858  1765 tablet_bootstrap.cc:492] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:46.606313  1646 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:46.607473  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:46.609819  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:46.608387  2149 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.614519  2149 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:46.606165  2155 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:46.615906  1713 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:46.619308  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:56:46.620280  1686 leader_election.cc:343] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.622854  2152 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.628087  1565 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.629534  2149 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.633229  2152 raft_consensus.cc:697] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:46.641659  2152 consensus_queue.cc:237] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.650995  1762 tablet_bootstrap.cc:492] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:46.651448  1762 ts_tablet_manager.cc:1403] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.264s	user 0.018s	sys 0.022s
I20260709 12:56:46.654000  1762 raft_consensus.cc:359] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.654948  1762 raft_consensus.cc:385] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.655215  1762 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.656064  1762 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.663822  1765 tablet_bootstrap.cc:654] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.670433  1761 tablet_bootstrap.cc:492] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:46.670562  1762 ts_tablet_manager.cc:1434] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:56:46.670933  1761 ts_tablet_manager.cc:1403] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.206s	user 0.027s	sys 0.023s
I20260709 12:56:46.671420  1762 tablet_bootstrap.cc:492] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:46.693645  1762 tablet_bootstrap.cc:654] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.693645  1468 catalog_manager.cc:5697] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:46.699574  1761 raft_consensus.cc:359] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.700368  1761 raft_consensus.cc:385] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.700664  1761 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.702111  1761 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.702826  1765 tablet_bootstrap.cc:492] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:46.703231  1765 ts_tablet_manager.cc:1403] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.135s	user 0.020s	sys 0.000s
I20260709 12:56:46.704160  1761 ts_tablet_manager.cc:1434] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 12:56:46.705329  1761 tablet_bootstrap.cc:492] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:46.705965  1765 raft_consensus.cc:359] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.706586  1765 raft_consensus.cc:385] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.706837  1765 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.707657  1765 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.710081  1765 ts_tablet_manager.cc:1434] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:56:46.709709  1469 catalog_manager.cc:5697] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:46.711050  1765 tablet_bootstrap.cc:492] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:46.715678  1761 tablet_bootstrap.cc:654] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.716876  1765 tablet_bootstrap.cc:654] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.721505  1762 tablet_bootstrap.cc:492] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:46.722071  1762 ts_tablet_manager.cc:1403] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.011s
I20260709 12:56:46.722736  1761 tablet_bootstrap.cc:492] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:46.723219  1761 ts_tablet_manager.cc:1403] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.003s
I20260709 12:56:46.725739  1761 raft_consensus.cc:359] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.725271  1762 raft_consensus.cc:359] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.726547  1761 raft_consensus.cc:385] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.726761  1762 raft_consensus.cc:385] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.726961  1761 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.727239  1762 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.727880  1761 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.728145  1762 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.731598  1762 ts_tablet_manager.cc:1434] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:56:46.731619  1761 ts_tablet_manager.cc:1434] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:56:46.732715  1762 tablet_bootstrap.cc:492] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:46.734587  2152 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.735067  2152 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.737061  2152 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:46.739131  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:46.739590  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:46.740278  1713 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:46.741305  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:56:46.742049  1612 leader_election.cc:343] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.742808  2152 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.743239  2152 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.743626  2152 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.748271  1762 tablet_bootstrap.cc:654] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.749884  1565 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.759814  1761 tablet_bootstrap.cc:492] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:46.761550  2152 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.766533  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:56:46.768347  1612 leader_election.cc:343] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.765974  1765 tablet_bootstrap.cc:492] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:46.769071  2152 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:46.769622  1765 ts_tablet_manager.cc:1403] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.027s
I20260709 12:56:46.771093  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:46.771698  1713 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.775684  1761 tablet_bootstrap.cc:654] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.777915  1765 raft_consensus.cc:359] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.778610  1765 raft_consensus.cc:385] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.778878  1765 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.779533  1765 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.782305  1765 ts_tablet_manager.cc:1434] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:56:46.783030  1762 tablet_bootstrap.cc:492] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:46.783267  1765 tablet_bootstrap.cc:492] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:46.783491  1762 ts_tablet_manager.cc:1403] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.014s
I20260709 12:56:46.787091  1762 raft_consensus.cc:359] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.787794  1762 raft_consensus.cc:385] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.788107  1762 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.789023  1762 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.790525  1765 tablet_bootstrap.cc:654] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.792043  1762 ts_tablet_manager.cc:1434] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:56:46.793107  1762 tablet_bootstrap.cc:492] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:46.796705  2149 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.797165  2149 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.799562  2149 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:46.800272  1762 tablet_bootstrap.cc:654] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.805657  1713 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:46.808393  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:46.809028  1639 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:46.810185  1684 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:46.810480  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:46.811411  2149 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:46.811760  2149 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:46.812090  2149 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.813251  1762 tablet_bootstrap.cc:492] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:46.813884  1762 ts_tablet_manager.cc:1403] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
W20260709 12:56:46.813930  1686 leader_election.cc:343] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.817268  1762 raft_consensus.cc:359] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.817978  1762 raft_consensus.cc:385] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.818264  1762 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.819280  1762 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.822678  1762 ts_tablet_manager.cc:1434] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:56:46.824076  1762 tablet_bootstrap.cc:492] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:46.824465  1761 tablet_bootstrap.cc:492] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:46.825160  1761 ts_tablet_manager.cc:1403] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.009s
I20260709 12:56:46.830924  1761 raft_consensus.cc:359] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.833341  1761 raft_consensus.cc:385] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.833721  1761 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.834332  1762 tablet_bootstrap.cc:654] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.834620  1765 tablet_bootstrap.cc:492] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:46.834484  1761 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.835240  1765 ts_tablet_manager.cc:1403] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.024s
I20260709 12:56:46.836853  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:46.837109  1761 ts_tablet_manager.cc:1434] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.006s
I20260709 12:56:46.837738  2152 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:46.837904  1765 raft_consensus.cc:359] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.838647  1765 raft_consensus.cc:385] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.838404  2152 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:46.838951  1765 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.839918  2152 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.841271  1761 tablet_bootstrap.cc:492] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:46.839922  1765 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.847033  1765 ts_tablet_manager.cc:1434] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:56:46.848101  1765 tablet_bootstrap.cc:492] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:46.851212  1761 tablet_bootstrap.cc:654] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.862660  2149 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.866070  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:56:46.867770  1686 leader_election.cc:343] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:46.877120  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:46.877750  1639 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:46.878520  2149 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:46.882741  1762 tablet_bootstrap.cc:492] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:46.883061  1765 tablet_bootstrap.cc:654] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:46.883195  1762 ts_tablet_manager.cc:1403] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.059s	user 0.003s	sys 0.031s
I20260709 12:56:46.887339  1762 raft_consensus.cc:359] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.887972  1762 raft_consensus.cc:385] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.888226  1762 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.888823  1762 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.890168  1762 ts_tablet_manager.cc:1434] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:56:46.892560  1762 tablet_bootstrap.cc:492] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Bootstrap starting.
I20260709 12:56:46.894945  1765 tablet_bootstrap.cc:492] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:46.895414  1765 ts_tablet_manager.cc:1403] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.004s
I20260709 12:56:46.933859  1765 raft_consensus.cc:359] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.935992  1765 raft_consensus.cc:385] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:46.936434  1765 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:46.937480  1765 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.939993  1765 ts_tablet_manager.cc:1434] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 12:56:46.942378  1765 tablet_bootstrap.cc:492] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:46.954725  2163 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.955912  2163 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:46.964439  2163 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:46.969847  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:46.970147  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:46.971293  1713 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:46.978390  2189 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:46.979180  2189 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.007323  1537 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:47.009405  2074 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.015992  2189 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.021989  1761 tablet_bootstrap.cc:492] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:47.022922  1761 ts_tablet_manager.cc:1403] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.182s	user 0.006s	sys 0.011s
I20260709 12:56:47.026366  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:47.027223  1566 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:47.031911  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:47.031656  1469 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:47.035535  1762 tablet_bootstrap.cc:654] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:47.035792  1612 leader_election.cc:343] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:47.036643  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:47.035866  1639 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:47.039772  2074 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:47.039970  1684 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:47.041590  2110 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:47.043373  2189 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:47.043937  2189 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:47.044454  2189 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.028425  1761 raft_consensus.cc:359] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.045006  1761 raft_consensus.cc:385] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:47.045821  2194 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.046298  2194 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.045328  1761 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:47.054255  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:47.042963  2110 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:47.056042  2110 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.058605  2163 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.059428  2163 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.060109  1765 tablet_bootstrap.cc:654] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:47.062131  1761 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.063472  2194 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.064953  2189 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.067849  2163 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:47.072016  1612 leader_election.cc:343] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:47.074360  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:47.075237  1720 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:47.072504  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:47.077217  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:47.081118  1643 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:47.083552  1761 ts_tablet_manager.cc:1434] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.002s
I20260709 12:56:47.086457  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:47.085009  1761 tablet_bootstrap.cc:492] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39: Bootstrap starting.
I20260709 12:56:47.088486  2177 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:47.088861  2177 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:47.089536  2177 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.091881  2149 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.092595  2149 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.096045  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:47.096236  2149 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:47.096849  1566 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:47.097398  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:47.098608  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:56:47.099807  1684 leader_election.cc:343] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:47.102186  1537 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:47.103271  2074 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.103413  2181 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:47.103782  2181 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:47.104100  2181 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.117350  1762 tablet_bootstrap.cc:492] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: No bootstrap required, opened a new log
I20260709 12:56:47.115322  2155 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:56:47.120162  2189 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.125622  1762 ts_tablet_manager.cc:1403] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent bootstrapping tablet: real 0.235s	user 0.009s	sys 0.033s
I20260709 12:56:47.132911  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:47.133212  2074 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:47.138439  1761 tablet_bootstrap.cc:654] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:47.139261  1612 leader_election.cc:343] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:47.141876  1469 catalog_manager.cc:5697] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:47.147388  2178 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.147933  2178 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.153182  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:47.153939  1713 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:47.154465  1762 raft_consensus.cc:359] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.155222  1762 raft_consensus.cc:385] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:47.155509  1762 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Initialized, Role: FOLLOWER
I20260709 12:56:47.156131  1762 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.150269  2178 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.169831  1762 ts_tablet_manager.cc:1434] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
W20260709 12:56:47.170639  1686 consensus_peers.cc:597] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:47.172405  2178 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.173039  2178 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.175648  2178 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.190099  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:47.192225  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:47.192972  1569 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 0.
I20260709 12:56:47.186268  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:47.196573  1765 tablet_bootstrap.cc:492] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:47.197472  1765 ts_tablet_manager.cc:1403] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.256s	user 0.020s	sys 0.017s
I20260709 12:56:47.181221  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:47.202430  1565 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.204727  2178 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:47.221287  2178 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:47.221681  2178 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.214534  2189 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:56:47.212304  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:47.232137  1765 raft_consensus.cc:359] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.233491  1765 raft_consensus.cc:385] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:47.237406  1765 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:47.243981  1765 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.248323  2181 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.250906  1765 ts_tablet_manager.cc:1434] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:56:47.250624  2178 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.239611  2177 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.268253  1713 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:47.269698  2177 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.278545  2178 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.280815  2110 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.281368  2110 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.285976  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:47.303881  2074 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.305301  2110 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:47.305681  1566 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.304456  2074 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.318207  2074 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.320216  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:47.321273  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:47.321969  1718 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 0.
I20260709 12:56:47.322851  1646 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:47.324147  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:56:47.326550  2007 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:47.326951  2007 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:47.327330  2007 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.332917  1765 tablet_bootstrap.cc:492] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:47.333670  1761 tablet_bootstrap.cc:492] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39: No bootstrap required, opened a new log
I20260709 12:56:47.313336  2181 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:47.334144  1761 ts_tablet_manager.cc:1403] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent bootstrapping tablet: real 0.249s	user 0.024s	sys 0.018s
I20260709 12:56:47.323488  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:47.336357  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:47.340402  1646 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 0.
I20260709 12:56:47.339241  1566 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
W20260709 12:56:47.341136  1686 leader_election.cc:343] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:47.310467  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 64472.9us
I20260709 12:56:47.343446  1761 raft_consensus.cc:359] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.353492  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:47.353674  1761 raft_consensus.cc:385] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:47.354077  1761 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Initialized, Role: FOLLOWER
I20260709 12:56:47.347218  1565 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:47.347419  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:47.354718  1646 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:47.355669  1612 leader_election.cc:343] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:47.355752  2007 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.361243  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:47.365684  2149 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:47.366088  2149 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:47.366415  2149 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.372432  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:47.373481  1563 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 1: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:56:47.377386  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:47.377980  1714 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.377841  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:56:47.377657  1761 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.381125  1646 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:47.384310  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:56:47.384927  1713 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.387609  2269 raft_consensus.cc:2764] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:56:47.389581  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:47.390313  1642 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:47.390226  1684 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:56:47.391170  2264 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:47.391656  2264 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:47.392736  2264 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.398414  2007 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:56:47.401285  1612 consensus_peers.cc:597] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:47.418406  1713 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:47.419315  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:56:47.420912  1612 leader_election.cc:343] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:47.422797  2149 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.424499  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:47.428295  2163 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:47.430476  1761 ts_tablet_manager.cc:1434] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent starting tablet: real 0.096s	user 0.004s	sys 0.003s
I20260709 12:56:47.431285  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:56:47.432520  1686 leader_election.cc:343] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:47.432260  2267 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:47.433933  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:56:47.434080  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:47.434378  1646 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.443722  1765 tablet_bootstrap.cc:654] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:47.440107  1714 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:56:47.427567  2149 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:47.454159  2267 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:47.459328  2267 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:47.460582  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:56:47.462915  1646 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:56:47.463713  2266 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:47.460338  2267 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.467187  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:47.467876  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:47.471782  2266 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:47.472994  2266 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.478231  2268 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:47.479135  2268 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:56:47.481303  2149 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:47.481421  2268 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.484445  2149 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:56:47.485545  2149 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.486918  2269 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.505861  1765 tablet_bootstrap.cc:492] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:47.506315  1765 ts_tablet_manager.cc:1403] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.182s	user 0.007s	sys 0.007s
I20260709 12:56:47.521050  1467 catalog_manager.cc:5697] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:47.522900  2110 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.533340  1765 raft_consensus.cc:359] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.534798  1765 raft_consensus.cc:385] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:47.534989  1765 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:47.536978  1765 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.558514  1765 ts_tablet_manager.cc:1434] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 12:56:47.569142  2007 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.569773  2007 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.572621  1765 tablet_bootstrap.cc:492] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:47.575601  2007 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.576241  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:47.576562  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:47.576915  1646 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:56:47.582439  2264 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.590612  1469 catalog_manager.cc:5697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:47.592227  1469 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:47.593081  1765 tablet_bootstrap.cc:654] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:47.593604  1537 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:47.594311  2007 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.593755  1469 catalog_manager.cc:5697] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:47.603401  2007 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:47.622393  1468 catalog_manager.cc:5697] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:47.633535  2264 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.634035  2264 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.649446  2264 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:47.649495  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:47.652316  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:47.660450  1569 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:47.662098  1686 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:47.662803  2110 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.664065  1765 tablet_bootstrap.cc:492] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:47.664567  1765 ts_tablet_manager.cc:1403] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.005s
I20260709 12:56:47.668339  1765 raft_consensus.cc:359] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.669028  1765 raft_consensus.cc:385] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:47.669286  1765 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:47.669917  1765 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.672379  2110 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:47.672675  1765 ts_tablet_manager.cc:1434] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:56:47.673591  1765 tablet_bootstrap.cc:492] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:47.679253  1765 tablet_bootstrap.cc:654] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:47.687913  1765 tablet_bootstrap.cc:492] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:47.688388  1765 ts_tablet_manager.cc:1403] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 12:56:47.690964  1765 raft_consensus.cc:359] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.691627  1765 raft_consensus.cc:385] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:47.691870  1765 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:47.692512  1765 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.694577  1765 ts_tablet_manager.cc:1434] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:56:47.696009  1765 tablet_bootstrap.cc:492] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Bootstrap starting.
I20260709 12:56:47.701736  1765 tablet_bootstrap.cc:654] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:47.705399  1569 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.711077  1765 tablet_bootstrap.cc:492] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: No bootstrap required, opened a new log
I20260709 12:56:47.712677  1765 ts_tablet_manager.cc:1403] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.002s
I20260709 12:56:47.715226  1765 raft_consensus.cc:359] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.715701  1765 raft_consensus.cc:385] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:47.715900  1765 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Initialized, Role: FOLLOWER
I20260709 12:56:47.716445  1765 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.717922  1765 ts_tablet_manager.cc:1434] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:56:47.955641  2267 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.967146  2267 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.968595  2267 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:47.980909  2163 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:47.981377  2163 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:47.983372  2163 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:47.984817  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:47.986126  1720 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 1: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:56:47.991717  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:47.993485  1535 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:47.994750  2163 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:47.998530  2267 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:48.003252  2149 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:48.008221  2267 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:48.018508  2163 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:48.021281  2149 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:48.020162  2110 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:56:48.022657  2264 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:48.050575  2268 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:48.162935  2007 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:48.163424  2007 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:48.165381  2007 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:48.165863  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:48.166348  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:48.167528  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:48.168299  2007 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:48.208478  1569 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:48.453838   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:48.491737  2304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:48.491822  2303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:48.493475  2306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:48.493943   431 server_base.cc:1061] running on GCE node
I20260709 12:56:48.495908   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:48.496245   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:48.496474   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601808496455 us; error 0 us; skew 500 ppm
I20260709 12:56:48.497257   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:48.500988   431 webserver.cc:533] Webserver started at http://127.0.107.196:37845/ using document root <none> and password file <none>
I20260709 12:56:48.501621   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:48.501889   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:48.502282   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:48.506320   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-3-root/instance:
uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
format_stamp: "Formatted at 2026-07-09 12:56:48 on dist-test-slave-73vh"
I20260709 12:56:48.512427   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:56:48.515970  2311 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:48.516790   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:56:48.517095   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-3-root
uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
format_stamp: "Formatted at 2026-07-09 12:56:48 on dist-test-slave-73vh"
I20260709 12:56:48.517381   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:48.548617   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:48.550325   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:48.552054   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:48.554988   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:48.555274   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:48.555608   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:48.555874   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:48.657835   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:43269
I20260709 12:56:48.657965  2373 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:43269 every 8 connection(s)
I20260709 12:56:48.671571   431 auto_leader_rebalancer-test.cc:384] add a tserver: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:48.679724  2374 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43765
I20260709 12:56:48.680177  2374 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:48.681041  2374 heartbeater.cc:507] Master 127.0.107.254:43765 requested a full tablet report, sending...
I20260709 12:56:48.683063  1469 ts_manager.cc:194] Registered new tserver with Master: c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:56:48.684813  1469 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46898
I20260709 12:56:48.807575  1714 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:48.815377  1569 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:48.817565  2149 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:48.822916  1643 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:48.827266  2299 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.826383  2380 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:48.830379  1569 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:48.833941  1643 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:56:48.836351  1684 consensus_peers.cc:597] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a33c093dd1a4a51a63ade534efa70f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:48.849300  1469 catalog_manager.cc:5697] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:48.858345  1714 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:48.871749  1569 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:48.872179  1643 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:56:48.873384  1684 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b51b349fdba540c3a8c0e167720c3a7c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:48.874526  2299 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.875841  2380 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:48.888887  2149 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:48.890923  1569 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:48.895720  1643 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:48.911300  1468 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:48.933346  1566 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:48.941730  1714 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:48.944160  2163 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.951308  1643 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:48.953006  2163 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.959647  2392 raft_consensus.cc:2955] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:48.961467  1714 raft_consensus.cc:2955] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:56:48.980768  1535 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46fb86b9f3304b99a092fa35dffe1813. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:48.980239  1467 catalog_manager.cc:5697] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:48.986534  1643 raft_consensus.cc:2955] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:49.029047  1643 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:49.038774  1566 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:49.039013  1714 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:49.040477  2269 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:49.041770  2266 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:49.064850  2268 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:49.067360  1714 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:49.072507  1572 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:56:49.081738  1610 consensus_peers.cc:597] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ac8464a8a2c438c8cdaf74b18d51098. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:49.085850  1468 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:49.274502  2401 ts_tablet_manager.cc:933] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:49.276747  2401 tablet_copy_client.cc:323] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:56:49.285149  2404 ts_tablet_manager.cc:933] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:49.287266  2404 tablet_copy_client.cc:323] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:56:49.296051  1731 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet b51b349fdba540c3a8c0e167720c3a7c from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:56:49.296728  1731 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet b51b349fdba540c3a8c0e167720c3a7c from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-b51b349fdba540c3a8c0e167720c3a7c
I20260709 12:56:49.297616  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet 5a33c093dd1a4a51a63ade534efa70f8 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:56:49.298295  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet 5a33c093dd1a4a51a63ade534efa70f8 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-5a33c093dd1a4a51a63ade534efa70f8
I20260709 12:56:49.306394  1731 tablet_copy_source_session.cc:215] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:49.308154  1730 tablet_copy_source_session.cc:215] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:49.311326  2401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51b349fdba540c3a8c0e167720c3a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:49.323026  2404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a33c093dd1a4a51a63ade534efa70f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:49.331343  2401 tablet_copy_client.cc:806] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:49.332068  2401 tablet_copy_client.cc:670] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:49.338703  2401 tablet_copy_client.cc:538] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:49.342666  2404 tablet_copy_client.cc:806] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:49.343256  2404 tablet_copy_client.cc:670] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:49.346995  2404 tablet_copy_client.cc:538] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:49.347122  2401 tablet_bootstrap.cc:492] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:49.360529  2404 tablet_bootstrap.cc:492] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:49.367337  2406 ts_tablet_manager.cc:933] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:56:49.397424  2404 tablet_bootstrap.cc:492] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:49.398548  2404 tablet_bootstrap.cc:492] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:49.399300  2404 ts_tablet_manager.cc:1403] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.039s	user 0.026s	sys 0.009s
I20260709 12:56:49.402592  2404 raft_consensus.cc:359] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:49.403584  2404 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:49.404345  2404 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:49.412989  2374 heartbeater.cc:499] Master 127.0.107.254:43765 was elected leader, sending a full tablet report...
I20260709 12:56:49.414161  2404 ts_tablet_manager.cc:1434] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:56:49.418440  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-5a33c093dd1a4a51a63ade534efa70f8 received from {username='slave'} at 127.0.0.1:48852
I20260709 12:56:49.418962  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-5a33c093dd1a4a51a63ade534efa70f8 on tablet 5a33c093dd1a4a51a63ade534efa70f8 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:49.441350  2406 tablet_copy_client.cc:323] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39997
I20260709 12:56:49.467834  2404 ts_tablet_manager.cc:933] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:49.478919  1582 tablet_copy_service.cc:140] P 2af567a273d44ca89d2b3b0f7c815bd1: Received BeginTabletCopySession request for tablet 46fb86b9f3304b99a092fa35dffe1813 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:53576)
I20260709 12:56:49.479539  1582 tablet_copy_service.cc:161] P 2af567a273d44ca89d2b3b0f7c815bd1: Beginning new tablet copy session on tablet 46fb86b9f3304b99a092fa35dffe1813 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:53576: session id = c05ea12435084ad9b281ed3a0a2ecebe-46fb86b9f3304b99a092fa35dffe1813
I20260709 12:56:49.480705  2404 tablet_copy_client.cc:323] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:56:49.487439  1582 tablet_copy_source_session.cc:215] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:49.492393  2406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46fb86b9f3304b99a092fa35dffe1813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:49.495129  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet 5ac8464a8a2c438c8cdaf74b18d51098 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:56:49.495610  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet 5ac8464a8a2c438c8cdaf74b18d51098 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-5ac8464a8a2c438c8cdaf74b18d51098
I20260709 12:56:49.508380  2401 tablet_bootstrap.cc:492] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:49.509308  2401 tablet_bootstrap.cc:492] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:49.510025  2401 ts_tablet_manager.cc:1403] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.163s	user 0.042s	sys 0.040s
I20260709 12:56:49.513921  2401 raft_consensus.cc:359] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:49.514784  2401 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:49.515445  2401 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:49.517658  2401 ts_tablet_manager.cc:1434] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:56:49.517818  1657 tablet_copy_source_session.cc:215] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:49.519253  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-b51b349fdba540c3a8c0e167720c3a7c received from {username='slave'} at 127.0.0.1:48852
I20260709 12:56:49.519704  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-b51b349fdba540c3a8c0e167720c3a7c on tablet b51b349fdba540c3a8c0e167720c3a7c with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:49.523526  2404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac8464a8a2c438c8cdaf74b18d51098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:49.544432  2404 tablet_copy_client.cc:806] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:49.545047  2404 tablet_copy_client.cc:670] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:49.551106  2404 tablet_copy_client.cc:538] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:49.563629  2404 tablet_bootstrap.cc:492] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:49.569159  2406 tablet_copy_client.cc:806] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:49.569774  2406 tablet_copy_client.cc:670] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:49.574358  2406 tablet_copy_client.cc:538] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:49.587982  2404 tablet_bootstrap.cc:492] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:49.589138  2404 tablet_bootstrap.cc:492] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:49.589534  2406 tablet_bootstrap.cc:492] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:49.589839  2404 ts_tablet_manager.cc:1403] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.026s	user 0.023s	sys 0.002s
I20260709 12:56:49.593304  2404 raft_consensus.cc:359] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:49.594269  2404 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:49.595108  2404 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:49.601596  2404 ts_tablet_manager.cc:1434] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:56:49.606213  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-5ac8464a8a2c438c8cdaf74b18d51098 received from {username='slave'} at 127.0.0.1:58328
I20260709 12:56:49.606663  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-5ac8464a8a2c438c8cdaf74b18d51098 on tablet 5ac8464a8a2c438c8cdaf74b18d51098 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:49.618149  2406 tablet_bootstrap.cc:492] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:49.619118  2406 tablet_bootstrap.cc:492] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:49.619812  2406 ts_tablet_manager.cc:1403] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 12:56:49.622999  2406 raft_consensus.cc:359] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:49.623883  2406 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:49.624614  2406 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:49.629456  2406 ts_tablet_manager.cc:1434] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.008s
I20260709 12:56:49.631358  1582 tablet_copy_service.cc:342] P 2af567a273d44ca89d2b3b0f7c815bd1: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-46fb86b9f3304b99a092fa35dffe1813 received from {username='slave'} at 127.0.0.1:53576
I20260709 12:56:49.631829  1582 tablet_copy_service.cc:434] P 2af567a273d44ca89d2b3b0f7c815bd1: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-46fb86b9f3304b99a092fa35dffe1813 on tablet 46fb86b9f3304b99a092fa35dffe1813 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:49.796658  2349 raft_consensus.cc:1217] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:49.823638  2349 raft_consensus.cc:1217] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:49.972599  2349 raft_consensus.cc:1217] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:50.062803  2349 raft_consensus.cc:1217] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:50.290567  2380 raft_consensus.cc:1064] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:50.293497  2380 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:50.311283  2349 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.313277  1572 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.315136  1642 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.315349  2299 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:50.316902  2149 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:50.317587  2299 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:50.332245  2149 raft_consensus.cc:1064] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:50.335774  2149 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:50.335788  2349 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.351784  1642 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.359812  1572 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.359066  1467 catalog_manager.cc:5697] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.361580  2349 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.362345  2299 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:50.362900  1643 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.365746  2424 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:50.381040  2424 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:50.331877  2380 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.408032  1572 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.409267  2149 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.413707  1642 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.447883  2418 raft_consensus.cc:1064] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:50.451884  2349 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.453011  1572 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.450754  2418 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:50.470016  1714 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:50.475050  1469 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:56:50.490935  2349 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:50.491291  1713 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:50.492522  1642 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:50.504710  2424 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:50.507110  2424 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:50.513902  2349 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.515492  1720 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.515648  2266 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:50.519024  1572 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:50.522964  2348 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:50.527022  2424 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:50.530369  2380 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:50.533201  1566 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.533308  2420 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.535598  2416 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:50.536986  2266 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:50.545367  1642 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.545264  2348 raft_consensus.cc:2955] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.549198  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a33c093dd1a4a51a63ade534efa70f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:50.558471  2299 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.560348  1468 catalog_manager.cc:5697] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:56:50.569612  1572 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.599606  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b51b349fdba540c3a8c0e167720c3a7c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:50.620040  2392 raft_consensus.cc:1064] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:50.624770  2418 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.626962  1717 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.630100  1556 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a33c093dd1a4a51a63ade534efa70f8 with delete_type TABLET_DATA_TOMBSTONED (TS 2af567a273d44ca89d2b3b0f7c815bd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45012
I20260709 12:56:50.644173  2392 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:56:50.682364  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 46498.4us
W20260709 12:56:50.682315  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 47004.8us
I20260709 12:56:50.640796  1466 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.694223  2438 tablet_replica.cc:333] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:56:50.756479  2349 raft_consensus.cc:2955] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.757541  2438 raft_consensus.cc:2243] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:50.758411  2438 raft_consensus.cc:2272] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:50.761643  2438 ts_tablet_manager.cc:1916] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:56:50.766710  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 81447.5us
I20260709 12:56:50.794991  2348 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.797845  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet b51b349fdba540c3a8c0e167720c3a7c with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59242
I20260709 12:56:50.805616  2007 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:50.807597  1642 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.809700  2349 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.819535  1713 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:50.826558  2448 tablet_replica.cc:333] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:56:50.827725  2448 raft_consensus.cc:2243] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:50.834640  2448 raft_consensus.cc:2272] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:50.830912  2392 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:56:50.836058  1466 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.847601  2447 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:50.879215  2448 ts_tablet_manager.cc:1916] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:56:50.891829  2415 raft_consensus.cc:2955] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.893108  1566 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.897863  1643 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:50.879805  2438 ts_tablet_manager.cc:1929] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:50.901340  2438 log.cc:1199] T 5a33c093dd1a4a51a63ade534efa70f8 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/wals/5a33c093dd1a4a51a63ade534efa70f8
I20260709 12:56:50.904088  1646 raft_consensus.cc:2955] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.910115  2349 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:50.911616  2416 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:50.913062  1456 catalog_manager.cc:5028] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): tablet 5a33c093dd1a4a51a63ade534efa70f8 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:50.921200  2348 raft_consensus.cc:2955] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.926843  2416 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.930341  2448 ts_tablet_manager.cc:1929] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:50.930891  2448 log.cc:1199] T b51b349fdba540c3a8c0e167720c3a7c P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/b51b349fdba540c3a8c0e167720c3a7c
I20260709 12:56:50.933142  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet b51b349fdba540c3a8c0e167720c3a7c (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:50.935173  2347 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.937994  1713 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:50.940136  1469 catalog_manager.cc:5697] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:56:50.946519  2266 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:50.953742  1720 raft_consensus.cc:2955] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:50.967913  1572 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:50.980822  2349 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:50.982519  1646 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:50.985179  2415 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:50.986126  2392 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:50.990197  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ac8464a8a2c438c8cdaf74b18d51098 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:50.993279  1468 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:51.008100  2447 raft_consensus.cc:2955] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:51.019811  1646 raft_consensus.cc:2955] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:51.020175  2347 raft_consensus.cc:2955] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:51.030403  1556 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ac8464a8a2c438c8cdaf74b18d51098 with delete_type TABLET_DATA_TOMBSTONED (TS 2af567a273d44ca89d2b3b0f7c815bd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45012
I20260709 12:56:51.031719  2438 tablet_replica.cc:333] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:56:51.033231  2438 raft_consensus.cc:2243] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:51.034157  2438 raft_consensus.cc:2272] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:51.059906  2438 ts_tablet_manager.cc:1916] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:56:51.076997  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46fb86b9f3304b99a092fa35dffe1813 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:51.086256  1468 catalog_manager.cc:5697] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:56:51.109088  2438 ts_tablet_manager.cc:1929] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:51.109928  2438 log.cc:1199] T 5ac8464a8a2c438c8cdaf74b18d51098 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/wals/5ac8464a8a2c438c8cdaf74b18d51098
I20260709 12:56:51.112115  1456 catalog_manager.cc:5028] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): tablet 5ac8464a8a2c438c8cdaf74b18d51098 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:51.129454  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 46fb86b9f3304b99a092fa35dffe1813 with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46146
I20260709 12:56:51.140791  2452 tablet_replica.cc:333] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:56:51.142098  2452 raft_consensus.cc:2243] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:51.142673  2452 pending_rounds.cc:70] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: Trying to abort 1 pending ops.
I20260709 12:56:51.143141  2452 pending_rounds.cc:77] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633016392011776 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "46fb86b9f3304b99a092fa35dffe1813" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } } }
I20260709 12:56:51.145021  2452 raft_consensus.cc:2917] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:56:51.145821  2452 raft_consensus.cc:2889] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:56:51.146476  2452 raft_consensus.cc:2272] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:51.150525  2452 ts_tablet_manager.cc:1916] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:56:51.169570  2452 ts_tablet_manager.cc:1929] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:51.170042  2452 log.cc:1199] T 46fb86b9f3304b99a092fa35dffe1813 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/46fb86b9f3304b99a092fa35dffe1813
I20260709 12:56:51.171775  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet 46fb86b9f3304b99a092fa35dffe1813 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:52.189790  1566 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.195218  1713 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:56:52.196134  1535 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57f5c2cabd34469aa65eff4ffae3e350. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:52.196309  1646 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:52.196812  2392 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:52.198246  2439 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.209225  2392 raft_consensus.cc:2955] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.210754  1646 raft_consensus.cc:2955] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.212598  1713 raft_consensus.cc:2955] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.227121  1467 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.230960  1566 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.240000  1643 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:56:52.240316  1535 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27982349e557426eb54944f0699b5f79. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:52.241385  2392 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.240005  1713 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:52.245291  2392 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.251995  2392 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.252998  1643 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.303236  1566 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.306231  1468 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:52.311348  1720 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.323926  1643 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:56:52.324930  1535 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 075b6c0f44a54d0cb3e8050968db2158. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:52.325672  2465 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.332361  1720 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:52.334389  2465 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.338340  2467 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.340226  1643 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.353672  1646 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.358067  1720 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.358873  1468 catalog_manager.cc:5697] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:56:52.371047  1610 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e271944afc3846f9b26d682a57b58ce8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:52.371852  1720 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:52.373654  2416 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.375068  1566 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:52.376931  2416 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:52.388728  2416 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.394239  1720 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.394646  1566 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:52.407836  1467 catalog_manager.cc:5697] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:52.700871  2476 ts_tablet_manager.cc:933] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:56:52.710405  2476 tablet_copy_client.cc:323] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39997
I20260709 12:56:52.712147  1582 tablet_copy_service.cc:140] P 2af567a273d44ca89d2b3b0f7c815bd1: Received BeginTabletCopySession request for tablet 075b6c0f44a54d0cb3e8050968db2158 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:53576)
I20260709 12:56:52.712733  1582 tablet_copy_service.cc:161] P 2af567a273d44ca89d2b3b0f7c815bd1: Beginning new tablet copy session on tablet 075b6c0f44a54d0cb3e8050968db2158 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:53576: session id = c05ea12435084ad9b281ed3a0a2ecebe-075b6c0f44a54d0cb3e8050968db2158
I20260709 12:56:52.723459  1582 tablet_copy_source_session.cc:215] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:52.730667  2476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075b6c0f44a54d0cb3e8050968db2158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.747553  2476 tablet_copy_client.cc:806] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:52.748148  2476 tablet_copy_client.cc:670] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:52.751622  2476 tablet_copy_client.cc:538] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:52.761600  2476 tablet_bootstrap.cc:492] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:52.777629  2476 tablet_bootstrap.cc:492] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:52.778604  2476 tablet_bootstrap.cc:492] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:52.779358  2476 ts_tablet_manager.cc:1403] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.008s
I20260709 12:56:52.782757  2476 raft_consensus.cc:359] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.783713  2476 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:52.784472  2476 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.790119  2476 ts_tablet_manager.cc:1434] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:56:52.791751  1582 tablet_copy_service.cc:342] P 2af567a273d44ca89d2b3b0f7c815bd1: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-075b6c0f44a54d0cb3e8050968db2158 received from {username='slave'} at 127.0.0.1:53576
I20260709 12:56:52.792124  1582 tablet_copy_service.cc:434] P 2af567a273d44ca89d2b3b0f7c815bd1: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-075b6c0f44a54d0cb3e8050968db2158 on tablet 075b6c0f44a54d0cb3e8050968db2158 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:52.804370  2476 ts_tablet_manager.cc:933] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:56:52.807233  2476 tablet_copy_client.cc:323] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39997
I20260709 12:56:52.809012  1582 tablet_copy_service.cc:140] P 2af567a273d44ca89d2b3b0f7c815bd1: Received BeginTabletCopySession request for tablet 27982349e557426eb54944f0699b5f79 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:53576)
I20260709 12:56:52.809582  1582 tablet_copy_service.cc:161] P 2af567a273d44ca89d2b3b0f7c815bd1: Beginning new tablet copy session on tablet 27982349e557426eb54944f0699b5f79 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:53576: session id = c05ea12435084ad9b281ed3a0a2ecebe-27982349e557426eb54944f0699b5f79
I20260709 12:56:52.818430  1582 tablet_copy_source_session.cc:215] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:52.823015  2476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27982349e557426eb54944f0699b5f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.833683  2482 ts_tablet_manager.cc:933] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:56:52.834892  2481 ts_tablet_manager.cc:933] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:52.840027  2476 tablet_copy_client.cc:806] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:52.840688  2476 tablet_copy_client.cc:670] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:52.844682  2476 tablet_copy_client.cc:538] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:52.845460  2482 tablet_copy_client.cc:323] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39997
I20260709 12:56:52.847136  1582 tablet_copy_service.cc:140] P 2af567a273d44ca89d2b3b0f7c815bd1: Received BeginTabletCopySession request for tablet 57f5c2cabd34469aa65eff4ffae3e350 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:53576)
I20260709 12:56:52.847539  2481 tablet_copy_client.cc:323] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:56:52.847776  1582 tablet_copy_service.cc:161] P 2af567a273d44ca89d2b3b0f7c815bd1: Beginning new tablet copy session on tablet 57f5c2cabd34469aa65eff4ffae3e350 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:53576: session id = c05ea12435084ad9b281ed3a0a2ecebe-57f5c2cabd34469aa65eff4ffae3e350
I20260709 12:56:52.849557  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet e271944afc3846f9b26d682a57b58ce8 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:56:52.850104  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet e271944afc3846f9b26d682a57b58ce8 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-e271944afc3846f9b26d682a57b58ce8
I20260709 12:56:52.856380  1582 tablet_copy_source_session.cc:215] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:52.858894  2476 tablet_bootstrap.cc:492] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:52.859531  2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f5c2cabd34469aa65eff4ffae3e350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.874264  1657 tablet_copy_source_session.cc:215] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:52.877645  2481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e271944afc3846f9b26d682a57b58ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.884256  2482 tablet_copy_client.cc:806] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:52.884894  2482 tablet_copy_client.cc:670] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:52.888751  2482 tablet_copy_client.cc:538] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:52.899602  2482 tablet_bootstrap.cc:492] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:52.904237  2476 tablet_bootstrap.cc:492] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:52.911124  2476 tablet_bootstrap.cc:492] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:52.912731  2476 ts_tablet_manager.cc:1403] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.018s
I20260709 12:56:52.919759  2476 raft_consensus.cc:359] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.929611  2476 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:52.928836  2482 tablet_bootstrap.cc:492] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:52.930959  2482 tablet_bootstrap.cc:492] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:52.931694  2482 ts_tablet_manager.cc:1403] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.012s
I20260709 12:56:52.930421  2476 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.933564  2481 tablet_copy_client.cc:806] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:52.936684  2481 tablet_copy_client.cc:670] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:52.936230  2482 raft_consensus.cc:359] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.937419  2482 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:52.940738  2476 ts_tablet_manager.cc:1434] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:56:52.942375  1582 tablet_copy_service.cc:342] P 2af567a273d44ca89d2b3b0f7c815bd1: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-27982349e557426eb54944f0699b5f79 received from {username='slave'} at 127.0.0.1:53576
I20260709 12:56:52.942770  1582 tablet_copy_service.cc:434] P 2af567a273d44ca89d2b3b0f7c815bd1: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-27982349e557426eb54944f0699b5f79 on tablet 27982349e557426eb54944f0699b5f79 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:52.938094  2482 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.944765  2481 tablet_copy_client.cc:538] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:52.946359  2482 ts_tablet_manager.cc:1434] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.005s
I20260709 12:56:52.947989  1582 tablet_copy_service.cc:342] P 2af567a273d44ca89d2b3b0f7c815bd1: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-57f5c2cabd34469aa65eff4ffae3e350 received from {username='slave'} at 127.0.0.1:53576
I20260709 12:56:52.948424  1582 tablet_copy_service.cc:434] P 2af567a273d44ca89d2b3b0f7c815bd1: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-57f5c2cabd34469aa65eff4ffae3e350 on tablet 57f5c2cabd34469aa65eff4ffae3e350 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:52.957224  2481 tablet_bootstrap.cc:492] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:52.980089  2481 tablet_bootstrap.cc:492] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:52.981102  2481 tablet_bootstrap.cc:492] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:52.981799  2481 ts_tablet_manager.cc:1403] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.006s
I20260709 12:56:52.984797  2481 raft_consensus.cc:359] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.985792  2481 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:52.986459  2481 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:52.988816  2481 ts_tablet_manager.cc:1434] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:56:52.990628  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-e271944afc3846f9b26d682a57b58ce8 received from {username='slave'} at 127.0.0.1:58328
I20260709 12:56:52.991019  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-e271944afc3846f9b26d682a57b58ce8 on tablet e271944afc3846f9b26d682a57b58ce8 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:53.101003  2347 raft_consensus.cc:1217] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:53.268996  2347 raft_consensus.cc:1217] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:53.388736  2347 raft_consensus.cc:1217] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:53.401681  2347 raft_consensus.cc:1217] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:53.685423  2465 raft_consensus.cc:1064] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:53.687546  2465 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:53.693492  1720 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.693495  2347 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.694546  1643 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.696087  2439 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:53.697432  2464 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:53.699582  2464 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:53.718325  2439 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:53.720759  1643 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:53.721668  2347 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:53.731261  1714 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:53.738847  1468 catalog_manager.cc:5697] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:56:53.774884  2416 raft_consensus.cc:1064] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:53.781232  2416 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:53.791270  2349 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.798870  2444 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:53.801939  1714 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.803260  1566 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.809604  2444 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:53.811277  2444 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:53.825953  2439 raft_consensus.cc:1064] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:53.828312  2439 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:53.808053  1572 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:53.853056  2348 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:53.858294  2464 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:53.861744  2463 raft_consensus.cc:1064] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:53.865186  2463 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:53.869963  2464 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:53.877912  2347 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:53.898283  2348 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.902446  2465 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:53.922317  1717 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.926522  2465 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:53.951763  1466 catalog_manager.cc:5697] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:53.970141  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 075b6c0f44a54d0cb3e8050968db2158 with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46146
I20260709 12:56:53.979099  2349 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.982577  1646 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:53.982815  1643 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:53.984567  2516 tablet_replica.cc:333] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:56:53.988090  2516 raft_consensus.cc:2243] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:53.988950  2516 raft_consensus.cc:2272] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:53.990921  2512 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:53.994794  2516 ts_tablet_manager.cc:1916] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:56:54.004343  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 80489.5us
I20260709 12:56:54.012585  2349 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.015218  1714 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:54.022102  2511 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:54.032725  2516 ts_tablet_manager.cc:1929] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:54.033337  2516 log.cc:1199] T 075b6c0f44a54d0cb3e8050968db2158 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/075b6c0f44a54d0cb3e8050968db2158
I20260709 12:56:54.035373  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet 075b6c0f44a54d0cb3e8050968db2158 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:54.035640  2465 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:54.041306  1717 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.047103  1466 catalog_manager.cc:5697] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.060859  2464 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:54.068564  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 075b6c0f44a54d0cb3e8050968db2158 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:56:54.088965  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44739.3us
I20260709 12:56:54.110962  2514 raft_consensus.cc:2955] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.097874  2439 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:56:54.151638  1566 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.164232  2349 raft_consensus.cc:2955] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:56:54.174081  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 81349.2us
W20260709 12:56:54.176501  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 88409.3us
I20260709 12:56:54.193327  1714 raft_consensus.cc:2955] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.221190  1643 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:54.230422  1469 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.238312  1642 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:54.256903  2514 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.260274  1646 raft_consensus.cc:2955] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.258121  1718 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.280246  1572 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:54.301203  1717 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:54.312985  2347 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:54.313673  1720 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:54.316174  2464 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:54.318395  2504 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:54.322968  2347 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:54.325098  2349 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.334381  1469 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.339412  2524 raft_consensus.cc:2955] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.346662  2523 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:54.351696  2512 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:54.343377  1718 raft_consensus.cc:2955] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.364975  1639 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.378424  2347 raft_consensus.cc:2955] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.387028  1572 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:54.388839  2512 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.401499  1719 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.408491  1469 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.424492  2346 raft_consensus.cc:2955] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.430043  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet 57f5c2cabd34469aa65eff4ffae3e350 with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59242
I20260709 12:56:54.439666  1469 catalog_manager.cc:5697] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.448102  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e271944afc3846f9b26d682a57b58ce8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:54.466363  1646 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:54.474067  1556 tablet_service.cc:1558] Processing DeleteTablet for tablet e271944afc3846f9b26d682a57b58ce8 with delete_type TABLET_DATA_TOMBSTONED (TS 2af567a273d44ca89d2b3b0f7c815bd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45012
I20260709 12:56:54.482686  2348 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:54.508538  2523 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:54.519243  2529 tablet_replica.cc:333] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:56:54.527436  2529 raft_consensus.cc:2243] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:54.528393  2529 raft_consensus.cc:2272] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:54.531108  2464 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.532891  2529 ts_tablet_manager.cc:1916] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:56:54.552186  2346 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.569530  2523 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:54.594395  2529 ts_tablet_manager.cc:1929] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:56:54.594987  2529 log.cc:1199] T 57f5c2cabd34469aa65eff4ffae3e350 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/57f5c2cabd34469aa65eff4ffae3e350
I20260709 12:56:54.598227  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet 57f5c2cabd34469aa65eff4ffae3e350 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:54.598762  1646 raft_consensus.cc:2955] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:54.604542  2530 tablet_replica.cc:333] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:56:54.605190  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57f5c2cabd34469aa65eff4ffae3e350 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:54.606472  2530 raft_consensus.cc:2243] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:54.606529  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 27982349e557426eb54944f0699b5f79 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:54.613090  2530 raft_consensus.cc:2272] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:54.624897  2530 ts_tablet_manager.cc:1916] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:56:54.626065  1468 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:56:54.654731  2530 ts_tablet_manager.cc:1929] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:54.655303  2530 log.cc:1199] T e271944afc3846f9b26d682a57b58ce8 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/wals/e271944afc3846f9b26d682a57b58ce8
I20260709 12:56:54.657517  1456 catalog_manager.cc:5028] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): tablet e271944afc3846f9b26d682a57b58ce8 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:54.660018  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 27982349e557426eb54944f0699b5f79 with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46146
I20260709 12:56:54.675959  2531 tablet_replica.cc:333] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:56:54.677593  2531 raft_consensus.cc:2243] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:54.678704  2531 raft_consensus.cc:2272] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:54.684628  2531 ts_tablet_manager.cc:1916] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:56:54.696738  2531 ts_tablet_manager.cc:1929] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:54.697067  2531 log.cc:1199] T 27982349e557426eb54944f0699b5f79 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/27982349e557426eb54944f0699b5f79
I20260709 12:56:54.698283  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet 27982349e557426eb54944f0699b5f79 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:55.728420  1713 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:56:55.752013  1684 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35dd8bcf618a48bb9d3dc5e16f488fcf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:55.752523  1646 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:55.753780  2299 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:55.754346  1572 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:55.755439  2299 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:55.761547  2526 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:55.769938  1639 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:55.769455  1572 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:55.776062  1643 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:55.788812  1468 catalog_manager.cc:5697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:56:55.809419  1610 consensus_peers.cc:597] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13d708096220406385b27d464c8725f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:55.828702  1713 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:55.831197  1572 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:55.849792  2539 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:55.851585  2539 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:55.867117  2539 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:55.868976  1713 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:56.734748  2556 ts_tablet_manager.cc:933] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:56:56.759413  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.004s	sys 0.016s
W20260709 12:56:56.759933  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.005s	sys 0.016s
I20260709 12:56:56.777489  1569 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:56.781467  2556 tablet_copy_client.cc:323] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:56:56.793443  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet 13d708096220406385b27d464c8725f2 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:56:56.793998  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet 13d708096220406385b27d464c8725f2 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-13d708096220406385b27d464c8725f2
I20260709 12:56:56.802506  2555 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:56:56.802700  1657 tablet_copy_source_session.cc:215] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:56.803054  2555 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:56.804265  2559 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:56:56.804838  2559 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:56.808666  1646 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:56.837695  1468 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 168) took 1051 ms. Trace:
I20260709 12:56:56.843636  2556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d708096220406385b27d464c8725f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:56.839996  1468 rpcz_store.cc:276] 0709 12:56:55.785897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:55.786000 (+   103us) service_pool.cc:224] Handling call
0709 12:56:56.836824 (+1050824us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:56:55.794407 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:56:55.794922 (+   515us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:56:55.794958 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:56:55.794975 (+    17us) tablet.cc:662] Decoding operations
0709 12:56:55.796968 (+  1993us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:56:55.797049 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:56:55.797079 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:56:55.797262 (+   183us) tablet.cc:701] Row locks acquired
0709 12:56:55.797279 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:56:55.797389 (+   110us) write_op.cc:270] Start()
0709 12:56:55.797478 (+    89us) write_op.cc:276] Timestamp: P: 1783601815797351 usec, L: 0
0709 12:56:55.797496 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:56:55.798051 (+   555us) log.cc:844] Serialized 598 byte log entry
0709 12:56:55.812168 (+ 14117us) op_driver.cc:464] REPLICATION: finished
0709 12:56:55.835629 (+ 23461us) write_op.cc:301] APPLY: starting
0709 12:56:55.835716 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:56:55.835843 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 12:56:55.835990 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:56:55.836230 (+   240us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:56:55.836406 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:56:55.836480 (+    74us) write_op.cc:312] APPLY: finished
0709 12:56:55.836714 (+   234us) log.cc:844] Serialized 22 byte log entry
0709 12:56:55.836908 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:56:55.838478 (+  1570us) write_op.cc:454] Released schema lock
0709 12:56:55.838526 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:56:55.839075 (+   549us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:56:55.839116 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3789,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":23216,"apply.run_cpu_time_us":1764,"apply.run_wall_time_us":3221,"num_ops":1,"prepare.queue_time_us":1983,"prepare.run_cpu_time_us":10066,"prepare.run_wall_time_us":14565,"raft.queue_time_us":1797,"raft.run_cpu_time_us":9607,"raft.run_wall_time_us":27567,"replication_time_us":14550,"thread_start_us":40913,"threads_started":4,"wal-append.queue_time_us":10629,"wal-append.run_cpu_time_us":13595,"wal-append.run_wall_time_us":1029819}]]}
I20260709 12:56:56.857506  2555 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:56.862906  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58430 (request call id 153) took 1059 ms. Trace:
I20260709 12:56:56.863293  1467 rpcz_store.cc:276] 0709 12:56:55.803445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:55.803581 (+   136us) service_pool.cc:224] Handling call
0709 12:56:55.811762 (+  8181us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269e090 00007f6a4273cf3a 00007f6a484f31cc 00007f6a485f137e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:56:56.862846 (+1051084us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349199,"reported_tablets":1,"spinlock_wait_cycles":10035456}
W20260709 12:56:56.864048  1610 consensus_peers.cc:597] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe107547ec8e475786b8fa8f8c789648. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:56.867472  2559 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:56.891135  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58424 (request call id 156) took 1085 ms. Trace:
I20260709 12:56:56.892783  2526 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:56:56.893419  2526 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:56.895504  2526 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:56:56.892776  1469 rpcz_store.cc:276] 0709 12:56:55.805909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:55.806040 (+   131us) service_pool.cc:224] Handling call
0709 12:56:55.910558 (+104518us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269e090 00007f6a4273cf3a 00007f6a484f31cc 00007f6a485f137e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:56:56.891067 (+980509us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":585092,"reported_tablets":1,"spinlock_wait_cycles":4518784}
I20260709 12:56:56.903532  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:56.908828  1566 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:56.913364  2557 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:56:56.913877  2557 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:56:56.915863  2557 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:56.899144  1467 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:56.900874  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:56.927078  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800104b60 after lost signal to thread 434
W20260709 12:56:56.928088  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08001782a0 after lost signal to thread 1504
W20260709 12:56:56.929252  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9140 after lost signal to thread 1596
W20260709 12:56:56.930284  1593 debug-util.cc:398] Leaking SignalData structure 0x7b080032d960 after lost signal to thread 1671
W20260709 12:56:56.931303  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2c20 after lost signal to thread 1745
W20260709 12:56:56.932385  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800327c80 after lost signal to thread 2373
I20260709 12:56:56.939052  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:56:56.953956  2532 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:56.957540  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:56.961728  1713 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:56.965955  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:56:56.975876  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:56.995002  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:56:56.998965  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:56:57.016628  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 52900.2us
I20260709 12:56:57.021401  2566 ts_tablet_manager.cc:933] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:57.024386  2556 tablet_copy_client.cc:806] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:57.025023  2556 tablet_copy_client.cc:670] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:57.031710  2556 tablet_copy_client.cc:538] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:57.043668  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:56:57.044881  2563 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:56:57.023871  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:57.050149  2555 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:56:57.053968  1612 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:57.057296  2555 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:57.068444  2554 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:56:57.071974  2556 tablet_bootstrap.cc:492] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:57.077195  2566 tablet_copy_client.cc:323] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:56:57.136667  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:56:57.160104  2475 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:56:57.160177  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:56:57.161351  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet 35dd8bcf618a48bb9d3dc5e16f488fcf from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-35dd8bcf618a48bb9d3dc5e16f488fcf
I20260709 12:56:57.172142  2520 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:57.183642  1730 tablet_copy_source_session.cc:215] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:57.208063  2566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:56:57.207366  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 90689.5us
I20260709 12:56:57.229533  1718 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:57.240136  1566 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:57.274283  1720 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:57.275748  1467 catalog_manager.cc:5697] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.312042  2556 tablet_bootstrap.cc:492] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:57.317476  2566 tablet_copy_client.cc:806] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:57.318171  2566 tablet_copy_client.cc:670] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:57.329907  2556 tablet_bootstrap.cc:492] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:57.330888  2556 ts_tablet_manager.cc:1403] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.259s	user 0.013s	sys 0.017s
I20260709 12:56:57.334764  2566 tablet_copy_client.cc:538] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:57.364246  2556 raft_consensus.cc:359] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:57.372812  2556 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:57.385185  2556 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:57.407734  2566 tablet_bootstrap.cc:492] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:57.409647  2556 ts_tablet_manager.cc:1434] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.002s
I20260709 12:56:57.412429  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-13d708096220406385b27d464c8725f2 received from {username='slave'} at 127.0.0.1:58328
I20260709 12:56:57.412989  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-13d708096220406385b27d464c8725f2 on tablet 13d708096220406385b27d464c8725f2 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:57.417562  1572 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:57.424933  2299 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:56:57.428563  1646 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:56:57.444046  2556 ts_tablet_manager.cc:933] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:56:57.445099  1684 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 061154c4edb1414ca27eef7f6a49a794. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:57.447564  2563 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:57.467793  2556 tablet_copy_client.cc:323] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:56:57.470413  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet fe107547ec8e475786b8fa8f8c789648 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:56:57.471024  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet fe107547ec8e475786b8fa8f8c789648 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-fe107547ec8e475786b8fa8f8c789648
I20260709 12:56:57.472225  2565 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:57.474390  1646 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:57.489409  1657 tablet_copy_source_session.cc:215] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:57.493710  2556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe107547ec8e475786b8fa8f8c789648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:57.491477  1569 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:57.521983  1468 catalog_manager.cc:5697] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:56:57.533653  2566 tablet_bootstrap.cc:492] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:57.549465  2566 tablet_bootstrap.cc:492] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:57.550288  2566 ts_tablet_manager.cc:1403] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.143s	user 0.021s	sys 0.004s
I20260709 12:56:57.553462  2566 raft_consensus.cc:359] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:57.562199  2566 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:57.562882  2556 tablet_copy_client.cc:806] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:57.562920  2566 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:57.565704  2556 tablet_copy_client.cc:670] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:57.569262  2566 ts_tablet_manager.cc:1434] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:56:57.571960  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-35dd8bcf618a48bb9d3dc5e16f488fcf received from {username='slave'} at 127.0.0.1:48852
I20260709 12:56:57.572382  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-35dd8bcf618a48bb9d3dc5e16f488fcf on tablet 35dd8bcf618a48bb9d3dc5e16f488fcf with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:57.580099  2556 tablet_copy_client.cc:538] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:57.608301  2556 tablet_bootstrap.cc:492] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:57.631995  2556 tablet_bootstrap.cc:492] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:57.633016  2556 tablet_bootstrap.cc:492] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:57.633808  2556 ts_tablet_manager.cc:1403] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.004s
I20260709 12:56:57.637216  2556 raft_consensus.cc:359] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:57.638094  2556 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:57.638761  2556 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:57.641484  2556 ts_tablet_manager.cc:1434] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:56:57.643467  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-fe107547ec8e475786b8fa8f8c789648 received from {username='slave'} at 127.0.0.1:58328
I20260709 12:56:57.643939  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-fe107547ec8e475786b8fa8f8c789648 on tablet fe107547ec8e475786b8fa8f8c789648 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:57.696424  2346 raft_consensus.cc:1217] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:57.720407  2346 raft_consensus.cc:1217] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:57.914529  2346 raft_consensus.cc:1217] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:57.987944  2556 ts_tablet_manager.cc:933] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:56:57.990943  2556 tablet_copy_client.cc:323] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:56:57.992658  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet 061154c4edb1414ca27eef7f6a49a794 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:56:57.993206  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet 061154c4edb1414ca27eef7f6a49a794 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-061154c4edb1414ca27eef7f6a49a794
I20260709 12:56:58.002559  1730 tablet_copy_source_session.cc:215] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:56:58.006850  2556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061154c4edb1414ca27eef7f6a49a794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:58.028712  2556 tablet_copy_client.cc:806] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:56:58.029328  2556 tablet_copy_client.cc:670] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:56:58.033157  2556 tablet_copy_client.cc:538] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:56:58.046468  2556 tablet_bootstrap.cc:492] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:56:58.075727  2556 tablet_bootstrap.cc:492] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:56:58.076746  2556 tablet_bootstrap.cc:492] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:56:58.077406  2556 ts_tablet_manager.cc:1403] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.010s
I20260709 12:56:58.080088  2556 raft_consensus.cc:359] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:58.080966  2556 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:56:58.081594  2556 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:56:58.084199  2556 ts_tablet_manager.cc:1434] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:56:58.087894  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-061154c4edb1414ca27eef7f6a49a794 received from {username='slave'} at 127.0.0.1:48852
I20260709 12:56:58.088285  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-061154c4edb1414ca27eef7f6a49a794 on tablet 061154c4edb1414ca27eef7f6a49a794 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:56:58.140928  2557 raft_consensus.cc:1064] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:58.143544  2557 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:58.150000  2565 raft_consensus.cc:1064] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:58.152626  2565 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:58.158183  2346 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.162222  2555 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:58.160526  1719 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.164183  1569 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.166306  2554 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:58.169885  2555 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:58.194839  2554 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.196635  1572 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.203725  1569 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.205295  2526 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:58.206241  2348 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.207103  1646 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.207541  2563 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:58.211944  2526 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:58.219841  2346 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.227258  1469 catalog_manager.cc:5697] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.234951  1719 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:56:58.271369  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 61594us
I20260709 12:56:58.301224  2563 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.316510  1569 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.325019  1646 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.324992  2346 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.347214  1641 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:58.372043  2346 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:58.374467  1718 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:58.378816  2520 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:58.359769  1466 catalog_manager.cc:5697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.393105  2559 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:58.397842  2559 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.399653  2348 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.401659  2346 raft_consensus.cc:1217] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:56:58.415062  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe107547ec8e475786b8fa8f8c789648 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:58.443372  1466 catalog_manager.cc:5697] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.452440  2559 raft_consensus.cc:1064] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:58.455261  2559 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:58.463459  1556 tablet_service.cc:1558] Processing DeleteTablet for tablet fe107547ec8e475786b8fa8f8c789648 with delete_type TABLET_DATA_TOMBSTONED (TS 2af567a273d44ca89d2b3b0f7c815bd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45012
I20260709 12:56:58.460173  1719 raft_consensus.cc:2955] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.468165  1718 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:58.479001  2346 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:58.482311  1569 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:58.486949  2565 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:58.497026  2589 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:58.527189  1719 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.538371  2597 tablet_replica.cc:333] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:56:58.538553  2346 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.540845  2520 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:58.555157  1569 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.540302  2597 raft_consensus.cc:2243] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:58.559140  1566 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.564213  2348 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.566537  2597 raft_consensus.cc:2272] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:58.565986  2557 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:56:58.569763  2555 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:58.570161  2590 raft_consensus.cc:2955] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.614483  1467 catalog_manager.cc:5697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.625146  2597 ts_tablet_manager.cc:1916] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:56:58.668349  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 64531.7us
I20260709 12:56:58.678532  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:58.693583  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet 35dd8bcf618a48bb9d3dc5e16f488fcf with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59242
W20260709 12:56:58.690510  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 87844.4us
I20260709 12:56:58.712862  2600 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.733467  2348 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.804963  2608 tablet_replica.cc:333] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:56:58.806984  2608 raft_consensus.cc:2243] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:58.832742  2608 raft_consensus.cc:2272] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:58.837707  1468 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.833249  1566 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.842983  2597 ts_tablet_manager.cc:1929] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:58.843575  2597 log.cc:1199] T fe107547ec8e475786b8fa8f8c789648 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/wals/fe107547ec8e475786b8fa8f8c789648
I20260709 12:56:58.865147  2608 ts_tablet_manager.cc:1916] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:56:58.875941  1719 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.892052  2590 raft_consensus.cc:1064] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:56:58.895081  2590 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:58.910312  1456 catalog_manager.cc:5028] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): tablet fe107547ec8e475786b8fa8f8c789648 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:58.925940  2348 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.927860  1641 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.929562  2589 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:58.941936  1641 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:58.944566  2610 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:58.958319  1564 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:56:58.959687  2590 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:58.963191  2608 ts_tablet_manager.cc:1929] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:58.963847  2346 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:58.966179  2600 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:58.963881  2608 log.cc:1199] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/35dd8bcf618a48bb9d3dc5e16f488fcf
I20260709 12:56:58.978096  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet 35dd8bcf618a48bb9d3dc5e16f488fcf (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:58.978736  2599 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.982678  1566 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:58.984897  2559 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:58.991577  1572 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.041558  1468 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:58.993899  2346 raft_consensus.cc:2955] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.060058  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 13d708096220406385b27d464c8725f2 with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46146
W20260709 12:56:59.064406  2612 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:56:59.086529  2610 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.094013  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13d708096220406385b27d464c8725f2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:59.090845  1641 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.110082  2348 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.142926  2616 tablet_replica.cc:333] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:56:59.144724  2616 raft_consensus.cc:2243] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:59.151862  1467 catalog_manager.cc:5697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.152415  1566 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.158939  2616 raft_consensus.cc:2272] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:59.164194  2616 ts_tablet_manager.cc:1916] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:56:59.182485  2616 ts_tablet_manager.cc:1929] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:59.182964  2616 log.cc:1199] T 13d708096220406385b27d464c8725f2 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/13d708096220406385b27d464c8725f2
I20260709 12:56:59.185016  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet 13d708096220406385b27d464c8725f2 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:56:59.219519  1719 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:56:59.236199  2348 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:59.237957  2610 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:59.245231  1566 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:56:59.246824  2589 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:59.261474  2590 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.268343  1566 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.268635  2348 raft_consensus.cc:2955] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.294691  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 061154c4edb1414ca27eef7f6a49a794 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:56:59.298520  1468 catalog_manager.cc:5697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:56:59.314872  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet 061154c4edb1414ca27eef7f6a49a794 with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59242
I20260709 12:56:59.315882  2608 tablet_replica.cc:333] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:56:59.317266  2608 raft_consensus.cc:2243] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:59.318291  2608 raft_consensus.cc:2272] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:59.322362  2608 ts_tablet_manager.cc:1916] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:56:59.346287  2608 ts_tablet_manager.cc:1929] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:56:59.346931  2608 log.cc:1199] T 061154c4edb1414ca27eef7f6a49a794 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/061154c4edb1414ca27eef7f6a49a794
I20260709 12:56:59.351639  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet 061154c4edb1414ca27eef7f6a49a794 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:00.406601  1641 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:00.414244  1610 consensus_peers.cc:597] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5a66d6152a24cf08a833d30477e5bbe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:00.414521  1572 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:00.415788  1719 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:00.416164  2599 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:00.417552  2557 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:00.448489  2617 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.458915  1720 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.477315  1466 catalog_manager.cc:5697] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.493176  1641 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:00.507764  1610 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ccb6bb6402c4cdf9f065c72d521dc44. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:00.513273  1564 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:00.520283  1572 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.525652  2624 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:00.552446  1713 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:00.554380  2622 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:00.560616  2624 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.562541  1564 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.579291  1466 catalog_manager.cc:5697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:00.579735  1713 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.583410  1718 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:00.605532  1684 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d01fa5de23643a7bc42ad00178a7f51. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:00.615126  1639 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:00.617066  1572 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:00.617379  2621 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:00.618479  2610 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:00.627214  2610 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.628913  1572 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.632676  1639 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.645928  1467 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:00.651237  1641 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:00.677403  1610 consensus_peers.cc:597] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86e8c2c317414ecda8dce8d5284c74d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:00.677868  1718 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:00.678514  1572 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:00.679266  2626 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:00.680159  2622 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:00.700749  2622 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.706352  1564 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.726853  1718 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.730297  1467 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:00.945184  2638 ts_tablet_manager.cc:933] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:00.952064  2638 tablet_copy_client.cc:323] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:57:00.954291  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet d5a66d6152a24cf08a833d30477e5bbe from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:57:00.954823  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet d5a66d6152a24cf08a833d30477e5bbe from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-d5a66d6152a24cf08a833d30477e5bbe
I20260709 12:57:00.961843  1657 tablet_copy_source_session.cc:215] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:00.965278  2638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a66d6152a24cf08a833d30477e5bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:00.986764  2638 tablet_copy_client.cc:806] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:00.988350  2638 tablet_copy_client.cc:670] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:00.992085  2638 tablet_copy_client.cc:538] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:00.998324  2638 tablet_bootstrap.cc:492] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:01.031302  2638 tablet_bootstrap.cc:492] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:01.032383  2638 tablet_bootstrap.cc:492] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:01.033123  2638 ts_tablet_manager.cc:1403] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.011s
I20260709 12:57:01.036226  2638 raft_consensus.cc:359] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:01.037117  2638 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:01.037823  2638 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:01.059293  2638 ts_tablet_manager.cc:1434] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.015s
I20260709 12:57:01.062804  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-d5a66d6152a24cf08a833d30477e5bbe received from {username='slave'} at 127.0.0.1:58328
I20260709 12:57:01.063264  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-d5a66d6152a24cf08a833d30477e5bbe on tablet d5a66d6152a24cf08a833d30477e5bbe with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:01.069703  2638 ts_tablet_manager.cc:933] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:01.097291  2638 tablet_copy_client.cc:323] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:57:01.099660  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet 6d01fa5de23643a7bc42ad00178a7f51 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:57:01.100252  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet 6d01fa5de23643a7bc42ad00178a7f51 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-6d01fa5de23643a7bc42ad00178a7f51
I20260709 12:57:01.107975  1730 tablet_copy_source_session.cc:215] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:01.113030  2638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d01fa5de23643a7bc42ad00178a7f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.125926  2643 ts_tablet_manager.cc:933] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:01.138504  2638 tablet_copy_client.cc:806] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:01.139243  2643 tablet_copy_client.cc:323] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:57:01.139473  2638 tablet_copy_client.cc:670] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:01.141284  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet 0ccb6bb6402c4cdf9f065c72d521dc44 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:57:01.141817  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet 0ccb6bb6402c4cdf9f065c72d521dc44 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-0ccb6bb6402c4cdf9f065c72d521dc44
I20260709 12:57:01.148010  2638 tablet_copy_client.cc:538] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:01.151705  1657 tablet_copy_source_session.cc:215] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:01.154935  2643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccb6bb6402c4cdf9f065c72d521dc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.157035  2638 tablet_bootstrap.cc:492] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:01.175908  2643 tablet_copy_client.cc:806] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:01.176638  2643 tablet_copy_client.cc:670] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:01.189499  2643 tablet_copy_client.cc:538] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:01.209640  2643 tablet_bootstrap.cc:492] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:01.210559  2648 ts_tablet_manager.cc:933] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:01.218133  2638 tablet_bootstrap.cc:492] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:01.219326  2638 tablet_bootstrap.cc:492] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:01.224447  2648 tablet_copy_client.cc:323] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:57:01.226500  2638 ts_tablet_manager.cc:1403] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.070s	user 0.029s	sys 0.015s
I20260709 12:57:01.227384  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet 86e8c2c317414ecda8dce8d5284c74d1 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:57:01.228128  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet 86e8c2c317414ecda8dce8d5284c74d1 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-86e8c2c317414ecda8dce8d5284c74d1
I20260709 12:57:01.231689  2638 raft_consensus.cc:359] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:01.232832  2638 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:01.233718  2638 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:01.251235  2638 ts_tablet_manager.cc:1434] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.008s
I20260709 12:57:01.260317  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-6d01fa5de23643a7bc42ad00178a7f51 received from {username='slave'} at 127.0.0.1:48852
I20260709 12:57:01.260779  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-6d01fa5de23643a7bc42ad00178a7f51 on tablet 6d01fa5de23643a7bc42ad00178a7f51 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:01.272712  1657 tablet_copy_source_session.cc:215] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:01.278200  2648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e8c2c317414ecda8dce8d5284c74d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:01.281627  2643 tablet_bootstrap.cc:492] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:01.282760  2643 tablet_bootstrap.cc:492] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:01.283440  2643 ts_tablet_manager.cc:1403] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.016s
I20260709 12:57:01.286784  2643 raft_consensus.cc:359] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:01.287633  2643 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:01.288306  2643 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:01.291051  2643 ts_tablet_manager.cc:1434] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:01.292902  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-0ccb6bb6402c4cdf9f065c72d521dc44 received from {username='slave'} at 127.0.0.1:58328
I20260709 12:57:01.293286  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-0ccb6bb6402c4cdf9f065c72d521dc44 on tablet 0ccb6bb6402c4cdf9f065c72d521dc44 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:01.303941  2648 tablet_copy_client.cc:806] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:01.304486  2648 tablet_copy_client.cc:670] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:01.308007  2648 tablet_copy_client.cc:538] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:01.322254  2648 tablet_bootstrap.cc:492] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:01.357180  2648 tablet_bootstrap.cc:492] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:01.358080  2648 tablet_bootstrap.cc:492] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:01.358753  2648 ts_tablet_manager.cc:1403] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.011s
I20260709 12:57:01.362020  2648 raft_consensus.cc:359] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:01.362887  2648 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:01.363582  2648 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:01.366809  2348 raft_consensus.cc:1217] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:01.371075  2648 ts_tablet_manager.cc:1434] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 12:57:01.374184  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-86e8c2c317414ecda8dce8d5284c74d1 received from {username='slave'} at 127.0.0.1:58328
I20260709 12:57:01.374707  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-86e8c2c317414ecda8dce8d5284c74d1 on tablet 86e8c2c317414ecda8dce8d5284c74d1 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:01.553483  2348 raft_consensus.cc:1217] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:01.596741  2348 raft_consensus.cc:1217] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:01.742611  2557 raft_consensus.cc:1064] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:01.746032  2346 raft_consensus.cc:1217] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:01.758383  2557 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:01.781200  2348 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:01.784435  1572 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:01.784763  1720 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:01.783583  2557 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:57:01.786463  2622 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:01.789325  2626 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:01.813596  2557 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:01.820211  1564 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:01.827484  1720 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:01.834421  1466 catalog_manager.cc:5697] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:01.857795  2348 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:01.963442  1639 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:01.974781  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 48376us
I20260709 12:57:01.979764  2348 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:01.981379  2622 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:01.990053  2626 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:01.991730  2346 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.002573  1564 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:02.005187  2610 raft_consensus.cc:1064] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:02.008325  2599 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:02.008368  2610 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:02.019883  1564 raft_consensus.cc:2955] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.060699  2617 raft_consensus.cc:1064] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:02.062999  1467 catalog_manager.cc:5697] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.063628  2617 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:02.084244  1641 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:02.088155  1566 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:02.093228  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5a66d6152a24cf08a833d30477e5bbe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:02.099448  2640 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:02.115619  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet d5a66d6152a24cf08a833d30477e5bbe with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46146
I20260709 12:57:02.118825  2346 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:02.135982  2667 tablet_replica.cc:333] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:57:02.139986  2667 raft_consensus.cc:2243] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:02.141256  2667 raft_consensus.cc:2272] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:02.146483  2667 ts_tablet_manager.cc:1916] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:02.122498  2640 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:57:02.150882  2565 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:02.157797  2348 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:02.161130  2557 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:02.164002  1566 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:02.164419  1720 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:02.166507  2617 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:02.173578  2626 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:02.199710  2626 raft_consensus.cc:1064] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:02.201488  2565 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.203364  2626 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:02.205039  1566 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.230409  1469 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.249639  2599 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.253295  1641 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.252329  1720 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.267685  1566 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.277705  2348 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:02.288334  2669 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:02.295801  2349 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.304379  1718 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:02.311218  1566 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:02.313117  2557 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:02.315780  2675 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:02.312423  1469 catalog_manager.cc:5697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.347190  2667 ts_tablet_manager.cc:1929] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:02.347940  2667 log.cc:1199] T d5a66d6152a24cf08a833d30477e5bbe P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/d5a66d6152a24cf08a833d30477e5bbe
I20260709 12:57:02.350208  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet d5a66d6152a24cf08a833d30477e5bbe (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
W20260709 12:57:02.352546  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 67946.4us
I20260709 12:57:02.354619  2346 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.378990  2557 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.391819  1720 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.395166  1566 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.423290  1467 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.425410  2349 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.439653  1720 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:02.454763  2346 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:02.456321  2565 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:02.461627  1566 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:02.465041  2640 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:02.468909  2665 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.470726  2346 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.473351  1572 raft_consensus.cc:2955] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.492079  1466 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.497536  1641 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:02.517683  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d01fa5de23643a7bc42ad00178a7f51 with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59242
I20260709 12:57:02.522447  1646 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:02.529366  2346 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:02.531572  1713 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:02.532991  2681 tablet_replica.cc:333] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:57:02.534349  2557 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:02.539690  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6d01fa5de23643a7bc42ad00178a7f51 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:02.542469  2676 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:02.547431  2669 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.558996  2681 raft_consensus.cc:2243] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:02.559923  2681 raft_consensus.cc:2272] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:02.572412  2681 ts_tablet_manager.cc:1916] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:02.583475  2349 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.585985  2348 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:02.587668  1720 raft_consensus.cc:2955] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.585985  1713 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:02.597622  2557 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:02.602751  2675 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:02.622649  2675 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.625617  1467 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.627009  2681 ts_tablet_manager.cc:1929] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:02.627645  2681 log.cc:1199] T 6d01fa5de23643a7bc42ad00178a7f51 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/6d01fa5de23643a7bc42ad00178a7f51
I20260709 12:57:02.629684  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet 6d01fa5de23643a7bc42ad00178a7f51 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:02.635838  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 86e8c2c317414ecda8dce8d5284c74d1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:02.640585  1556 tablet_service.cc:1558] Processing DeleteTablet for tablet 86e8c2c317414ecda8dce8d5284c74d1 with delete_type TABLET_DATA_TOMBSTONED (TS 2af567a273d44ca89d2b3b0f7c815bd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45012
I20260709 12:57:02.647116  2682 tablet_replica.cc:333] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:57:02.654234  2346 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.665187  1718 raft_consensus.cc:2955] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.695467  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ccb6bb6402c4cdf9f065c72d521dc44 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:02.710242  1467 catalog_manager.cc:5697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:02.728310  2682 raft_consensus.cc:2243] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:02.731582  1556 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ccb6bb6402c4cdf9f065c72d521dc44 with delete_type TABLET_DATA_TOMBSTONED (TS 2af567a273d44ca89d2b3b0f7c815bd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45012
I20260709 12:57:02.735611  2682 raft_consensus.cc:2272] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:02.747306  2682 ts_tablet_manager.cc:1916] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:02.763800  2682 ts_tablet_manager.cc:1929] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:02.764287  2682 log.cc:1199] T 86e8c2c317414ecda8dce8d5284c74d1 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/wals/86e8c2c317414ecda8dce8d5284c74d1
I20260709 12:57:02.766105  2682 tablet_replica.cc:333] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:57:02.766022  1456 catalog_manager.cc:5028] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): tablet 86e8c2c317414ecda8dce8d5284c74d1 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:02.767486  2682 raft_consensus.cc:2243] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:02.768070  2682 raft_consensus.cc:2272] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:02.770725  2682 ts_tablet_manager.cc:1916] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:02.790817  2682 ts_tablet_manager.cc:1929] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:02.791157  2682 log.cc:1199] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/wals/0ccb6bb6402c4cdf9f065c72d521dc44
I20260709 12:57:02.794404  1456 catalog_manager.cc:5028] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): tablet 0ccb6bb6402c4cdf9f065c72d521dc44 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:03.812523  1641 consensus_queue.cc:237] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:03.818662  1610 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0aa36fcde2c4a1fa46a60cb9a82a16f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:03.819031  1568 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:03.820322  1720 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:03.820279  2675 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.821481  2685 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.828300  2675 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.836592  1718 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.843297  1467 catalog_manager.cc:5697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:03.844623  1720 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:03.847204  1568 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:57:03.857913  1684 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b302e4f74a6c4ff2915495d3ac0982bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:03.859735  1641 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:03.861064  1566 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:03.862267  2684 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.863417  2665 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.876214  2665 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.878345  1641 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.891582  1568 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.907999  1641 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:03.911139  1466 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:03.915733  1610 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d36382528fc4b5680388922224bdfa3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:03.916819  1566 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:03.917793  1720 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:03.918301  2677 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.920351  2677 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.928866  2675 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.930186  1720 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.936798  1568 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.946893  1566 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:03.952395  1467 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:57:03.960407  1535 consensus_peers.cc:597] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3e979717db64b77b569522980fab6af. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:03.963670  1641 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:03.965395  2661 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.967631  1720 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:03.969050  2661 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:03.976155  2683 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.978224  1641 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.979571  1720 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:03.992455  1466 catalog_manager.cc:5697] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:04.321877  2702 ts_tablet_manager.cc:933] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:04.323738  2702 tablet_copy_client.cc:323] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:57:04.325397  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:57:04.325958  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet d0aa36fcde2c4a1fa46a60cb9a82a16f from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-d0aa36fcde2c4a1fa46a60cb9a82a16f
I20260709 12:57:04.333743  1657 tablet_copy_source_session.cc:215] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:04.336310  2702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:04.348254  2702 tablet_copy_client.cc:806] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:04.348902  2702 tablet_copy_client.cc:670] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:04.352180  2702 tablet_copy_client.cc:538] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:04.358937  2702 tablet_bootstrap.cc:492] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:04.362862  2704 ts_tablet_manager.cc:933] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:04.371318  2704 tablet_copy_client.cc:323] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:57:04.373034  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet b302e4f74a6c4ff2915495d3ac0982bc from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:57:04.373600  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet b302e4f74a6c4ff2915495d3ac0982bc from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-b302e4f74a6c4ff2915495d3ac0982bc
I20260709 12:57:04.379086  2702 tablet_bootstrap.cc:492] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:04.379956  2702 tablet_bootstrap.cc:492] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:04.380611  2702 ts_tablet_manager.cc:1403] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 12:57:04.383613  2702 raft_consensus.cc:359] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:04.384377  2702 raft_consensus.cc:740] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:04.385084  1730 tablet_copy_source_session.cc:215] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:04.385028  2702 consensus_queue.cc:260] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:04.388733  2704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302e4f74a6c4ff2915495d3ac0982bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:04.392938  2702 ts_tablet_manager.cc:1434] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.009s
I20260709 12:57:04.397817  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-d0aa36fcde2c4a1fa46a60cb9a82a16f received from {username='slave'} at 127.0.0.1:58328
I20260709 12:57:04.398218  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-d0aa36fcde2c4a1fa46a60cb9a82a16f on tablet d0aa36fcde2c4a1fa46a60cb9a82a16f with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:04.408486  2704 tablet_copy_client.cc:806] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:04.409075  2704 tablet_copy_client.cc:670] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:04.412595  2704 tablet_copy_client.cc:538] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:04.421450  2704 tablet_bootstrap.cc:492] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:04.437788  2704 tablet_bootstrap.cc:492] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:04.438606  2704 tablet_bootstrap.cc:492] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:04.439204  2704 ts_tablet_manager.cc:1403] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:57:04.441924  2704 raft_consensus.cc:359] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:04.442703  2704 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:04.443348  2704 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:04.445708  2704 ts_tablet_manager.cc:1434] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:57:04.447338  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-b302e4f74a6c4ff2915495d3ac0982bc received from {username='slave'} at 127.0.0.1:48852
I20260709 12:57:04.447717  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-b302e4f74a6c4ff2915495d3ac0982bc on tablet b302e4f74a6c4ff2915495d3ac0982bc with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:04.455636  2704 ts_tablet_manager.cc:933] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:57:04.459278  2704 tablet_copy_client.cc:323] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39997
I20260709 12:57:04.461090  1582 tablet_copy_service.cc:140] P 2af567a273d44ca89d2b3b0f7c815bd1: Received BeginTabletCopySession request for tablet a3e979717db64b77b569522980fab6af from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:53576)
I20260709 12:57:04.461547  1582 tablet_copy_service.cc:161] P 2af567a273d44ca89d2b3b0f7c815bd1: Beginning new tablet copy session on tablet a3e979717db64b77b569522980fab6af from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:53576: session id = c05ea12435084ad9b281ed3a0a2ecebe-a3e979717db64b77b569522980fab6af
I20260709 12:57:04.467914  1582 tablet_copy_source_session.cc:215] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:04.470288  2704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e979717db64b77b569522980fab6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:04.483683  2704 tablet_copy_client.cc:806] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:04.484194  2704 tablet_copy_client.cc:670] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:04.487447  2704 tablet_copy_client.cc:538] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:04.494558  2704 tablet_bootstrap.cc:492] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:04.514070  2704 tablet_bootstrap.cc:492] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:04.514832  2704 tablet_bootstrap.cc:492] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:04.515475  2704 ts_tablet_manager.cc:1403] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:57:04.517532  2704 raft_consensus.cc:359] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:04.518096  2704 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:04.518683  2704 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:04.521466  2704 ts_tablet_manager.cc:1434] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:57:04.523981  1582 tablet_copy_service.cc:342] P 2af567a273d44ca89d2b3b0f7c815bd1: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-a3e979717db64b77b569522980fab6af received from {username='slave'} at 127.0.0.1:53576
I20260709 12:57:04.524396  1582 tablet_copy_service.cc:434] P 2af567a273d44ca89d2b3b0f7c815bd1: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-a3e979717db64b77b569522980fab6af on tablet a3e979717db64b77b569522980fab6af with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:04.537213  2704 ts_tablet_manager.cc:933] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:04.539052  2704 tablet_copy_client.cc:323] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:57:04.540555  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet 0d36382528fc4b5680388922224bdfa3 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:57:04.541038  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet 0d36382528fc4b5680388922224bdfa3 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-0d36382528fc4b5680388922224bdfa3
I20260709 12:57:04.547411  1657 tablet_copy_source_session.cc:215] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:04.550987  2704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d36382528fc4b5680388922224bdfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:04.566453  2704 tablet_copy_client.cc:806] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:04.566969  2704 tablet_copy_client.cc:670] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:04.570196  2704 tablet_copy_client.cc:538] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:04.582617  2704 tablet_bootstrap.cc:492] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:04.598986  2704 tablet_bootstrap.cc:492] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:04.599699  2704 tablet_bootstrap.cc:492] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:04.600245  2704 ts_tablet_manager.cc:1403] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 12:57:04.602449  2704 raft_consensus.cc:359] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:04.602985  2704 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:04.603418  2704 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:04.605223  2704 ts_tablet_manager.cc:1434] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:57:04.607641  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-0d36382528fc4b5680388922224bdfa3 received from {username='slave'} at 127.0.0.1:58328
I20260709 12:57:04.608019  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-0d36382528fc4b5680388922224bdfa3 on tablet 0d36382528fc4b5680388922224bdfa3 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:04.842003  2349 raft_consensus.cc:1217] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:04.953352  2349 raft_consensus.cc:1217] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:04.969542  2349 raft_consensus.cc:1217] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:57:04.993960  2349 raft_consensus.cc:1217] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:05.360611  2714 raft_consensus.cc:1064] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:05.362875  2717 raft_consensus.cc:1064] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:05.363526  2714 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:05.365425  2717 consensus_queue.cc:237] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:05.370644  2349 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:05.371917  1641 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:05.372181  1718 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:05.372057  2683 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:05.373688  2714 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.377599  2683 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.412545  2685 raft_consensus.cc:1064] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:05.415295  2685 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:05.426005  2661 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.431465  2349 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.434401  1641 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.445465  1720 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.461503  2346 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.470119  1566 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.472708  2675 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.484833  2723 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.491099  1467 catalog_manager.cc:5697] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:05.535432  2348 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.541501  1572 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.550544  1713 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.552229  1718 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.553259  2723 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:05.557265  2685 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.557747  2675 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.559602  2684 raft_consensus.cc:1064] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:05.562510  2724 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.562805  2685 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.564256  1572 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.584945  1469 catalog_manager.cc:5697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:05.595695  2349 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.610399  2684 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:05.620095  2711 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.629287  1713 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.633203  1568 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.634882  2349 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.635903  1641 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.637487  2665 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.639109  2665 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.646167  1718 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.653714  2347 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.658747  1572 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:05.676927  2716 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.680042  2349 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.684563  2347 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:05.686956  2661 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:05.692199  1572 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.695427  1639 consensus_queue.cc:237] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:05.696717  2738 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.698720  1467 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.702047  1568 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.706559  2714 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.708230  1572 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:05.710142  2349 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:05.709744  2347 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.713200  2717 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:05.714283  2685 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:05.719259  1641 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:05.723193  2675 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.732478  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:05.733896  2683 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:05.738812  2346 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.739305  1639 raft_consensus.cc:2955] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.745970  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a3e979717db64b77b569522980fab6af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:05.748517  1572 raft_consensus.cc:2955] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.750170  1467 catalog_manager.cc:5697] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.753780  1467 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.755669  1641 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:05.757027  1646 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.772125  1469 catalog_manager.cc:5697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 3 to 4, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:05.783747  1718 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:05.785562  2717 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:05.789670  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet a3e979717db64b77b569522980fab6af with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46146
I20260709 12:57:05.792567  2717 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.803486  1711 tablet_service.cc:1558] Processing DeleteTablet for tablet d0aa36fcde2c4a1fa46a60cb9a82a16f with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46146
I20260709 12:57:05.805835  1718 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.809855  2346 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:05.811558  2711 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:05.814983  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d36382528fc4b5680388922224bdfa3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:05.834194  2743 tablet_replica.cc:333] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:57:05.835455  2743 raft_consensus.cc:2243] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:05.836290  2743 raft_consensus.cc:2272] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:05.839785  2743 ts_tablet_manager.cc:1916] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:05.841564  2346 raft_consensus.cc:2955] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:05.846655  1464 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:05.859179  2743 ts_tablet_manager.cc:1929] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:57:05.859736  2743 log.cc:1199] T a3e979717db64b77b569522980fab6af P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/a3e979717db64b77b569522980fab6af
I20260709 12:57:05.861472  2743 tablet_replica.cc:333] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:57:05.861843  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet a3e979717db64b77b569522980fab6af (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:05.862439  2743 raft_consensus.cc:2243] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:05.862797  1556 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d36382528fc4b5680388922224bdfa3 with delete_type TABLET_DATA_TOMBSTONED (TS 2af567a273d44ca89d2b3b0f7c815bd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45012
I20260709 12:57:05.863335  2743 raft_consensus.cc:2272] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:05.871266  2744 tablet_replica.cc:333] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:57:05.868419  2743 ts_tablet_manager.cc:1916] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:05.873170  2744 raft_consensus.cc:2243] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:05.873837  2744 raft_consensus.cc:2272] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:05.887096  2744 ts_tablet_manager.cc:1916] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:05.889336  2743 ts_tablet_manager.cc:1929] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:05.889779  2743 log.cc:1199] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/d0aa36fcde2c4a1fa46a60cb9a82a16f
I20260709 12:57:05.891291  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet d0aa36fcde2c4a1fa46a60cb9a82a16f (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:05.906299  2744 ts_tablet_manager.cc:1929] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:05.906757  2744 log.cc:1199] T 0d36382528fc4b5680388922224bdfa3 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/wals/0d36382528fc4b5680388922224bdfa3
I20260709 12:57:05.908123  1456 catalog_manager.cc:5028] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): tablet 0d36382528fc4b5680388922224bdfa3 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:06.101555  1720 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:06.105386  2346 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.106562  2665 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.106587  1572 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.107918  2684 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.112172  2738 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:06.113543  2346 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:06.120121  1572 raft_consensus.cc:2955] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:06.121115  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b302e4f74a6c4ff2915495d3ac0982bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:06.128933  1467 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:06.140141  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet b302e4f74a6c4ff2915495d3ac0982bc with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59242
I20260709 12:57:06.141814  2745 tablet_replica.cc:333] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:57:06.142946  2745 raft_consensus.cc:2243] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.143641  2745 raft_consensus.cc:2272] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.146852  2745 ts_tablet_manager.cc:1916] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:06.163535  2745 ts_tablet_manager.cc:1929] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:06.163935  2745 log.cc:1199] T b302e4f74a6c4ff2915495d3ac0982bc P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/b302e4f74a6c4ff2915495d3ac0982bc
I20260709 12:57:06.165488  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet b302e4f74a6c4ff2915495d3ac0982bc (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:07.217945  1568 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:07.223989  1718 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:57:07.225145  1535 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39b62689c0094341b01c7263292dd753. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:07.225162  1641 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:07.226130  2748 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:07.227062  2714 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:07.235313  2683 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.236848  1641 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.236966  1718 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.263417  1568 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:07.256574  1464 catalog_manager.cc:5697] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:07.271426  1720 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:07.273139  2683 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:07.275604  1535 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: acc3fcdecc7546fe92075e15e904c331. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:07.277938  1646 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:07.279402  2683 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:07.285141  2714 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.334964  1720 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.366463  1572 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:07.401634  1535 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fbeca1b8e9f46c5843a82bafe73b5a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:07.407707  1641 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:07.407027  1646 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.411382  2762 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:07.417826  1467 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.426664  1720 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:07.430392  2759 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:07.479945  2759 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.485781  1642 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.510427  1720 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:07.507864  1713 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.513981  1467 catalog_manager.cc:5697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:57:07.568571  1684 consensus_peers.cc:597] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 997bea07114b4964bbe0c9bc9185a7f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:07.572908  1641 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:07.574579  2738 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:07.577018  1572 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:07.581087  2665 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:07.585798  2761 raft_consensus.cc:2955] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.591377  1572 raft_consensus.cc:2955] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.598934  1642 raft_consensus.cc:2955] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.609081  2772 ts_tablet_manager.cc:933] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:57:07.619566  2772 tablet_copy_client.cc:323] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39997
I20260709 12:57:07.621714  1582 tablet_copy_service.cc:140] P 2af567a273d44ca89d2b3b0f7c815bd1: Received BeginTabletCopySession request for tablet 39b62689c0094341b01c7263292dd753 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:53576)
I20260709 12:57:07.622444  1582 tablet_copy_service.cc:161] P 2af567a273d44ca89d2b3b0f7c815bd1: Beginning new tablet copy session on tablet 39b62689c0094341b01c7263292dd753 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:53576: session id = c05ea12435084ad9b281ed3a0a2ecebe-39b62689c0094341b01c7263292dd753
I20260709 12:57:07.620028  1467 catalog_manager.cc:5697] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:07.640942  1582 tablet_copy_source_session.cc:215] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:07.644985  2772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b62689c0094341b01c7263292dd753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:07.667251  2772 tablet_copy_client.cc:806] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:07.667938  2772 tablet_copy_client.cc:670] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:07.672096  2772 tablet_copy_client.cc:538] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:07.677891  2772 tablet_bootstrap.cc:492] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:07.695536  2772 tablet_bootstrap.cc:492] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:07.696717  2772 tablet_bootstrap.cc:492] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:07.699249  2772 ts_tablet_manager.cc:1403] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 12:57:07.702282  2772 raft_consensus.cc:359] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:07.702857  2772 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:07.703480  2772 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:07.706578  2772 ts_tablet_manager.cc:1434] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:07.708781  1582 tablet_copy_service.cc:342] P 2af567a273d44ca89d2b3b0f7c815bd1: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-39b62689c0094341b01c7263292dd753 received from {username='slave'} at 127.0.0.1:53576
I20260709 12:57:07.709244  1582 tablet_copy_service.cc:434] P 2af567a273d44ca89d2b3b0f7c815bd1: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-39b62689c0094341b01c7263292dd753 on tablet 39b62689c0094341b01c7263292dd753 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:07.714623  2777 ts_tablet_manager.cc:933] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:57:07.716598  2777 tablet_copy_client.cc:323] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39997
I20260709 12:57:07.718295  1582 tablet_copy_service.cc:140] P 2af567a273d44ca89d2b3b0f7c815bd1: Received BeginTabletCopySession request for tablet acc3fcdecc7546fe92075e15e904c331 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:53576)
I20260709 12:57:07.718829  1582 tablet_copy_service.cc:161] P 2af567a273d44ca89d2b3b0f7c815bd1: Beginning new tablet copy session on tablet acc3fcdecc7546fe92075e15e904c331 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:53576: session id = c05ea12435084ad9b281ed3a0a2ecebe-acc3fcdecc7546fe92075e15e904c331
I20260709 12:57:07.726544  1582 tablet_copy_source_session.cc:215] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:07.730558  2777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3fcdecc7546fe92075e15e904c331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:07.745847  2777 tablet_copy_client.cc:806] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:07.746395  2777 tablet_copy_client.cc:670] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:07.750840  2777 tablet_copy_client.cc:538] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:07.759091  2777 tablet_bootstrap.cc:492] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:07.777513  2777 tablet_bootstrap.cc:492] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:07.778220  2777 tablet_bootstrap.cc:492] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:07.778751  2777 ts_tablet_manager.cc:1403] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260709 12:57:07.780951  2777 raft_consensus.cc:359] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:07.781550  2777 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:07.782051  2777 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:07.784682  2777 ts_tablet_manager.cc:1434] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 12:57:07.786391  1582 tablet_copy_service.cc:342] P 2af567a273d44ca89d2b3b0f7c815bd1: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-acc3fcdecc7546fe92075e15e904c331 received from {username='slave'} at 127.0.0.1:53576
I20260709 12:57:07.786780  1582 tablet_copy_service.cc:434] P 2af567a273d44ca89d2b3b0f7c815bd1: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-acc3fcdecc7546fe92075e15e904c331 on tablet acc3fcdecc7546fe92075e15e904c331 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:07.883075  2777 ts_tablet_manager.cc:933] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:57:07.884723  2777 tablet_copy_client.cc:323] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39997
I20260709 12:57:07.886281  1582 tablet_copy_service.cc:140] P 2af567a273d44ca89d2b3b0f7c815bd1: Received BeginTabletCopySession request for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:53576)
I20260709 12:57:07.886780  1582 tablet_copy_service.cc:161] P 2af567a273d44ca89d2b3b0f7c815bd1: Beginning new tablet copy session on tablet 6fbeca1b8e9f46c5843a82bafe73b5a8 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:53576: session id = c05ea12435084ad9b281ed3a0a2ecebe-6fbeca1b8e9f46c5843a82bafe73b5a8
I20260709 12:57:07.894505  1582 tablet_copy_source_session.cc:215] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:07.897418  2777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:07.914884  2777 tablet_copy_client.cc:806] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:07.915431  2777 tablet_copy_client.cc:670] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:07.918637  2777 tablet_copy_client.cc:538] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:07.926874  2777 tablet_bootstrap.cc:492] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:07.947702  2777 tablet_bootstrap.cc:492] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:07.948562  2777 tablet_bootstrap.cc:492] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:07.949219  2777 ts_tablet_manager.cc:1403] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.001s
I20260709 12:57:07.952041  2777 raft_consensus.cc:359] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:07.952893  2777 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:07.953555  2777 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:07.956050  2777 ts_tablet_manager.cc:1434] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:57:07.957836  1582 tablet_copy_service.cc:342] P 2af567a273d44ca89d2b3b0f7c815bd1: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-6fbeca1b8e9f46c5843a82bafe73b5a8 received from {username='slave'} at 127.0.0.1:53576
I20260709 12:57:07.958235  1582 tablet_copy_service.cc:434] P 2af567a273d44ca89d2b3b0f7c815bd1: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-6fbeca1b8e9f46c5843a82bafe73b5a8 on tablet 6fbeca1b8e9f46c5843a82bafe73b5a8 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:07.988058  2777 ts_tablet_manager.cc:933] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:07.989732  2777 tablet_copy_client.cc:323] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:57:07.991451  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet 997bea07114b4964bbe0c9bc9185a7f4 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:57:07.992038  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet 997bea07114b4964bbe0c9bc9185a7f4 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-997bea07114b4964bbe0c9bc9185a7f4
I20260709 12:57:07.998708  1730 tablet_copy_source_session.cc:215] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:08.002590  2777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997bea07114b4964bbe0c9bc9185a7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:08.015170  2777 tablet_copy_client.cc:806] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:08.015758  2777 tablet_copy_client.cc:670] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:08.021062  2777 tablet_copy_client.cc:538] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:08.028512  2777 tablet_bootstrap.cc:492] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:08.043038  2777 tablet_bootstrap.cc:492] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:08.043819  2777 tablet_bootstrap.cc:492] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:08.044328  2777 ts_tablet_manager.cc:1403] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.004s
I20260709 12:57:08.046160  2777 raft_consensus.cc:359] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:08.047056  2777 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:08.047658  2777 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:08.052368  2777 ts_tablet_manager.cc:1434] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:57:08.054003  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-997bea07114b4964bbe0c9bc9185a7f4 received from {username='slave'} at 127.0.0.1:48852
I20260709 12:57:08.054426  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-997bea07114b4964bbe0c9bc9185a7f4 on tablet 997bea07114b4964bbe0c9bc9185a7f4 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:08.159138  2346 raft_consensus.cc:1217] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:08.212218  2346 raft_consensus.cc:1217] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:08.292052  2346 raft_consensus.cc:1217] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:08.502354  2347 raft_consensus.cc:1217] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:08.690948   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:08.731665  2784 raft_consensus.cc:1064] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:08.733824  2784 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:08.750763  2346 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:08.751246  1642 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:08.752780  2762 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:08.753888  2784 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:08.754807  1718 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:08.757475  2762 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:08.777527  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:08.778240  1713 raft_consensus.cc:606] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Received request to transfer leadership to TS c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:08.789256  2784 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:08.796974  1642 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:08.798926  2762 raft_consensus.cc:1064] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:08.794696  2346 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:08.801226  2762 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:08.814173  1464 catalog_manager.cc:5697] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:08.830256  2346 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:08.830626  1720 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:08.832193  2793 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:08.833117  2759 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:08.846503  2761 raft_consensus.cc:993] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:57:08.847085  2761 raft_consensus.cc:1081] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Signalling peer c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:57:08.848881  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:57:08.849206  2346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:57:08.851096  2346 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:08.851431  2346 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:08.852587  1641 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:08.850164  1642 raft_consensus.cc:606] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:08.873871  2346 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:08.885182  2793 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:57:08.920887  2346 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:08.921253  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50755.7us
W20260709 12:57:08.940778  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 47058.8us
I20260709 12:57:08.944026  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:08.944718  1713 raft_consensus.cc:3055] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:08.944993  1713 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:08.945704  1713 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:08.946830  1713 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:08.960391  2802 raft_consensus.cc:1064] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:08.984256  1713 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:08.990864  2759 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:08.980037  1720 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.019529  2802 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.043164  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:09.047719  2776 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:57:09.053587  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52465.5us
I20260709 12:57:09.061203  2776 raft_consensus.cc:697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:09.062305  2776 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.071620  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:09.073019  1564 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.077435  2348 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:09.079444  1641 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:09.083101  2802 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:09.084348  2348 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.091094  1564 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:09.097114  2801 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:09.095065  1641 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.124679  2665 raft_consensus.cc:1064] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:09.134019  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:48508
I20260709 12:57:09.134604  1564 raft_consensus.cc:606] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:09.144235  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:09.144788  1719 raft_consensus.cc:606] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Received request to transfer leadership to TS c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:09.147401  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:09.147830  1719 raft_consensus.cc:606] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:09.148998   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:57:09.150717   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:09.160988  1468 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:09.153478  2665 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:09.167618  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 99269.2us
I20260709 12:57:09.182868  2349 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:09.182916  1719 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.185020  2761 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:09.182919  1641 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:09.188738  2761 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:09.201629  1713 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:09.207242  2801 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.214993  1641 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.262367  1465 catalog_manager.cc:5697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:09.268663  2717 raft_consensus.cc:993] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:57:09.271579  2717 raft_consensus.cc:1081] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:57:09.273473  1566 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:09.274806  1713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46160
I20260709 12:57:09.275310  1713 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.275633  1713 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.280818  2761 raft_consensus.cc:2955] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.283751  2348 raft_consensus.cc:2955] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.292160  2347 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.300530  1639 raft_consensus.cc:2955] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.302153  1467 catalog_manager.cc:5697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:09.303510  1470 catalog_manager.cc:5697] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:09.282182  1713 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:09.312418  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:09.313033  1641 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:09.313370  1641 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:09.314177  1641 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:09.315464  1641 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.311329  1713 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:09.326625  1719 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.327476  1641 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:09.328848  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:09.329772  2665 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:09.330206  2665 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:09.330938  2665 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:09.333539  2801 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:09.337709  2813 raft_consensus.cc:993] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:57:09.338124  2801 raft_consensus.cc:1081] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:57:09.339994  1646 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:09.347854  2761 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:09.356328  2819 raft_consensus.cc:2955] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.359151  2347 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:09.371522  2822 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:09.381007  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:09.381634  1572 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.381276  1568 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.376999  1641 raft_consensus.cc:2955] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.384402  1719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46170
I20260709 12:57:09.384931  1719 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.385257  1719 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:09.386382  1456 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 5 similar messages]
I20260709 12:57:09.396977  1713 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.400215  2773 raft_consensus.cc:993] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:57:09.402637  1572 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:09.413527  1719 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.414796  2348 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:09.416879  2821 raft_consensus.cc:1081] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Signalling peer 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:57:09.418073  1719 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:09.420372  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:09.420904  1639 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.426152  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:09.426880  2348 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.425813  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:09.433310  1566 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:09.433678  1566 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:09.433171  2797 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:57:09.434479  2348 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:09.435125  1566 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.436926  1566 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.438773  1470 catalog_manager.cc:5697] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.438536  2347 raft_consensus.cc:2955] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.443058  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 997bea07114b4964bbe0c9bc9185a7f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:09.447764  1469 catalog_manager.cc:5697] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 2, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:09.461635  1556 tablet_service.cc:1558] Processing DeleteTablet for tablet 997bea07114b4964bbe0c9bc9185a7f4 with delete_type TABLET_DATA_TOMBSTONED (TS 2af567a273d44ca89d2b3b0f7c815bd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45012
I20260709 12:57:09.463680  1572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:45038
I20260709 12:57:09.464404  1572 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.466017  1572 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.466284  1719 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:09.472018  2809 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:09.467149  1639 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:09.479307  2801 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.483772  1684 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:09.486799  2349 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.488498  2823 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:09.489040  2823 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:09.489964  2823 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.486842  1572 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:09.493000  1572 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:09.494127  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:09.499861  1720 raft_consensus.cc:3055] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:09.500183  1720 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:09.500876  1720 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:09.501715  1564 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:09.501852  1720 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.503113  2776 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:09.510938  1720 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:09.512267  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 39b62689c0094341b01c7263292dd753 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:09.512481  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:09.513098  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:09.513269  2797 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:09.518155  1639 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.518445  2797 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:09.514199  1467 catalog_manager.cc:5697] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.460314  1566 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:09.516896  1719 raft_consensus.cc:2955] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.535326  1639 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:09.526180  1469 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 2, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:09.519433  2797 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:09.538652  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet acc3fcdecc7546fe92075e15e904c331 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2af567a273d44ca89d2b3b0f7c815bd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.549809  2828 tablet_replica.cc:333] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:57:09.572199  2828 raft_consensus.cc:2243] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:09.573248  2828 raft_consensus.cc:2272] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:09.578414  2819 raft_consensus.cc:993] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:57:09.579039  2819 raft_consensus.cc:1081] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Signalling peer c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:57:09.589951  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet 39b62689c0094341b01c7263292dd753 with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59242
I20260709 12:57:09.609386  2349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:57:09.609989  2349 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.610303  2349 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.615540  2833 tablet_replica.cc:333] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:57:09.618362  2833 raft_consensus.cc:2243] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:09.619360  2833 raft_consensus.cc:2272] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:09.620426  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46146
I20260709 12:57:09.620970  1713 raft_consensus.cc:606] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:57:09.622884  1470 catalog_manager.cc:5697] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:09.627295  2828 ts_tablet_manager.cc:1916] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:09.629503  2833 ts_tablet_manager.cc:1916] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:09.637524  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46146
I20260709 12:57:09.638055  1713 raft_consensus.cc:606] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:57:09.641614  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46146
I20260709 12:57:09.642293  1713 raft_consensus.cc:606] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:57:09.639351  2349 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.647249  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:09.647684  1518 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:57:09.648175  1518 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for acc3fcdecc7546fe92075e15e904c331 already in progress
I20260709 12:57:09.648118  1564 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:09.648674  1518 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for acc3fcdecc7546fe92075e15e904c331 already in progress
I20260709 12:57:09.660931  1713 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:09.662971  2349 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:09.664161  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:09.667260  1713 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:09.667572  1713 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:09.668483  1713 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.671149  1713 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:09.680830  2828 ts_tablet_manager.cc:1929] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:57:09.681547  2828 log.cc:1199] T 997bea07114b4964bbe0c9bc9185a7f4 P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/wals/997bea07114b4964bbe0c9bc9185a7f4
I20260709 12:57:09.682056  1713 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:09.666029  2834 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:09.666549  1564 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:09.684366  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:09.684979  1456 catalog_manager.cc:5028] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): tablet 997bea07114b4964bbe0c9bc9185a7f4 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
W20260709 12:57:09.686264  1456 catalog_manager.cc:4755] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): ChangeConfig:REMOVE_PEER RPC failed for tablet acc3fcdecc7546fe92075e15e904c331: Remote error: Service unavailable: leader transfer in progress
I20260709 12:57:09.686740  2834 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:09.687820  2834 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:09.686861  2833 ts_tablet_manager.cc:1929] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:09.695376  2833 log.cc:1199] T 39b62689c0094341b01c7263292dd753 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/39b62689c0094341b01c7263292dd753
I20260709 12:57:09.694617  2834 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.697956  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet 39b62689c0094341b01c7263292dd753 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:09.730630  1469 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:09.764489  1564 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:09.765715  2819 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:09.777765  1641 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:09.779031  2773 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:09.951203  1641 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:09.952839  1564 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:09.952911  2773 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:09.958920  1713 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:09.959468  2773 raft_consensus.cc:993] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:57:09.960515  2349 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:09.964408  2821 raft_consensus.cc:1081] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Signalling peer 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:57:09.972316  2797 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:09.973536  1641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:59258
I20260709 12:57:09.974079  1641 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:09.974424  1641 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:09.993573  2801 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:09.997624  1641 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:10.003866  1713 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:10.005374  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:10.005923  2349 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:10.006366  2813 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:10.014376  2347 raft_consensus.cc:2955] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:10.017710  1641 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:10.017963  2349 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:10.018841  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:10.019618  1713 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:10.019941  1713 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:10.020860  1713 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:10.022217  1713 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:10.025863  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:10.027046  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:10.027575  1568 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:10.028663  1713 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:10.029771  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:10.030556  2711 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:10.030959  2711 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:10.031721  2711 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:10.031810  1469 catalog_manager.cc:5697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 3 to 4, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:10.036572  1568 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:10.039664  1719 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:10.041684  2797 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:10.043195  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fbeca1b8e9f46c5843a82bafe73b5a8 with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59242
I20260709 12:57:10.048717  2833 tablet_replica.cc:333] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:57:10.061759  2833 raft_consensus.cc:2243] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:10.061992  1641 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:10.062637  2833 raft_consensus.cc:2272] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:10.063659  2813 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:10.068766  2833 ts_tablet_manager.cc:1916] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:10.072465  1470 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 3, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 3 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:10.092546  2833 ts_tablet_manager.cc:1929] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:10.093144  2833 log.cc:1199] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/6fbeca1b8e9f46c5843a82bafe73b5a8
I20260709 12:57:10.095309  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet 6fbeca1b8e9f46c5843a82bafe73b5a8 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:10.158825   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:10.234396  1564 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:10.268203  2776 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:57:10.334494  1719 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:10.369239  2776 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:57:10.869627  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 282772us
W20260709 12:57:10.900094  1454 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet acc3fcdecc7546fe92075e15e904c331 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:57:10.952085  1454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52231.7us
W20260709 12:57:11.164376  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 68688.1us
W20260709 12:57:11.234592  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.010s	sys 0.007s
W20260709 12:57:11.247596  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.010s	sys 0.011s
W20260709 12:57:11.261505  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 381621us
I20260709 12:57:11.396297  2711 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:11.384037   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:11.339061  2821 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:11.420190  2856 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:11.446030  2821 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:11.433202  2711 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:11.489948  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.012s	sys 0.011s
I20260709 12:57:11.515002  2711 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:11.516448  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.013s	sys 0.012s
I20260709 12:57:11.389704  2809 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:11.506722  2858 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:11.535647  2850 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:11.562536  2859 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:11.550689  2847 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:11.554478  2862 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:11.575435  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 372742us
I20260709 12:57:11.649477  2773 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:11.639595  2863 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:11.451985  2856 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.664278  2855 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:11.559670  2809 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.758814  2813 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:11.682008  2848 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:11.685873  2801 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:11.649173  2850 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.743753  2821 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:11.635033  2858 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:11.876796  2865 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:11.670799  2847 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.672164  2859 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.946646  2868 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:11.950310  2858 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:11.947095  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.545s	user 0.026s	sys 0.016s
W20260709 12:57:11.960436  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.559s	user 0.029s	sys 0.016s
W20260709 12:57:11.962630  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 1.56257e+06us
I20260709 12:57:11.710722  2863 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.848779  2848 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:11.881712  2857 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:11.811319  2855 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.852231  2801 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.769763  2773 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.000098  2785 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.041607  2872 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:11.985325  2865 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.080304  2872 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.098287  2711 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:12.115239  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 144533us
I20260709 12:57:12.130206  2874 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.121255  2711 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.766019  2862 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.203286  2711 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.203869  2711 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.204398  2711 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:11.905435  2813 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.206466  2864 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.206447  2871 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.207248  2864 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.207298  2871 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.131551  2867 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.227002  1720 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:12.254309  2875 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.255014  2875 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.255705  2862 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:12.208534  2813 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.291776  2711 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.292522  2711 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:12.257714  2315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.011s	sys 0.011s
I20260709 12:57:12.210559  2848 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:12.285898  2876 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.288621  2859 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:12.181298  2785 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.210309  2865 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:12.212390  2773 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:12.290800  2875 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:12.304606  2315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.011s	sys 0.011s
I20260709 12:57:12.029891  2857 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.301789  2847 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:12.257243  2849 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:11.954723  2868 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.296402  2821 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.293152  2711 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.285358  2850 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:12.323261  2853 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.298220  2862 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.197913  2874 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.329157  2830 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.319376  2776 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.332374  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:12.337567  2861 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:12.337960  2866 log.cc:927] Time spent T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.430s	user 0.002s	sys 0.000s
I20260709 12:57:12.311264  2876 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.264190  2867 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.326817  2773 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.593005  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:12.651796  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:12.655483  2711 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.637212  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 225) took 1569 ms. Trace:
I20260709 12:57:12.494665  2854 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:12.653535  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.014s	sys 0.012s
W20260709 12:57:12.497328  1685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.003s	sys 0.013s
I20260709 12:57:12.505380  1641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "523c299f124340818ee040d8a887dba6"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:57:12.656004  1714 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:12.659235  1641 raft_consensus.cc:606] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:57:12.665510  1685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.009s	sys 0.021s
I20260709 12:57:12.319212  2858 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.319401  2813 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:12.653725  2881 log.cc:927] Time spent T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:57:12.322343  2809 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:12.682746  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.015s	sys 0.013s
I20260709 12:57:12.294921  2870 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.401072  2855 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.326658  2865 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.688408  2711 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:12.602834  2863 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.589345  2878 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.577332  2869 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.691424  2830 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.696661  2867 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.698783  2876 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.608908  2868 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.360502  2875 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.641393  2864 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.557027  2872 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:12.453258  2850 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:12.507220  2801 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.656666  1469 rpcz_store.cc:276] 0709 12:57:11.056401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:11.084140 (+ 27739us) service_pool.cc:224] Handling call
0709 12:57:12.624791 (+1540651us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1743,"reported_tablets":1}
I20260709 12:57:12.333756  2856 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.583176  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:12.369822  2849 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.693441  2858 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.453490  2853 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.504312  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:12.711524  2717 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.715190  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:12.656953  2854 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.715968  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:12.717536  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:12.739075  2711 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.687021  2883 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.655287  2773 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.721725  2880 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:12.323269  2882 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.360720  2821 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.339543  2873 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:12.748409  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.004s	sys 0.044s
I20260709 12:57:12.790910  2717 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.691886  2871 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.763986  2845 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.692049  2785 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:12.665660  2776 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.737046  2822 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.734068  2813 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.722637  2809 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.776921  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 27) took 1845 ms. Trace:
I20260709 12:57:12.656530  2861 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.744629  2863 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:12.783231  2850 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.788024  2879 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.819840  2717 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.788898  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:12.789402  1613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.012s	sys 0.019s
I20260709 12:57:12.777478  2864 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.715930  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:12.740677  2857 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.801412  2711 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:12.803542  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.004s	sys 0.044s
I20260709 12:57:12.661538  2862 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.771272  2868 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.786511  2872 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.786332  2801 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.756829  2865 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.791320  2876 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.811069  2773 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:12.786089  2875 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:12.818408  1454 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet acc3fcdecc7546fe92075e15e904c331 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:57:12.806461  2893 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:12.826347  1613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.012s	sys 0.019s
I20260709 12:57:12.812484  1713 rpcz_store.cc:276] 0709 12:57:10.925325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.925545 (+   220us) service_pool.cc:224] Handling call
0709 12:57:10.926996 (+  1451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:11.277628 (+350632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:11.277725 (+    97us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:11.295343 (+ 17618us) log.cc:844] Serialized 26 byte log entry
0709 12:57:11.579949 (+284606us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:11.580098 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:11.581541 (+  1443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:12.770480 (+1188939us) raft_consensus.cc:1685] finished
0709 12:57:12.770506 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:12.770674 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28513,"raft.queue_time_us":105980,"raft.run_cpu_time_us":1817,"raft.run_wall_time_us":37502,"thread_start_us":481767,"threads_started":2,"wal-append.queue_time_us":427511}
I20260709 12:57:12.808338  2873 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.769106  2878 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.771116  2869 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.842221  2861 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.808473  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:12.832973  2872 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.744964  2870 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.843326  2801 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:12.864895  1454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 46601.7us
I20260709 12:57:12.865103  2711 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.821485  2863 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.884918  2711 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.885553  2711 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.886019  2890 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.845007  2868 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.811105  2822 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.864424  2876 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.833384  2857 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:12.817139  2809 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.872519  2821 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:12.871367  2856 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.826435  2864 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.893811  2711 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:12.894966  2717 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:12.900038  2717 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.814725  2882 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.882668  2861 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.891521  1720 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:12.904980  2801 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:12.905542  2878 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:12.816176  2845 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.913316  2854 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.902207  2856 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.899206  2813 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:12.893898  1640 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:12.914139  2801 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.844756  2879 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.939200  2865 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:12.812126  2880 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.814555  2883 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.886772  2890 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.013582  2864 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.014322  2864 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:13.015007  2864 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:12.891458  2888 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:12.916764  2857 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:12.918145  2861 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.122529  2873 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.006700  2830 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.091416  2776 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:12.997823  2801 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.135078  2874 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.145480  2869 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.156741  2830 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:13.157549  2830 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.115473  2809 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.120209  2850 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.116402  2849 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.136560  2862 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:12.881158  2893 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.113907  2888 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.300805  2822 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.160612  2830 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.184584  2875 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.180477  2868 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.304807  2856 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.191679  2876 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:13.306131  2315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.060s	sys 0.092s
W20260709 12:57:13.307407  2315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.061s	sys 0.092s
I20260709 12:57:12.986588  2858 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.312503  2717 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.191432  2863 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:13.313930  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.397s	user 0.024s	sys 0.073s
I20260709 12:57:13.191123  2882 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.314208  2876 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.173017  2845 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:13.322378  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.025s	sys 0.073s
I20260709 12:57:13.303886  2879 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:13.315395  2797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.033s	sys 0.062s
I20260709 12:57:13.165723  2880 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.188927  2870 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.319451  2868 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:13.359854  2876 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.364173  2857 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.184245  2883 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.257885  2888 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.370553  2868 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.383440  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.374187  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:13.378857  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.032s	sys 0.149s
W20260709 12:57:13.384451  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.032s	sys 0.149s
I20260709 12:57:13.384476  1720 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:13.353863  2801 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.321974  2890 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:13.369930  2797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.033s	sys 0.062s
I20260709 12:57:13.387979  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.389599  1720 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:13.575780  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.576529  1647 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:13.577229  2346 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:13.579334  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.579713  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.431665  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.559676  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.581758  1645 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:13.582011  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.581771  2347 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:13.582814  1640 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
W20260709 12:57:13.510603  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.001s	sys 0.012s
W20260709 12:57:13.583863  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.002s	sys 0.016s
I20260709 12:57:13.469949  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:13.589545  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.002s	sys 0.016s
W20260709 12:57:13.590013  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.002s	sys 0.016s
I20260709 12:57:13.590814  2888 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.591535  2888 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.594347  2888 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.595248  2888 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:13.595952  2888 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:13.552744  2312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.028s	sys 0.101s
W20260709 12:57:13.597263  2312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.029s	sys 0.102s
I20260709 12:57:13.598838  2888 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.599133  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.602591  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.603389  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:13.604447  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.059s	sys 0.157s
I20260709 12:57:13.604522  2348 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
W20260709 12:57:13.536764  1685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.037s	sys 0.090s
W20260709 12:57:13.607043  1685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.038s	sys 0.091s
W20260709 12:57:13.604934  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.059s	sys 0.157s
W20260709 12:57:13.607515  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 891447us
I20260709 12:57:13.391985  2868 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.583326  2864 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.607581  2858 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.614863  2858 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.553577  2876 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.395141  2893 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.392547  2861 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.624955  2867 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:13.628551  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.646981  2858 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.649113  1684 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:13.648626  1610 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:13.654142  2856 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.654567  2856 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.655015  2856 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.659392  2850 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:13.659679  2822 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.659940  2850 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.660229  2822 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.662428  2822 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.662693  2850 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.663316  2850 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.663630  1684 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:13.666997  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.667619  1713 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:13.668309  1684 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:13.668439  2858 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.668962  2858 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.669373  2858 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.669436  2852 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.669931  2852 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.670265  2852 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.654459  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.671066  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.662366  2853 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.673843  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.674507  2349 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:13.671711  1720 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:13.678303  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.678746  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.678901  2346 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:13.694391  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.694744  2879 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.694834  2822 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.695294  2879 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.695569  2822 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.705106  2822 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.705771  2822 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.706847  2822 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.707672  2872 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.663676  2850 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.713385  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.713541  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.713923  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.714306  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.714349  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.715039  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.715322  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:13.725835  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.726054  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.726486  1715 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:13.727335  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.718423  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.712370  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.718766  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.669381  1684 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:13.730293  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:13.730373  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 61040.7us
I20260709 12:57:13.730971  1719 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:13.728783  2349 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:13.716544  2879 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.736374  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.737339  2867 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:13.737787  2906 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:13.737895  2867 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.738373  2906 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.740177  2867 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.722626  1641 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:13.741514  2845 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:13.742070  2845 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.720788  2856 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.743424  2858 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.744199  2845 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.744258  2856 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.746022  2822 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.746197  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:13.746742  1537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.028s	sys 0.061s
I20260709 12:57:13.746927  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:13.752099  1537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.028s	sys 0.061s
I20260709 12:57:13.754839  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.755636  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:13.740553  2906 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:13.756556  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.011s	sys 0.035s
W20260709 12:57:13.756964  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.012s	sys 0.035s
I20260709 12:57:13.757336  2868 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.757783  2868 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.758178  2868 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.747304  2858 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:13.749699  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.758713  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:13.754724  1640 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:13.747642  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.751148  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.756634  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:13.766897  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.767638  2314 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:13.751735  2872 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:13.735455  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:13.770884  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:13.751045  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:13.763833  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.764139  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.771710  2853 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:13.769228  2872 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.772256  2853 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.774530  2853 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.774788  2872 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.775480  2861 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:13.776006  2861 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:13.778138  2861 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:13.779237  2864 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.779958  2864 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.722784  2850 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.782014  2906 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.782243  2312 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:13.771852  2903 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.782846  2903 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.783245  2903 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.765462  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.784999  1712 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:13.782403  2906 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.764629  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.792059  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3e979717db64b77b569522980fab6af"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
mode: GRACEFUL
new_leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:48508
I20260709 12:57:13.792309  1715 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:13.792667  1568 raft_consensus.cc:606] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Received request to transfer leadership to TS c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:13.794126  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:13.787081  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:13.795536  2852 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:13.791294  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 55933.5us
I20260709 12:57:13.796777  2893 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.797145  2893 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.797313  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:13.797577  2893 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.797853  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:13.798336  2872 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.798614  2904 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.799289  1684 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:13.799889  2904 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.800329  2904 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:13.751493  2901 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.800712  2904 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.801039  2901 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:13.801448  2901 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.801381  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.802275  1720 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:13.804322  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:13.810413  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:13.808359  2717 raft_consensus.cc:993] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:57:13.770170  2876 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.812346  2717 raft_consensus.cc:1081] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:57:13.780907  2868 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.827260  1566 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:13.800722  2906 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.812572  2822 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.847862  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:13.849747  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.835850  2822 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:14.836153  1569 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:14.836292  2822 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.818909  2858 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:14.894618  2858 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:14.895190  2858 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.862552  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.896015  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 41) took 1034 ms. Trace:
I20260709 12:57:14.896394  1572 rpcz_store.cc:276] 0709 12:57:13.861942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.862097 (+   155us) service_pool.cc:224] Handling call
0709 12:57:14.895955 (+1033858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.897367  2869 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:14.897050  2921 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:14.897667  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.897959  2869 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:14.898416  1572 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:14.898217  2921 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:13.863878  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:13.869963  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.901132  2921 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:14.902041  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1371) took 1032 ms. Trace:
I20260709 12:57:14.902403  1571 rpcz_store.cc:276] 0709 12:57:13.869218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.869402 (+   184us) service_pool.cc:224] Handling call
0709 12:57:14.901980 (+1032578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.903352  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.904004  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1387) took 1028 ms. Trace:
I20260709 12:57:14.904310  1571 rpcz_store.cc:276] 0709 12:57:13.875857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.903132 (+1027275us) service_pool.cc:224] Handling call
0709 12:57:14.903938 (+   806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:13.876560  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:13.889226  2901 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:14.905896  1566 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:14.906448  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 40) took 1047 ms. Trace:
I20260709 12:57:14.906615  1715 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.906821  1566 rpcz_store.cc:276] 0709 12:57:13.858709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.876308 (+ 17599us) service_pool.cc:224] Handling call
0709 12:57:14.906392 (+1030084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.907981  2901 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:14.908046  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:13.891355  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.909001  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1386) took 1033 ms. Trace:
I20260709 12:57:13.884490  2904 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:14.909123  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1009) took 1083 ms. Trace:
I20260709 12:57:14.909524  1566 rpcz_store.cc:276] 0709 12:57:13.875590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.907759 (+1032169us) service_pool.cc:224] Handling call
0709 12:57:14.908938 (+  1179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.909716  1715 rpcz_store.cc:276] 0709 12:57:13.826001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.830009 (+  4008us) service_pool.cc:224] Handling call
0709 12:57:14.871930 (+1041921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:14.907072 (+ 35142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:14.908912 (+  1840us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b54002de954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:14.909073 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79293184}
I20260709 12:57:14.910789  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.911067  2904 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.904402  2905 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:13.905748  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 80709.4us
I20260709 12:57:14.911757  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.911998  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.911857  2905 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:14.912904  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1071) took 1003 ms. Trace:
I20260709 12:57:14.913110  2314 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:14.913321  1566 rpcz_store.cc:276] 0709 12:57:13.910003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.911738 (+1001735us) service_pool.cc:224] Handling call
0709 12:57:14.912845 (+  1107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.913460  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.914268  2905 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:14.914357  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.915006  1566 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:13.911988  2906 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:14.915180  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:13.913266  1537 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45038 dropped due to backpressure: service queue is full with 50 items
I20260709 12:57:13.930095  2913 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:13.934026  2914 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:14.343364  2797 raft_consensus.cc:993] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: : Instructing follower c05ea12435084ad9b281ed3a0a2ecebe to start an election
W20260709 12:57:14.711627  1640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.018s	sys 0.022s
W20260709 12:57:14.918401  1640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.019s	sys 0.023s
I20260709 12:57:14.918401  2797 raft_consensus.cc:1081] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Signalling peer c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:57:14.918216  2914 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:14.918844  2906 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:14.727144  2915 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:14.919616  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.919824  2915 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:14.732470  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.019s	sys 0.071s
W20260709 12:57:14.765722  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.012s	sys 0.028s
W20260709 12:57:14.774013  1612 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.837s (SENT) [suppressed 4 similar messages]
I20260709 12:57:14.780579  2868 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:14.794996  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.923223  2914 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:14.923370  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.915864  1537 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45038 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1067)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1072)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1065)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1064)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1368)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1372)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1373)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1068)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1073)
I20260709 12:57:14.795559  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.924969  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.925469  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.812716  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:14.813575  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:14.927321  2314 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:14.925505  1716 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:14.816568  2852 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:14.817130  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:14.821185  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.821276  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.827549  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:14.831664  2897 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:14.836333  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 37) took 1022 ms. Trace:
I20260709 12:57:14.836670  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 38) took 1002 ms. Trace:
W20260709 12:57:14.842669  2893 consensus_meta.cc:287] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.045s	user 0.024s	sys 0.003s
I20260709 12:57:14.844023  2822 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:14.938215  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1373) took 1068 ms. Trace:
I20260709 12:57:14.938856  1537 rpcz_store.cc:276] 0709 12:57:13.869747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.938152 (+1068405us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:57:14.847447  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08002b5ce0 after lost signal to thread 434
W20260709 12:57:14.848126  2850 consensus_meta.cc:287] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.067s	user 0.006s	sys 0.011s
I20260709 12:57:14.851632  2878 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:14.852875  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:14.856547  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1024) took 1053 ms. Trace:
I20260709 12:57:14.853300  2918 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:14.858073  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:14.858435  2919 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:14.860598  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:14.932425  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:14.860774  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:13.825726  2876 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:14.866075  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.873919  2920 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:14.874145  2347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 285) took 1152 ms. Trace:
I20260709 12:57:14.882105  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.882530  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.883658  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.884231  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:14.884984  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.885488  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.885978  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.886756  2312 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:14.888283  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:13.853022  2903 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:14.948927  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 62278.9us
I20260709 12:57:14.942835  1717 raft_consensus.cc:1240] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.901305  2869 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:13.871534  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:13.872628  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:13.895853  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:14.909072  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1383) took 1034 ms. Trace:
W20260709 12:57:14.947727  1538 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45038 dropped due to backpressure: service queue is full with 50 items
I20260709 12:57:14.915618  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1390) took 1017 ms. Trace:
I20260709 12:57:14.901249  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 42) took 1039 ms. Trace:
I20260709 12:57:14.917234  2883 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.955067  1566 rpcz_store.cc:276] 0709 12:57:13.897985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.914112 (+1016127us) service_pool.cc:224] Handling call
0709 12:57:14.915566 (+  1454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.943468  2342 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:14.943565  2919 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:14.956725  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 39) took 1101 ms. Trace:
I20260709 12:57:14.957048  2342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3e979717db64b77b569522980fab6af"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:59842
I20260709 12:57:14.899739  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:14.926787  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.020s	sys 0.071s
I20260709 12:57:14.926764  2348 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:14.927266  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.814383  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:14.928203  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.012s	sys 0.028s
I20260709 12:57:14.957401  1563 rpcz_store.cc:276] 0709 12:57:13.855046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.856703 (+  1657us) service_pool.cc:224] Handling call
0709 12:57:14.956601 (+1099898us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:14.962373  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.946600  2347 rpcz_store.cc:276] 0709 12:57:13.721652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.721788 (+   136us) service_pool.cc:224] Handling call
0709 12:57:13.728198 (+  6410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:13.749797 (+ 21599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:13.749821 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:13.754841 (+  5020us) log.cc:844] Serialized 52 byte log entry
0709 12:57:14.848742 (+1093901us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b1800192580. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1 00007f6a426efa0f
0709 12:57:14.872862 (+ 24120us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:14.872902 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:14.872992 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:14.873835 (+   843us) raft_consensus.cc:1685] finished
0709 12:57:14.873858 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:14.874064 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21164,"raft.queue_time_us":23206,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":977,"spinlock_wait_cycles":16334592,"thread_start_us":23919,"threads_started":1,"wal-append.queue_time_us":1116984}
I20260709 12:57:14.964452  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:14.965019  2348 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.932402  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:14.932613  2868 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:14.935232  1569 rpcz_store.cc:276] 0709 12:57:13.838205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.838377 (+   172us) service_pool.cc:224] Handling call
0709 12:57:14.836599 (+998222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.845674  2345 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.972234  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:14.972436  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.973196  2343 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.969635  1567 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
W20260709 12:57:14.940630  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800207da0 after lost signal to thread 1504
I20260709 12:57:14.940547  2893 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:14.981818  2344 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.983196  2893 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:14.936798  2897 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:14.983877  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.984596  2901 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:14.985361  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.985239  2901 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:14.986374  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.986541  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.987190  1714 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:14.987686  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.988000  2901 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:14.988129  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.982381  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.989486  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:14.989964  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:14.990958  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.991235  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:14.991629  1639 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:14.992791  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:14.994477  2897 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:14.954679  1538 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45038 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1072)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1065)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1064)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 43)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1368)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1372)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1068)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1082)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1084)
I20260709 12:57:14.991253  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.998934  1643 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:14.942284  2915 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:15.000451  2919 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:15.000555  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.001390  1569 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:15.001579  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:15.002015  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1075) took 1090 ms. Trace:
I20260709 12:57:15.002408  1569 rpcz_store.cc:276] 0709 12:57:13.911352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.000178 (+1088826us) service_pool.cc:224] Handling call
0709 12:57:15.001941 (+  1763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.003481  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.004164  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1378) took 1132 ms. Trace:
I20260709 12:57:15.003854  1684 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.005098  1643 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.006700  2904 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:15.008225  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.010447  2348 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:15.012773  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.012804  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:14.998764  1538 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53576 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1072)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1065)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1064)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 43)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1368)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1372)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1068)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1082)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1084)
I20260709 12:57:15.004603  1569 rpcz_store.cc:276] 0709 12:57:13.873383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.003137 (+1129754us) service_pool.cc:224] Handling call
0709 12:57:15.004118 (+   981us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:14.941355  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 167371us
I20260709 12:57:14.946981  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.023871  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.936378  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.945885  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:14.948220  1537 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45024 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1072)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1065)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1064)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 43)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1368)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1372)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1068)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1082)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1084)
I20260709 12:57:14.947625  1647 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:14.952221  2923 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.060484  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:15.061299  1684 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.061376  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.943118  1644 rpcz_store.cc:276] 0709 12:57:13.803426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.809493 (+  6067us) service_pool.cc:224] Handling call
0709 12:57:14.855656 (+1046163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:14.855925 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:14.855985 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:14.856093 (+   108us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:14.856162 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:14.856261 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:14.856439 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.062340  2901 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.062840  2901 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.062950  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.063078  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.063364  2901 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.064102  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.064534  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.065444  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.065807  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.947113  2858 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.066833  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.067085  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.942178  2850 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.068614  2858 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:15.071750  2850 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:14.948596  1641 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:15.073143  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.074431  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.075071  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.075690  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:14.941962  2822 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:14.946636  2920 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.078655  2901 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.080394  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.082034  2920 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:14.917171  2913 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:14.947378  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.052374  1537 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45038 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1065)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1064)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 46)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1091)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 45)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1089)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 43)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1368)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1372)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1068)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1082)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1084)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 47)
I20260709 12:57:15.083081  1716 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:15.083431  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.084858  2913 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:14.959385  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1382) took 1079 ms. Trace:
I20260709 12:57:14.954232  1568 rpcz_store.cc:276] 0709 12:57:13.874777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.881715 (+  6938us) service_pool.cc:224] Handling call
0709 12:57:14.909010 (+1027295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.960188  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:14.955142  1570 rpcz_store.cc:276] 0709 12:57:13.862328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.863256 (+   928us) service_pool.cc:224] Handling call
0709 12:57:14.901184 (+1037928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.943336  2918 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:14.946116  2876 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.944785  2864 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:14.975400  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:14.975715  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08001ddee0 after lost signal to thread 1596
I20260709 12:57:14.969578  2852 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:14.977866  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.083755  1537 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45038 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1065)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1064)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 46)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1091)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 45)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1089)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 43)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1368)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1372)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1068)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1082)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1084)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 47)
I20260709 12:57:14.942106  2878 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.087642  1717 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:15.087265  2852 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.088485  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:14.974216  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1377) took 1103 ms. Trace:
W20260709 12:57:15.089825  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 129738us
I20260709 12:57:14.979624  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:15.090108  1567 rpcz_store.cc:276] 0709 12:57:13.870973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.871051 (+    78us) service_pool.cc:224] Handling call
0709 12:57:14.974102 (+1103051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.094987  1640 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:15.095424  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.015008  2893 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.015965  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.017372  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.102984  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.103842  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1379) took 1230 ms. Trace:
I20260709 12:57:15.104185  1568 rpcz_store.cc:276] 0709 12:57:13.873681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.096110 (+1222429us) service_pool.cc:224] Handling call
0709 12:57:15.103763 (+  7653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.105813  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1067) took 1197 ms. Trace:
I20260709 12:57:15.106309  1571 rpcz_store.cc:276] 0709 12:57:13.908570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.015477 (+1106907us) service_pool.cc:224] Handling call
0709 12:57:15.105745 (+ 90268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.090788  2878 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.018759  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.016214  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.095932  2864 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:15.020268  2897 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.109054  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1072) took 1198 ms. Trace:
I20260709 12:57:15.109524  1566 rpcz_store.cc:276] 0709 12:57:13.910322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.018463 (+1108141us) service_pool.cc:224] Handling call
0709 12:57:15.109000 (+ 90537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:14.946892  1642 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:15.048847  2343 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:15.100785  1721 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:15.117002  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.046398  1713 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:15.117555  1642 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:15.117817  2918 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.118728  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:15.118984  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:15.113457  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1074) took 1194 ms. Trace:
I20260709 12:57:15.119633  1642 raft_consensus.cc:2393] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:15.057108  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.119834  1567 rpcz_store.cc:276] 0709 12:57:13.911015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.094975 (+1183960us) service_pool.cc:224] Handling call
0709 12:57:15.105045 (+ 10070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.076174  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:15.119261  2852 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:14.935139  1565 rpcz_store.cc:276] 0709 12:57:13.813719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.823960 (+ 10241us) service_pool.cc:224] Handling call
0709 12:57:14.836244 (+1012284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.120999  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.121379  2830 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:15.121091  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 45000.3us
I20260709 12:57:15.121943  2830 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:15.122359  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.122454  2830 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.103075  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.076812  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.129413  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.120966  2344 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.131167  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.123731  2915 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.106793  1563 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:15.115942  2864 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.132612  1715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:37874
W20260709 12:57:15.134104  1610 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52bc0b3e08ea4bd78b344b833b97faed. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:15.084980  1684 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:14.976366  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:15.085201  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:15.136305  2340 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:14.951740  1638 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:15.137954  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.089366  1572 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
W20260709 12:57:15.143184  1572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1066) took 1235 ms (client timeout 1504 ms). Trace:
W20260709 12:57:15.143543  1572 rpcz_store.cc:269] 0709 12:57:13.908243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.899456 (+991213us) service_pool.cc:224] Handling call
0709 12:57:15.142983 (+243527us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54003a07d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:15.143088 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301730560}
I20260709 12:57:15.068320  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.144599  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.145231  1572 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
W20260709 12:57:15.093556  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800177e20 after lost signal to thread 1671
I20260709 12:57:15.145794  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.132635  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1396) took 1230 ms. Trace:
I20260709 12:57:15.145686  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1381) took 1271 ms. Trace:
I20260709 12:57:15.093783  1564 rpcz_store.cc:276] 0709 12:57:13.874521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.895527 (+ 21006us) service_pool.cc:224] Handling call
0709 12:57:14.954331 (+1058804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.084386  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:14.980437  2903 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:14.976059  2342 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:15.087132  1719 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:15.098721  2797 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.095161  2822 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.102188  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.153215  2797 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.153652  2342 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.153827  2797 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.101480  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:15.154873  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53467.8us
I20260709 12:57:15.101972  2893 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:15.019457  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.109647  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.022162  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.018103  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:15.053507  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:15.053061  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 51605.3us
I20260709 12:57:15.159843  2893 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.076443  1720 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:15.069693  1454 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet acc3fcdecc7546fe92075e15e904c331 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:57:15.162000  1454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 92381.5us
I20260709 12:57:15.069900  1712 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.163314  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.123716  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.111466  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.089345  1714 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:15.139760  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.165570  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1385) took 1290 ms. Trace:
I20260709 12:57:15.165913  1570 rpcz_store.cc:276] 0709 12:57:13.875314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.137142 (+1261828us) service_pool.cc:224] Handling call
0709 12:57:15.165513 (+ 28371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920}
I20260709 12:57:15.140107  2915 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.141273  1610 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:15.144479  1643 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:15.147090  1593 debug-util.cc:398] Leaking SignalData structure 0x7b080033cb80 after lost signal to thread 1745
I20260709 12:57:15.149096  2852 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:15.134856  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 49947.9us
I20260709 12:57:15.149377  1716 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:15.146942  1572 rpcz_store.cc:276] 0709 12:57:13.874248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.144398 (+1270150us) service_pool.cc:224] Handling call
0709 12:57:15.145634 (+  1236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.149823  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.179950  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1077) took 1267 ms. Trace:
I20260709 12:57:15.150434  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1399) took 1245 ms. Trace:
I20260709 12:57:15.180413  1568 rpcz_store.cc:276] 0709 12:57:13.905259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.137712 (+1232453us) service_pool.cc:224] Handling call
0709 12:57:15.150392 (+ 12680us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.147948  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.181901  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1065) took 1274 ms. Trace:
I20260709 12:57:15.182179  1566 rpcz_store.cc:276] 0709 12:57:13.907902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.137429 (+1229527us) service_pool.cc:224] Handling call
0709 12:57:15.181837 (+ 44408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.181901  2856 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:15.184171  2845 raft_consensus.cc:3055] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.178498  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.184715  2845 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:15.184913  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.180271  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.156163  2903 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.188207  2916 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.188334  2903 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.188597  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:15.188854  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.189172  1717 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.190829  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.191169  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.191910  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1393) took 1290 ms. Trace:
I20260709 12:57:15.120474  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.146919  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1078) took 1234 ms. Trace:
I20260709 12:57:15.167485  1718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "523c299f124340818ee040d8a887dba6"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46160
I20260709 12:57:15.191140  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.168597  2848 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.194686  2848 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.195266  2848 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.146761  1563 rpcz_store.cc:276] 0709 12:57:13.902627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.016888 (+1114261us) service_pool.cc:224] Handling call
0709 12:57:15.132547 (+115659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.097364  1535 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45024 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1065)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1064)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 46)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1091)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 45)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1089)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 43)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1368)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1372)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1068)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1082)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1084)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 47)
W20260709 12:57:15.172575  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800328d80 after lost signal to thread 2373
I20260709 12:57:15.161345  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.173617  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.174235  2888 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:15.199913  2888 raft_consensus.cc:697] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:15.174685  1714 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:15.200870  2897 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.175041  2915 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.180297  1564 rpcz_store.cc:276] 0709 12:57:13.912048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.149570 (+1237522us) service_pool.cc:224] Handling call
0709 12:57:15.179894 (+ 30324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.133481  1715 raft_consensus.cc:606] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Received request to transfer leadership to TS c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.187750  1640 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.189005  2903 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.202574  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1394) took 1300 ms. Trace:
I20260709 12:57:15.202967  1570 rpcz_store.cc:276] 0709 12:57:13.901836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.166673 (+1264837us) service_pool.cc:224] Handling call
0709 12:57:15.202511 (+ 35838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.159427  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1384) took 1284 ms. Trace:
I20260709 12:57:15.203938  1569 rpcz_store.cc:276] 0709 12:57:13.875026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.016913 (+1141887us) service_pool.cc:224] Handling call
0709 12:57:15.022010 (+  5097us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fe9c 00007f6a3f60fa5b 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:15.159363 (+137353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5918976}
I20260709 12:57:15.192266  1566 rpcz_store.cc:276] 0709 12:57:13.901519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.186913 (+1285394us) service_pool.cc:224] Handling call
0709 12:57:15.191859 (+  4946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.148495  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.189985  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.193361  1718 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:15.213214  1718 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.212765  2845 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.188880  2916 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.214983  2916 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.193843  1565 rpcz_store.cc:276] 0709 12:57:13.912366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.145362 (+1232996us) service_pool.cc:224] Handling call
0709 12:57:15.146836 (+  1474us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:15.197945  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800323800 after lost signal to thread 2882
I20260709 12:57:15.212415  1571 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:15.177652  2852 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.186806  1537 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45038 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1064)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1096)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 46)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1091)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 45)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1100)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1102)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1089)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 43)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1098)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1094)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1095)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1099)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1368)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1372)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1068)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1080)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1082)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1084)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 47)
I20260709 12:57:15.233579  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.234236  1564 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:15.234733  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.235164  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.234742  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1398) took 1329 ms. Trace:
I20260709 12:57:15.235563  1563 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:15.235936  1564 rpcz_store.cc:276] 0709 12:57:13.904914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.233355 (+1328441us) service_pool.cc:224] Handling call
0709 12:57:15.234684 (+  1329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.236567  1568 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:15.237003  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.237157  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1380) took 1363 ms. Trace:
I20260709 12:57:15.230373  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1389) took 1333 ms. Trace:
I20260709 12:57:15.236220  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.238176  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.237847  1571 rpcz_store.cc:276] 0709 12:57:13.896776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.148023 (+1251247us) service_pool.cc:224] Handling call
0709 12:57:15.229076 (+ 81053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.238605  1569 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:15.239112  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1395) took 1337 ms. Trace:
I20260709 12:57:15.239352  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.239447  1569 rpcz_store.cc:276] 0709 12:57:13.902177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.235913 (+1333736us) service_pool.cc:224] Handling call
0709 12:57:15.239049 (+  3136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.239627  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.237207  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.240005  1564 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:15.237546  1568 rpcz_store.cc:276] 0709 12:57:13.873962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.234910 (+1360948us) service_pool.cc:224] Handling call
0709 12:57:15.237101 (+  2191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.241765  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1064) took 1334 ms. Trace:
I20260709 12:57:15.242365  1565 rpcz_store.cc:276] 0709 12:57:13.907555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.236717 (+1329162us) service_pool.cc:224] Handling call
0709 12:57:15.241697 (+  4980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.244479  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1391) took 1346 ms. Trace:
I20260709 12:57:15.244998  1567 rpcz_store.cc:276] 0709 12:57:13.898402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.189598 (+1291196us) service_pool.cc:224] Handling call
0709 12:57:15.244411 (+ 54813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.246008  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.246287  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.248111  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.236526  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1397) took 1333 ms. Trace:
I20260709 12:57:15.250831  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.249194  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.262346  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.264341  1571 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:15.250710  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.265708  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.266175  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1388) took 1390 ms. Trace:
I20260709 12:57:15.266399  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.266654  1570 rpcz_store.cc:276] 0709 12:57:13.876124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.235127 (+1359003us) service_pool.cc:224] Handling call
0709 12:57:15.250508 (+ 15381us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:15.266110 (+ 15602us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15504768}
I20260709 12:57:15.267107  1716 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:15.251626  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.267918  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.253099  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.253201  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.255434  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.267959  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.269374  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.232712  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.270291  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1070) took 1360 ms. Trace:
I20260709 12:57:15.258769  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:15.270614  1572 rpcz_store.cc:276] 0709 12:57:13.909638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.232323 (+1322685us) service_pool.cc:224] Handling call
0709 12:57:15.270237 (+ 37914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.270885  1537 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.258917  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.229265  2852 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.160598  2901 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.272699  2890 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.272909  2717 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.273452  2717 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.273932  2717 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.274091  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.274827  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.274857  1572 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:15.275328  1568 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:15.276053  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.276849  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.276917  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.279067  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.280342  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1367) took 1412 ms. Trace:
I20260709 12:57:15.280771  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.280700  1564 rpcz_store.cc:276] 0709 12:57:13.868085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.279813 (+1411728us) service_pool.cc:224] Handling call
0709 12:57:15.280016 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.280129 (+   113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.280158 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.280186 (+    28us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.280202 (+    16us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.280231 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.280302 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.283047  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.283167  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1368) took 1414 ms. Trace:
I20260709 12:57:15.283715  1564 rpcz_store.cc:276] 0709 12:57:13.868376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.281831 (+1413455us) service_pool.cc:224] Handling call
0709 12:57:15.282396 (+   565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.282613 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.282650 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.282719 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.282765 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.282977 (+   212us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.283111 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.284984  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.286293  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1369) took 1417 ms. Trace:
I20260709 12:57:15.260735  2845 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.286779  1564 rpcz_store.cc:276] 0709 12:57:13.868624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.284954 (+1416330us) service_pool.cc:224] Handling call
0709 12:57:15.285308 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.285519 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.285559 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.285982 (+   423us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.286030 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.286109 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.286234 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.287976  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:15.287009  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1370) took 1418 ms. Trace:
I20260709 12:57:15.288913  1572 rpcz_store.cc:276] 0709 12:57:13.868934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.286236 (+1417302us) service_pool.cc:224] Handling call
0709 12:57:15.286503 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.286665 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.286697 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.286737 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.286770 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.286837 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.286949 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.289623  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1372) took 1420 ms. Trace:
I20260709 12:57:15.289988  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.290187  1564 rpcz_store.cc:276] 0709 12:57:13.869474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.288220 (+1418746us) service_pool.cc:224] Handling call
0709 12:57:15.288962 (+   742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.289185 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.289225 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.289292 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.289338 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.289415 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.289559 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.292371  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.267201  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.293058  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1376) took 1422 ms. Trace:
I20260709 12:57:15.293682  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.290766  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1374) took 1420 ms. Trace:
I20260709 12:57:15.293592  1564 rpcz_store.cc:276] 0709 12:57:13.870685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.291962 (+1421277us) service_pool.cc:224] Handling call
0709 12:57:15.292295 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.292516 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.292557 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.292618 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:15.292754 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.292865 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.292997 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.294463  1572 rpcz_store.cc:276] 0709 12:57:13.870036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.289997 (+1419961us) service_pool.cc:224] Handling call
0709 12:57:15.290255 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.290408 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.290434 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.290472 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.290504 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.290568 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.290696 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.263924  1563 rpcz_store.cc:276] 0709 12:57:13.903004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.234349 (+1331345us) service_pool.cc:224] Handling call
0709 12:57:15.236410 (+  2061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.298645  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1061) took 1392 ms. Trace:
I20260709 12:57:15.299113  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1062) took 1392 ms. Trace:
I20260709 12:57:15.302372  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1063) took 1395 ms. Trace:
I20260709 12:57:15.303210  1565 rpcz_store.cc:276] 0709 12:57:13.907248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.301082 (+1393834us) service_pool.cc:224] Handling call
0709 12:57:15.301599 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.301843 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.301892 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.301967 (+    75us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.302010 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.302111 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.302285 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:15.262449  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 101269us
I20260709 12:57:15.277490  2863 consensus_queue.cc:1059] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:57:15.307190  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.308869  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1058) took 1403 ms. Trace:
I20260709 12:57:15.285825  2853 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.326351  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1375) took 1456 ms. Trace:
I20260709 12:57:15.296672  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1059) took 1390 ms. Trace:
I20260709 12:57:15.314265  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.327045  1572 rpcz_store.cc:276] 0709 12:57:13.905952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.295779 (+1389827us) service_pool.cc:224] Handling call
0709 12:57:15.296137 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.296343 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.296373 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.296422 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:15.296451 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.296515 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.296612 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.326130  1564 rpcz_store.cc:276] 0709 12:57:13.905662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.295347 (+1389685us) service_pool.cc:224] Handling call
0709 12:57:15.308183 (+ 12836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.308407 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.308449 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.308505 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:15.308553 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.308632 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.308801 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.330710  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1073) took 1420 ms. Trace:
I20260709 12:57:15.331132  1564 rpcz_store.cc:276] 0709 12:57:13.910670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.329747 (+1419077us) service_pool.cc:224] Handling call
0709 12:57:15.330101 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.330305 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.330344 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.330397 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.330448 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.330523 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.330639 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.326856  1566 rpcz_store.cc:276] 0709 12:57:13.870370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.291676 (+1421306us) service_pool.cc:224] Handling call
0709 12:57:15.325845 (+ 34169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.326016 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.326050 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.326094 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:15.326127 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.326188 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.326295 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.316391  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.333894  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1069) took 1424 ms. Trace:
I20260709 12:57:15.340095  1572 rpcz_store.cc:276] 0709 12:57:13.909299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.328730 (+1419431us) service_pool.cc:224] Handling call
0709 12:57:15.333306 (+  4576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.333499 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.333534 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.333599 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.333642 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.333718 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.333831 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.292351  2918 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.317592  2801 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.313129  2901 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.321358  2890 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.315748  2856 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.305776  2920 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.339015  2853 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:15.299870  1563 rpcz_store.cc:276] 0709 12:57:13.906867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.297634 (+1390767us) service_pool.cc:224] Handling call
0709 12:57:15.298223 (+   589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.298497 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.298572 (+    75us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.298669 (+    97us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:15.298747 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.298849 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.299030 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.321717  1571 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:15.350337  2879 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.318784  2904 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.325196  2897 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:15.325965  2919 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.350749  2869 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:15.380410  2890 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:15.363384  2801 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.379696  2905 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.385687  2853 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.299309  1567 rpcz_store.cc:276] 0709 12:57:13.906489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.297283 (+1390794us) service_pool.cc:224] Handling call
0709 12:57:15.297749 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.298040 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.298077 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.298161 (+    84us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.298250 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.298371 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.298542 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.307314  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1068) took 1398 ms. Trace:
I20260709 12:57:15.327620  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:15.441923  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 134865us
W20260709 12:57:15.442405  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 128132us
I20260709 12:57:15.382189  2856 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.446879  1568 rpcz_store.cc:276] 0709 12:57:13.908941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.306577 (+1397636us) service_pool.cc:224] Handling call
0709 12:57:15.306851 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.307013 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.307038 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:15.307076 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:15.307109 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.307162 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.307255 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:15.448715  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.380187  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.442961  2897 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.457886  2904 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.459415  2342 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.381709  2914 consensus_queue.cc:1059] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:57:15.381382  2901 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.463315  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:15.438748  2919 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:15.445138  2890 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.385905  2918 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.446715  2801 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:15.466205  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 149909us
I20260709 12:57:15.484236  1537 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.361486  2888 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.387709  2920 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.446926  2869 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:15.449210  2856 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.495095  1537 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:15.463973  2893 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.466723  2904 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.502010  1537 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.483615  2919 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.476879  2923 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.483897  2878 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.520388  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:15.523173  2863 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:15.500018  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 140861us
I20260709 12:57:15.508200  2341 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:15.508599  2904 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:15.527567  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 244550us
I20260709 12:57:15.518141  1718 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:15.535987  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 64883.3us
I20260709 12:57:15.518023  2878 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:15.544571  1718 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.549506  2349 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.552865  2893 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:15.558687  2880 raft_consensus.cc:3055] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.559346  2880 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:15.543149  2878 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:15.583854  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 63562.8us
I20260709 12:57:15.544166  2863 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:15.586930  1537 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.591611  1537 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:15.582990  2880 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.548249  2931 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.583535  2850 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.578619  2930 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.569777  2314 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:15.619983  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 79875.7us
I20260709 12:57:15.597759  2822 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.621621  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.622093  2822 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.622790  2923 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.623024  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.623600  2893 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:15.589434  2858 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:15.616189  2876 consensus_meta.cc:287] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.003s
I20260709 12:57:15.540158  2932 consensus_queue.cc:1059] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:57:15.618574  2930 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:15.623368  2923 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.611948  2717 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.624917  2897 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:15.598986  2931 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.624603  2893 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.624671  2858 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.625001  2850 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.625317  2876 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.640457  2930 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.642108  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.630295  2863 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.644019  2918 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:15.645550  2905 raft_consensus.cc:3055] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.649438  2920 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.599898  2879 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.683326  2850 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.683001  2879 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.611456  2797 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.684864  2346 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.685801  2876 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:15.661522  2931 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:15.664434  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 315491us
I20260709 12:57:15.584765  2869 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.664835  2923 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.680408  2717 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:15.625965  2940 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.678944  2905 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:15.681998  2913 raft_consensus.cc:3055] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.683555  2942 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.690299  1535 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.665390  2342 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.702613  2858 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.674351  2880 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:15.693041  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 70171.3us
I20260709 12:57:15.678138  2901 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:15.675037  2863 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.710467  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:15.710790  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.711896  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.713376  1641 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.698907  2797 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:15.719000  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:15.719975  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 128432us
I20260709 12:57:15.698691  2913 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:15.721925  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.722623  1537 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.694164  2940 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:15.691195  2916 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.715490  2863 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.713433  2932 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.733757  2852 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:15.725431  2848 consensus_meta.cc:287] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.007s
I20260709 12:57:15.740595  1641 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:15.741922  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.745244  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.713256  2941 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:57:15.749302  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.728914  2940 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.726414  2934 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:57:15.737460  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:15.741978  2822 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.761288  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:15.726927  2905 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.762625  2905 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.763396  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.751933  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:15.752525  2932 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.777941  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.746181  2848 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.792237  1643 raft_consensus.cc:3055] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.792632  1643 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:15.793027  2928 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.793712  2928 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:15.794420  2928 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.794469  2876 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.795393  2876 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:15.797351  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:15.793869  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:15.798753  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:15.793460  1643 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.811697  1643 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.775352  2916 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:15.813737  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.795985  2950 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.784916  2942 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:15.809324  2893 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:15.829723  2928 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.832995  2928 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:15.800983  2342 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:15.778682  2890 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:15.846160  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:15.753925  2913 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.857363  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.865435  2852 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:15.866616  2890 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:15.869581  2951 consensus_queue.cc:1059] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
W20260709 12:57:15.870393  2864 consensus_meta.cc:287] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.737s	user 0.014s	sys 0.001s
I20260709 12:57:15.871392  2951 raft_consensus.cc:3055] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.871318  2864 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.874552  2348 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.875016  2864 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:15.871949  2951 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:15.881947  1643 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
W20260709 12:57:15.906695  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 194925us
I20260709 12:57:15.857477  2893 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:57:15.912395  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 166899us
I20260709 12:57:15.911185  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.917601  2914 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.917778  1535 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.918488  2914 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.921144  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.922068  1567 raft_consensus.cc:3055] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:15.922542  1567 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:57:15.930003  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 207439us
I20260709 12:57:15.930600  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:15.930971  1537 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.906672  2913 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.933671  2914 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.936877  2914 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.937400  2914 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.923801  1567 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.941427  1537 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:15.955411  2958 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.957219  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:15.958083  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:15.958609  2944 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.938413  2852 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.963548  2852 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.964098  2852 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.915418  2919 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:15.969810  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:15.970373  1537 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:15.972404  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.963346  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.978688  1686 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:15.938457  2918 consensus_queue.cc:1059] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:57:15.956173  2958 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.953920  2876 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.019693  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:15.961465  1567 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:16.020709  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.020859  1713 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.021027  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.021751  1717 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.026391  1718 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.020401  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:16.028944  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 65679.2us
W20260709 12:57:16.031090  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.038786  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.039544  1566 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:16.040500  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.041098  1566 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:16.037706  2822 raft_consensus.cc:993] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:57:16.041805  1568 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:15.976948  2880 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.960453  2932 consensus_queue.cc:1059] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:57:16.043340  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.044557  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:16.045521  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.046584  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.047351  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.048095  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:16.053992  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.030022  2958 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.056747  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:16.053512  2853 consensus_meta.cc:287] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.592s	user 0.015s	sys 0.001s
I20260709 12:57:15.951272  2950 consensus_queue.cc:1059] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
W20260709 12:57:16.058274  2856 consensus_meta.cc:287] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.549s	user 0.004s	sys 0.008s
W20260709 12:57:16.055807  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 81003.6us
I20260709 12:57:16.053915  2880 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:15.952692  2951 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.059463  2848 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.075358  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.075889  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.076129  1535 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:16.078773  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.074788  1565 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:16.037257  2904 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.082223  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:16.083926  2801 consensus_meta.cc:287] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.008s
I20260709 12:57:16.087402  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:16.070411  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 278207us
I20260709 12:57:16.111256  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.111734  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:16.113088  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:16.091785  2878 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.074504  2901 raft_consensus.cc:1081] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Signalling peer c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:57:16.059237  2879 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:16.056901  2957 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.068423  2920 raft_consensus.cc:3055] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.979542  2893 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.074084  2850 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:16.076735  2944 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.086966  2853 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.108609  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.120482  2797 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.132028  2797 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:16.132118  1568 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:16.096390  2931 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.114895  1686 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.100524  2880 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.138506  2853 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.139075  2938 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.077533  2890 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:16.103892  2951 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.124141  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.128296  2950 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:16.132941  2903 consensus_meta.cc:287] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.930s	user 0.016s	sys 0.019s
I20260709 12:57:16.118464  2858 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.098315  2856 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.116202  2932 raft_consensus.cc:3055] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.147948  2797 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.148918  2932 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:16.149787  2797 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:16.109344  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 163598us
I20260709 12:57:16.119472  2848 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:16.154621  2848 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:16.155308  2848 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.130172  2850 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:16.122252  2888 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.158274  2850 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.136379  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.139858  1570 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.123678  2920 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:57:16.107053  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 77804.6us
I20260709 12:57:16.142509  2919 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:16.142947  2890 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.143033  2950 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:16.131762  2923 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.120968  2801 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.182433  2801 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.184235  1569 raft_consensus.cc:2393] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:16.129455  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:16.185360  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 55995us
I20260709 12:57:16.146476  2903 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:16.147046  2915 consensus_meta.cc:287] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.945s	user 0.011s	sys 0.017s
I20260709 12:57:16.139374  2853 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:16.150450  2932 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.158357  2904 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:16.159804  1686 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.193671  1686 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.195787  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:16.161392  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.197820  2932 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.122967  2863 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.166481  2890 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:16.162784  2954 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:16.164230  2856 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.166115  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1060) took 2259 ms. Trace:
I20260709 12:57:16.176182  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.208977  1570 rpcz_store.cc:276] 0709 12:57:13.906203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.296835 (+1390632us) service_pool.cc:224] Handling call
0709 12:57:15.339818 (+ 42983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:16.159712 (+819894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:16.165810 (+  6098us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54001860d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:16.165989 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839429888}
I20260709 12:57:16.187824  2957 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.166783  2950 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.144219  2879 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.205207  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.220068  1686 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:16.211376  1535 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.230086  1643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:57:16.230738  1643 raft_consensus.cc:606] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Received request to transfer leadership to TS c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:16.231757  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:16.200505  2878 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:16.207379  2901 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.190062  2915 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.193099  2852 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.210467  2858 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:16.209139  2938 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.210793  2340 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.254355  2954 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.249642  2903 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.206954  2853 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:57:16.260536  2858 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:16.254398  2801 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:16.249679  2956 log.cc:927] Time spent T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:57:16.246922  2845 consensus_meta.cc:287] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.951s	user 0.012s	sys 0.016s
I20260709 12:57:16.267611  1643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:57:16.266032  2962 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.268971  2963 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:57:16.256681  2953 ts_tablet_manager.cc:933] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:16.249123  2931 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.278846  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1099) took 1103 ms. Trace:
I20260709 12:57:16.293380  1569 rpcz_store.cc:276] 0709 12:57:15.175037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.282390 (+107353us) service_pool.cc:224] Handling call
0709 12:57:16.278590 (+996200us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400323054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:16.278764 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693470080}
I20260709 12:57:16.280894  2848 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.286180  2852 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:16.252928  2890 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.266716  2879 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.291858  1643 raft_consensus.cc:606] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Received request to transfer leadership to TS c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:16.290766  2858 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.275025  1567 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:16.306619  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.283758  2920 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:16.307298  2930 consensus_meta.cc:287] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.628s	user 0.002s	sys 0.012s
I20260709 12:57:16.303076  2797 raft_consensus.cc:3055] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.288873  2880 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.323342  2797 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:57:16.342206  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.344671  2920 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.328830  2950 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.362334  2903 raft_consensus.cc:993] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: : Instructing follower c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:57:16.359135  2906 consensus_queue.cc:1059] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:57:16.363282  2958 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.337759  2850 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.375578  2915 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.385648  2797 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.386161  2950 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:16.386281  2940 consensus_meta.cc:287] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.625s	user 0.015s	sys 0.000s
I20260709 12:57:16.348212  2863 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.386840   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:57:16.392575  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 181258us
I20260709 12:57:16.356019  2923 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.324934  2930 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:16.390470  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 187920us
W20260709 12:57:16.394017  2830 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.271s	user 0.011s	sys 0.025s
W20260709 12:57:16.394315  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 348659us
I20260709 12:57:16.394253   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:57:16.399370  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 179403us
I20260709 12:57:16.393371  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:16.384498  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.393296  2856 raft_consensus.cc:1081] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Signalling peer c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:57:16.409461  1686 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.414448  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:16.415031  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.416112  1686 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.416747  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:16.419785  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 188137us
I20260709 12:57:16.420579  1684 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:16.421701  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.425325  1535 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:16.439635  2349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:57:16.440191  2349 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:16.440536  2349 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.440953  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:16.441663  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.441382  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.447947  1643 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.452052  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.395623  2940 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.408891  2830 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.413794  2863 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.414661  2797 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.419590  2822 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.418458  2951 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.460122  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.425382  1571 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:16.449159  2913 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:16.471813  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:16.457178  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.423003  2852 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.441339  2918 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:57:16.538921  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 47464.9us
I20260709 12:57:16.449862  2944 consensus_queue.cc:1059] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:57:16.442798  2853 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.456332  2930 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:16.481863  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:16.540899  2340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:59844
I20260709 12:57:16.553653  2913 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:16.552258  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.539397  1647 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.481364  2968 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:57:16.558513  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.489957  2905 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.481446  2893 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:16.547986  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 84543.7us
I20260709 12:57:16.574079  1714 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.560493  2880 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.575970  1713 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:16.555748  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 74083.8us
I20260709 12:57:16.578667  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.573585  2340 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:16.584252  2340 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.586426  2890 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.582741  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:16.582800  2349 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:16.571626  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 101894us
I20260709 12:57:16.574239  2913 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.590508  2349 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.578326  2918 raft_consensus.cc:697] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:16.577459  2905 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:16.579988  2850 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:16.596942  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:16.621483  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.592015  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:16.578333  2953 tablet_copy_client.cc:323] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:57:16.598393  2965 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:16.592469  2801 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:57:16.598969  2918 consensus_queue.cc:237] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.596931  2858 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.605564  2940 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:16.606094  2967 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:57:16.569684  2970 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:57:16.606479  1638 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.606994  2848 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.607301  2830 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:16.607949  2341 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:16.646531  2944 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.646946  2944 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:16.608835  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.609761  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.610270  2880 raft_consensus.cc:3055] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.629395  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.611888  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:16.612304  2914 consensus_meta.cc:287] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.002s
I20260709 12:57:16.610257  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:16.613237  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.641837  2343 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:16.616349  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.617974  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.619310  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.619957  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.658326  2935 raft_consensus.cc:3055] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.658610  1715 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:16.658829  2935 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:16.659257  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.623118  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:16.624295  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.624751  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.656417  1570 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:16.625828  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.630043  2965 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.630442  2845 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.629496  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.581034  2893 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.629547  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:16.628647  1612 leader_election.cc:336] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.557s (SENT)
I20260709 12:57:16.630017  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.629894  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.641819  2971 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:57:16.648823  2905 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.651748  2942 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:57:16.651789  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.622967  2869 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.602557  2340 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.647819  2944 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.650990  2858 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:16.606518  2913 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.670549  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.578908  2958 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.649915  2314 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.654737  2938 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:16.654834  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 64023us
I20260709 12:57:16.653345  2342 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.701110  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:16.674822  1570 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:16.651916  2880 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:16.672145  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:16.719902  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 91302us
I20260709 12:57:16.720763  1570 raft_consensus.cc:3055] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.720906  2830 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.721310  1570 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:16.723093  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:16.668578  2965 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:16.733639  1569 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.735344  1572 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.734684  2869 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:57:16.739212  2971 raft_consensus.cc:3055] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.739950  1563 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:16.740940  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.741673  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.742833  1686 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:16.663012  2914 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.743908  1686 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.739825  2971 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:16.743445  1570 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.725543  2920 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:16.754741  1469 catalog_manager.cc:5697] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 2 to 3, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:57:16.743104  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 103499us
I20260709 12:57:16.749576  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.756207  2920 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.752000  1717 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.757519  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1061) took 1030 ms. Trace:
I20260709 12:57:16.758651  1564 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:16.727488  2876 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.767740  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.769683  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.771468  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.757371  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:16.755857  2913 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:16.758067  1647 rpcz_store.cc:276] 0709 12:57:15.727247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.727418 (+   171us) service_pool.cc:224] Handling call
0709 12:57:15.727650 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:16.574568 (+846918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:16.757235 (+182667us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400096ad4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:16.757439 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866346240}
I20260709 12:57:16.764937  2932 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:16.745296  2869 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.765739  2920 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:16.774727  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.775161  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:16.798322  2942 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:16.798959  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:16.776901  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:16.800489  2876 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.660063  2935 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.730265  2845 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.668684  2970 consensus_queue.cc:1059] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:57:16.785997  1570 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.786614  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.792678  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:16.787510  2893 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:16.800052  2942 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:16.759371  2918 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:16.805285  1535 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:16.867564  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 62348.7us
I20260709 12:57:16.802237  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:16.788810  2965 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:16.828025  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.808009  2830 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:57:16.881965  2965 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:16.882766  2965 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.882848  2830 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.883548  2830 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:16.804044  2797 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:16.885458  2797 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.886045  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.887322  1566 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:16.840472  2914 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.816769  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.888921  1563 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
W20260709 12:57:16.808301  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 51112us
I20260709 12:57:16.846293  2845 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:16.890184  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.891041  2845 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.891644  2845 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:16.891937  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.843549  2340 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:16.792577  2880 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.897444  2845 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.851420  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:16.852820  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.806380  2850 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:16.898422  2869 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:16.901079  2850 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:16.898478  2880 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.901751  2850 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.856055  1645 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.856395  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:16.871877  2932 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:16.872092  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.905928  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:16.906054  2946 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.908145  1645 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.908886  2797 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:16.909049  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 52741us
I20260709 12:57:16.904485  2830 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.805197  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.918329  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.918661  1565 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:16.919255  1567 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
W20260709 12:57:16.919741  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.728561  2938 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.873888  1641 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:16.874581  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:16.874519  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:16.867026  2918 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:16.880916  2920 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:57:16.881508  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.851470  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet 52bc0b3e08ea4bd78b344b833b97faed from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:57:16.848143  2848 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:16.914788  2830 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.894170  1535 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:16.961531  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 67472.3us
I20260709 12:57:16.849630  1647 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:57:16.896739  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 94575us
I20260709 12:57:16.963522  1686 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.900255  1642 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:16.900265  1646 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.964411  1646 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:16.899267  1569 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:16.965937  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.966162  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:16.966580  1569 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:16.967095  2876 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:16.966959  2893 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:16.967711  2876 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:16.968374  2876 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.968139  1646 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:16.969456  1646 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.920598  2845 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.982285  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.963853  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.982972  1564 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.963907  2850 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:16.985496  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.990288  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.990561  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.990335  1686 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.991061  1714 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.991361  1718 raft_consensus.cc:2393] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:16.992223  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:16.992985  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:16.994546  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:16.995751  1715 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:16.991386  1714 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:17.004334  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:17.004504  2349 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.004946  1641 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:17.021298  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.922901  1570 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:16.957055  2936 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.957178  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet 52bc0b3e08ea4bd78b344b833b97faed from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-52bc0b3e08ea4bd78b344b833b97faed
W20260709 12:57:16.936381  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.967733  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:17.022387  1569 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:16.893149  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.968731  2869 consensus_queue.cc:1059] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:16.972134  2968 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.972769  2878 raft_consensus.cc:3055] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.964789  2797 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:16.960783  2918 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.977159  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:16.977432  2893 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:16.978382  2923 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.979044  2938 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:16.920567  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:16.979322  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:16.934963  2848 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:17.046358  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:17.008252  2946 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.048673  1570 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:17.037251  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.051019  1716 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.038744  1646 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:17.054178  1717 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:16.988060  1721 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:17.043035  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:17.052798  2312 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:17.023947  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:17.014400  2914 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.003376  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:16.987713  2876 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.059065  2919 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.034106  2920 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.046890  1686 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.042354  1563 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.036402  2878 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:17.057735  1566 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:17.033574  2968 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:17.042650  2951 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.062526  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.061268  1564 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
W20260709 12:57:17.050151  2963 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 12:57:17.063161  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 59867.6us
I20260709 12:57:17.069199  2965 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.049700  2923 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.068252  1567 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:17.067588  2869 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:17.067523  2848 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.065904  2863 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.048200  2893 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.032068  2880 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:57:17.067232  2850 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:17.080578  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:17.066817  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.072001  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.068549  2938 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:17.083161  2938 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:17.083570  2938 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.084501  1721 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:17.084839  2848 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.070053  2968 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.068548  2901 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.087179  2858 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.064369  2876 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:17.036835  2936 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.066025  2919 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:57:17.096516  1716 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:17.090626  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.091696  2969 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.093004  2914 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:17.093521  2958 consensus_queue.cc:1059] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:57:17.131812  2797 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:17.132030  2923 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:17.133152  1686 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.133438  2852 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:17.139103  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 48596.9us
W20260709 12:57:17.141279  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 88608.5us
I20260709 12:57:17.079835  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 48) took 1306 ms. Trace:
I20260709 12:57:17.145906  1535 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:17.089095  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 109938us
I20260709 12:57:17.147651  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:17.148463  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.151818  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:17.153597  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:17.138331  2969 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:17.157403  1535 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.141997  2970 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.160490  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:17.156208  2880 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.145212  2797 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.162948  2797 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:17.146596  2923 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.173269  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:17.146536  2965 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:17.176956  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:17.172243  1657 tablet_copy_source_session.cc:215] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:17.159112  2876 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:17.159664  2822 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.158993  2890 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.180917  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.181928  1713 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.182178  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.183640  1720 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:17.165834  2958 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.160084  2940 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.185011  1713 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.185515  1719 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:17.186332  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.193692  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:17.177043  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:17.147346  1571 rpcz_store.cc:276] 0709 12:57:15.767635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.775546 (+  7911us) service_pool.cc:224] Handling call
0709 12:57:15.813599 (+ 38053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:16.541014 (+727415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:17.065271 (+524257us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54003124d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:17.073793 (+  8522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1371879808}
I20260709 12:57:17.198228  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:17.199015  1571 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:17.177562  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:17.201293  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:17.201402  2888 consensus_queue.cc:1059] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.210685  2888 raft_consensus.cc:3055] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.211019  2888 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:17.202189  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.202878  2876 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:17.203963  2893 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:17.205209  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:17.206368  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.208705  1569 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:17.215466  2856 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:17.212626  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 55273.4us
I20260709 12:57:17.216078  2951 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:57:17.216777  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.216714  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.217547  2853 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.217787  1686 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.217921  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:17.218696  2853 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.218721  2951 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:17.223266  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.219257  2951 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:17.223981  2951 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.224606  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.224778  2938 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.178944  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:17.225767  1721 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:17.226058  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 60508.3us
I20260709 12:57:17.226675  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.211920  2888 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.227600  2986 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.227716  1721 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:17.228173  2888 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.228914  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.227012  2938 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:17.238669  1572 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.230225  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:17.233973  2853 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:17.241482  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:17.242283  1564 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:17.242720  2856 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:17.243229  2856 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.243330  2876 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.244796  2853 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.248072  2973 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.248484  2973 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:17.236124  2953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bc0b3e08ea4bd78b344b833b97faed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:17.249475  2973 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.252861  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:17.253978  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:17.256544  1564 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.260993  1564 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.263808  1721 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:17.226851  2314 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.264761  2850 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:17.266871  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.267057  2856 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:17.267771  2984 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.207463  2969 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.268975  2984 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:17.269776  2984 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:17.270110  2984 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.270165  2973 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.272265  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:17.273669  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:17.280882  1715 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.270874  2965 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:57:17.283109  2934 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.283478  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:17.294179  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:17.284296  1638 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:17.309834  2830 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.309540  2918 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.309929  2958 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:17.313752  2958 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.315802  2958 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:17.316793  2856 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.319579  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:17.323069  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:17.324602  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:17.325426  2346 raft_consensus.cc:2393] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:17.326514  2856 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.328768  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:17.329944  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:17.330472  2346 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.331701  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:17.335855  1684 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:17.335978  1647 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.336488  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:17.337548  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:17.325827  2888 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:17.310904  2801 raft_consensus.cc:3055] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:17.340142  1639 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.327175  1563 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:17.339207  2946 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.328174  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:17.335326  2848 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:17.358376  1643 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:17.341820  2879 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:17.341310  2888 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:17.338683  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:17.339980  2801 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:17.347890  2934 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.354671  2848 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:17.365222  2888 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.365897  2856 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:17.365258  2876 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:17.369741  2848 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.377086  2314 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.381911  2986 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:17.382586  2986 raft_consensus.cc:697] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:17.386515  1567 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:17.387080  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:17.387867  1571 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:17.388326  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:17.389303  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:17.389744  2893 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:17.383917  2986 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.371982  2992 consensus_queue.cc:1059] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:57:17.391776  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:17.392500  1564 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:17.394152  2985 raft_consensus.cc:3055] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:17.394769  2985 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:17.394037  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:17.392338  2801 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.402794  2801 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.404716  2944 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.403296  1714 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.404421  2951 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.406059  1714 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.409475  1720 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.411181  2951 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:17.397228  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:17.413065  1715 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:17.415006  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:17.403245  2822 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:17.428910  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.407763  1721 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:17.429677  1713 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.432730  2853 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:17.436899  1717 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.436762  1640 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:17.439217  2848 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.398236  2876 raft_consensus.cc:697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:17.449570  1717 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.452682  1717 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:17.461061  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 54570.9us
W20260709 12:57:17.478456  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.485332  1714 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
W20260709 12:57:17.487068  2994 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:57:17.488142  2848 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:17.496160  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:17.497689  2992 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:17.499807  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.505895  2936 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:17.507669  2863 raft_consensus.cc:3055] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.508241  2863 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:17.509243  2863 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.510268  2863 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.512931  2905 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.516258  2992 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:17.502691  2893 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.521478  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:17.524894  2923 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.519200  2992 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.536231  2923 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.515275  2984 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.532521  2888 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.543099  2935 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.551275  2971 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.558252  2893 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.559821  2918 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:17.555613  2971 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.576596  2888 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:17.581727  2968 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.581727  2969 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.549016  2923 consensus_queue.cc:1059] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:57:17.562969  2878 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.547884  2876 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:17.610700  2984 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:17.782291  1566 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
W20260709 12:57:17.784222  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.759347  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1411) took 1138 ms. Trace:
W20260709 12:57:17.775569  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.860361  2342 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.795997  1565 rpcz_store.cc:276] 0709 12:57:16.619231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.624702 (+  5471us) service_pool.cc:224] Handling call
0709 12:57:17.755334 (+1130632us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b5400112e54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:17.757849 (+  2515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148260608}
I20260709 12:57:17.867767  2797 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.842811  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:17.975679  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.614852  2878 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.976948  2965 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.950192  2797 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:17.962988  2890 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:18.050560  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.039680  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.009394  2985 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.082283  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:18.023852  2890 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:18.092906  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.096107  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.095805  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.099130  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.110764  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.121838  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:18.124312  1641 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.125106  1647 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:18.124946  2965 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.136073  1644 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:18.142632  2984 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.144912  2984 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.145218  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:18.147544  2879 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:18.148234  2984 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.149794  1568 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:18.150365  2797 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.154088  2797 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.151093  2863 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:18.156903  2863 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.157420  2863 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.157668  1566 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.158792  1718 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.151716  2852 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.160221  1569 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.160462  2905 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.161190  2880 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:18.160939  2852 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.153110  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:18.168637  1646 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.000s	sys 0.025s
W20260709 12:57:18.169111  1646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.000s	sys 0.025s
I20260709 12:57:18.168800  2905 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.168823  2880 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.171340  2905 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.171401  2852 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:18.172132  2880 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.155050  2797 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.175850  2797 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.177284  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1080) took 1322 ms. Trace:
I20260709 12:57:18.177826  1640 rpcz_store.cc:276] 0709 12:57:16.854931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.871631 (+ 16700us) service_pool.cc:224] Handling call
0709 12:57:18.176721 (+1305090us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400337054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:18.176943 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":744530816}
I20260709 12:57:18.178395  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:18.179355  2343 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.179356  1563 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.180797  2890 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.184130  1571 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:18.174198  1564 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.129587  2965 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:18.191911  2845 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:57:18.195123  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 50409.5us
I20260709 12:57:18.195423  2845 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:18.195974  2845 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:18.196591  1686 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:18.199007  2965 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.188060  1565 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.189049  2936 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.201184  2936 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.204111  2936 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.188292  1571 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.193135  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:18.206641  2863 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.209340  2863 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:18.210616  2953 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.021s
W20260709 12:57:18.212869  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.834362   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:57:18.214756  1568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1410) took 1595 ms (client timeout 1812 ms). Trace:
W20260709 12:57:18.215157  1568 rpcz_store.cc:269] 0709 12:57:16.618973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.619075 (+   102us) service_pool.cc:224] Handling call
0709 12:57:18.214564 (+1595489us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400113d54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:18.214693 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498637696}
I20260709 12:57:18.220091  1467 catalog_manager.cc:5697] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 2, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:18.226646  1643 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:18.228768  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:18.229463  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:18.196604  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.230343  1638 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:18.230705  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:18.231033  1718 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
W20260709 12:57:18.231537  1642 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.012s	sys 0.048s
W20260709 12:57:18.231967  1642 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.012s	sys 0.048s
I20260709 12:57:18.233040  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 231) took 1199 ms. Trace:
I20260709 12:57:18.232944  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:18.233597  1470 rpcz_store.cc:276] 0709 12:57:17.033628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.033780 (+   152us) service_pool.cc:224] Handling call
0709 12:57:17.798236 (+764456us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269e090 00007f6a4273cf3a 00007f6a484f31cc 00007f6a485f137e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:18.232846 (+434610us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152401,"reported_tablets":1,"spinlock_wait_cycles":49190656}
I20260709 12:57:18.234491  2342 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:18.234599  2830 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:18.235369  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:18.230279  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46898 (request call id 129) took 1837 ms. Trace:
W20260709 12:57:18.240396  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.242261  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.242461  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 74298.8us
I20260709 12:57:18.242574  1563 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:18.255117  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:18.255523  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.249266  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:18.257491  1643 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:18.259056  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:18.259774  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:18.260880  1639 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:18.260982  1569 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.239547  1469 rpcz_store.cc:276] 0709 12:57:16.392412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.392599 (+   187us) service_pool.cc:224] Handling call
0709 12:57:18.229974 (+1837375us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:16.809708 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:16.872577 (+ 62869us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:16.872660 (+    83us) write_op.cc:435] Acquired schema lock
0709 12:57:16.872699 (+    39us) tablet.cc:662] Decoding operations
0709 12:57:16.873272 (+   573us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:16.873350 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:16.873415 (+    65us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:16.873698 (+   283us) tablet.cc:701] Row locks acquired
0709 12:57:16.873739 (+    41us) write_op.cc:260] PREPARE: finished
0709 12:57:16.883601 (+  9862us) write_op.cc:270] Start()
0709 12:57:16.883825 (+   224us) write_op.cc:276] Timestamp: P: 1783601836873887 usec, L: 0
0709 12:57:16.883875 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:57:16.885058 (+  1183us) log.cc:844] Serialized 536 byte log entry
0709 12:57:17.186908 (+301850us) op_driver.cc:464] REPLICATION: finished
0709 12:57:17.280779 (+ 93871us) write_op.cc:301] APPLY: starting
0709 12:57:17.299700 (+ 18921us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:17.324479 (+ 24779us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:17.324655 (+   176us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:17.324909 (+   254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:17.328392 (+  3483us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:17.335060 (+  6668us) write_op.cc:312] APPLY: finished
0709 12:57:17.354714 (+ 19654us) log.cc:844] Serialized 23 byte log entry
0709 12:57:17.366472 (+ 11758us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:17.369191 (+  2719us) write_op.cc:454] Released schema lock
0709 12:57:17.369966 (+   775us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:17.437405 (+ 67439us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b1800191140. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a4616aef0 00007f6a4616b489 00007f6a4616d71a
0709 12:57:17.437557 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:17.437598 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12116,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":28668,"apply.run_cpu_time_us":2589,"apply.run_wall_time_us":112896,"num_ops":1,"prepare.queue_time_us":48412,"prepare.run_cpu_time_us":20612,"prepare.run_wall_time_us":245890,"raft.queue_time_us":10768,"raft.run_cpu_time_us":17230,"raft.run_wall_time_us":288843,"replication_time_us":291442,"spinlock_wait_cycles":44104960,"thread_start_us":232527,"threads_started":4,"wal-append.queue_time_us":211773}]]}
I20260709 12:57:18.267298  2936 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:18.267818  2936 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:18.272925  2349 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:18.273177  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.010s	sys 0.042s
W20260709 12:57:18.278110  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.011s	sys 0.042s
I20260709 12:57:18.277089  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.280148  1718 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:18.198480  2845 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.282673  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:18.285357  1646 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:18.272763  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.017s	sys 0.038s
I20260709 12:57:18.288049  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 54) took 1003 ms. Trace:
W20260709 12:57:18.274065  2969 consensus_meta.cc:287] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.626s	user 0.014s	sys 0.021s
I20260709 12:57:18.287091  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:18.292891  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.017s	sys 0.040s
I20260709 12:57:18.297089  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:18.297552  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:18.298061  1563 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:18.289592  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:18.289439  1642 rpcz_store.cc:276] 0709 12:57:17.284981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.285125 (+   144us) service_pool.cc:224] Handling call
0709 12:57:17.323405 (+ 38280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:17.323600 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:18.232783 (+909183us) log.cc:844] Serialized 14 byte log entry
0709 12:57:18.238315 (+  5532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:18.244680 (+  6365us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:18.279634 (+ 34954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:18.284814 (+  5180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:18.287995 (+  3181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":339,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":166,"thread_start_us":904946,"threads_started":1}
I20260709 12:57:18.317842  2348 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:18.314729  2880 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.324132  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.316205  2863 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.332907  1716 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
W20260709 12:57:18.327257  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 991388us
I20260709 12:57:18.339563  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.341099  2863 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.343385  2863 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.344677  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.345515  1712 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:18.320268  2890 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.329402  2880 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.346495  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1068) took 1181 ms. Trace:
I20260709 12:57:18.333679  2845 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.351425  1716 rpcz_store.cc:276] 0709 12:57:17.165024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.165157 (+   133us) service_pool.cc:224] Handling call
0709 12:57:18.337940 (+1172783us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001752d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:18.346426 (+  8486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2620896128}
I20260709 12:57:18.346837  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:18.350746  2984 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.352619  2880 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.364905  1686 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:18.365816  2852 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:18.366146  2965 consensus_queue.cc:1059] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:18.357396  1638 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:57:18.369989  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 1.03347e+06us
I20260709 12:57:18.335572  2936 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.380683  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:18.349349  2953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59844 (request call id 298) took 2528 ms. Trace:
I20260709 12:57:18.365873  3000 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:18.386806  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.371320  3001 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.383769  2342 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:18.371850  2890 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.409476  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.409565  3001 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.410360  1718 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:18.407810  1537 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:18.412817  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.415047  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:18.414266  2797 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.419683  2905 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.419981  2797 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.420259  2905 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.420701  2797 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:18.423358  2971 consensus_meta.cc:287] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.862s	user 0.021s	sys 0.016s
W20260709 12:57:18.428985  2935 consensus_meta.cc:287] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.874s	user 0.012s	sys 0.015s
I20260709 12:57:18.420864  2905 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.447261  1537 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:18.448661  2852 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.453539  2852 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.454286  2879 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:18.454686  2879 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:18.456079  2852 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.403810  2863 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:18.456943  2863 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.457556  2965 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:18.458112  2965 raft_consensus.cc:697] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:18.459442  2863 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.431033  3000 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.459303  2965 consensus_queue.cc:237] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.455705  2879 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.463037  2893 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:57:18.464205  2888 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.463457  1719 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:18.404932  2984 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.466382  1537 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:18.462337  2936 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.464002  3000 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.470803  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:18.467777  2863 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:18.478461  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:18.480795  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.481968  2950 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.482414  2950 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.482785  2950 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.482894  2984 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:18.482151  1718 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:18.464787  2888 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:18.473582  2986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.015s	sys 0.027s
I20260709 12:57:18.486016  2975 raft_consensus.cc:3055] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:18.488093  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 114879us
I20260709 12:57:18.489132  1569 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
W20260709 12:57:18.490190  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 125544us
I20260709 12:57:18.478838  2893 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.480386  2863 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:18.487717  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.027s	sys 0.027s
W20260709 12:57:18.500587  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1540) took 1303 ms (client timeout 1582 ms). Trace:
W20260709 12:57:18.489975  2986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.015s	sys 0.027s
I20260709 12:57:18.501899  2863 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.386504  2953 rpcz_store.cc:276] 0709 12:57:15.801838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.805230 (+  3392us) service_pool.cc:224] Handling call
0709 12:57:16.253705 (+448475us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b58001b4b98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f6101a2 00007f6a48551bb9 00007f6a47682d88 00007f6a47746a07 00007f6a47778f4e 00007f6a4775dfdd 00007f6a4775df89 00007f6a4775df19 00007f6a4775dee1
0709 12:57:16.294753 (+ 41048us) ts_tablet_manager.cc:934] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
0709 12:57:17.211126 (+916373us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:17.502297 (+291171us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:17.504545 (+  2248us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:18.211331 (+706786us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:18.217033 (+  5702us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:18.287786 (+ 70753us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:18.328028 (+ 40242us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10354,"spinlock_wait_cycles":69606656,"tablet-copy.queue_time_us":50916,"thread_start_us":219731,"threads_started":2}
I20260709 12:57:18.489791  2975 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:57:18.510809  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.513446  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.502074  1719 rpcz_store.cc:269] 0709 12:57:17.197256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.201981 (+  4725us) service_pool.cc:224] Handling call
0709 12:57:18.489685 (+1287704us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002df354. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:18.500527 (+ 10842us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2785139072}
W20260709 12:57:18.505905  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.028s	sys 0.028s
I20260709 12:57:18.523510  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:18.519991  1721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.016s	sys 0.043s
I20260709 12:57:18.522143  1716 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:18.551415  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:18.526494  2879 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:18.553335  3003 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:57:18.553894  2953 tablet_copy_client.cc:806] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
W20260709 12:57:18.554572  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 145451us
W20260709 12:57:18.554886  3004 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:57:18.548697  1686 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:18.506260  3001 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.558133  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.546273  2890 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.547839  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:18.576576  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:18.583835  1712 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.572506  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:18.585713  1720 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:18.586702  2935 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.587239  2935 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.588922  1642 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:18.589495  2935 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.521245  2893 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.589989  3001 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:18.590586  3001 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.591746  2893 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:18.593727  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.574676  1721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.017s	sys 0.044s
I20260709 12:57:18.571331  2971 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.585740  2343 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:18.605075  2346 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:18.600297  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.608834  2953 tablet_copy_client.cc:670] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:18.612980  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:18.615504  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53706.5us
I20260709 12:57:18.601624  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:18.608129  2797 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.625905  3018 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:18.626899  3018 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.602916  2971 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.629273  2971 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.629698  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:18.630251  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:18.574728  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 1.05115e+06us
W20260709 12:57:18.632076  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 62206.5us
I20260709 12:57:18.635013  3024 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:18.635578  3026 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:18.635672  3024 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.636924  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:18.638562  3024 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.639359  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.640319  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.640574  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:18.641165  1720 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:18.641528  2878 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.641945  2878 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.642316  2878 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.642537  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:18.644634  3005 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:18.645056  3005 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:18.645434  3005 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.631636  3000 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:18.647135  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.662879  1535 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:18.657280  2985 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.650324  2890 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.648599  3018 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.679893  3024 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:18.693413  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.655953  1563 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
W20260709 12:57:18.698093  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.704244  2890 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:18.704775  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.705611  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:18.706423  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 74499us
I20260709 12:57:18.706525  3018 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.706971  2890 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.707077  3018 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.707796  2893 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.707592  2890 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.708216  2893 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.710937  2893 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.710754  2975 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.709260  2953 tablet_copy_client.cc:538] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:18.716008  2888 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.678411  3013 raft_consensus.cc:476] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Not starting pre-election -- already a leader
W20260709 12:57:18.709527  2968 consensus_meta.cc:287] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.123s	user 0.012s	sys 0.018s
I20260709 12:57:18.709295  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1532) took 1514 ms. Trace:
W20260709 12:57:18.710124  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 117523us
I20260709 12:57:18.725701  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:57:18.732961  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.791147  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 176533us
I20260709 12:57:18.793112  1684 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:18.708451  3001 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:18.798517  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.790763  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 146994us
W20260709 12:57:18.761369  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.799837  1570 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:18.810770  2346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 329) took 1382 ms. Trace:
I20260709 12:57:18.800127  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:18.800244  2923 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.761139  2893 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.800879  2845 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:18.697028  3026 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:18.717433  2797 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.821426  2346 rpcz_store.cc:276] 0709 12:57:17.428839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.429023 (+   184us) service_pool.cc:224] Handling call
0709 12:57:17.429384 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:18.605558 (+1176174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:18.810448 (+204890us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54004cbdd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:18.810684 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2675733248}
I20260709 12:57:18.828514  2344 raft_consensus.cc:2368] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:18.829427  2893 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:18.829200  3026 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:18.805327  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 79723.6us
I20260709 12:57:18.826226  2845 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.830524  2845 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.830602  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:18.723966  2880 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.721240  2975 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.732376  2863 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.716612  2950 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.725137  1721 rpcz_store.cc:276] 0709 12:57:17.194528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.431790 (+237262us) service_pool.cc:224] Handling call
0709 12:57:17.432620 (+   830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:17.440772 (+  8152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:17.440824 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:17.480747 (+ 39923us) log.cc:844] Serialized 506 byte log entry
0709 12:57:18.629288 (+1148541us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:18.629370 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:18.629497 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:18.709015 (+ 79518us) raft_consensus.cc:1685] finished
0709 12:57:18.709041 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:18.709175 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1109965,"threads_started":1,"wal-append.queue_time_us":976213}
I20260709 12:57:18.808599  3005 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.850028  3027 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.850607  3027 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.851576  3005 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.805230  3024 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.852972  2890 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.853528  2890 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.854015  3024 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.741861  2971 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.729226  3018 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.726840  2934 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:18.855198  2934 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:18.855473  2890 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.856209  2971 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:18.809538  3028 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.813074  1610 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:18.857256  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 44295.9us
I20260709 12:57:18.857103  3028 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.857451  2963 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.825965  2923 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.804981  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:18.732339  2992 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:18.825644  1570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1125) took 1674 ms (client timeout 2174 ms). Trace:
I20260709 12:57:18.804726  2968 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.834873  2880 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.732070  2905 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.841166  2863 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.841601  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:18.842036  3001 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:18.842592  2950 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.814248  3032 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.846074  2888 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:18.865870  2941 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:18.856178  2934 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.867723  3028 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:18.859381  2935 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.889503  2935 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.741789  2878 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:18.868698  1570 rpcz_store.cc:269] 0709 12:57:17.151460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.151575 (+   115us) service_pool.cc:224] Handling call
0709 12:57:18.825376 (+1673801us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400132c54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:18.825581 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3619326720}
I20260709 12:57:18.870754  1686 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:18.897135  3028 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.897596  2878 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:18.897598  3028 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.898880  3028 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:18.872411  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 209773us
W20260709 12:57:18.875025  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.875692  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:18.900089  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 107119us
I20260709 12:57:18.880000  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:18.881014  2968 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.881325  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:18.878816  3032 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.875505  3001 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.881840  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.881958  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.882201  1571 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:18.878942  1638 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.840442  2845 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.885331  2314 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:18.886039  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:18.879015  2941 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.887239  2923 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.858740  3027 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.893199  2935 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.894450  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.926729  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:18.927000  1715 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:18.927359  1571 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.894857  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.927623  1686 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:18.928129  1713 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:18.895376  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.833360  2953 tablet_bootstrap.cc:492] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:18.929123  2971 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:18.900485  1720 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:18.929698  2971 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:18.930781  2971 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.873853  2992 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.879277  2965 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:18.900964  1719 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.900926  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:18.913831  1716 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:18.902257  1610 leader_election.cc:400] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:18.944443  1610 leader_election.cc:403] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:57:18.915460  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 67744.6us
I20260709 12:57:18.907549  3001 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.945006  2965 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:18.945084  3027 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.945807  3027 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.919559  1718 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:57:18.919832  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.907987  2878 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.922905  2941 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.924149  2950 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:18.959408  2863 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.959486  2950 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.960502  2863 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.961967  2950 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.915001  1721 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:18.924178  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:18.963626  2863 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.925308  2845 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.925258  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:18.965063  1563 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:18.965286  1684 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:18.925550  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:18.966725  1570 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:18.967857  2969 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.969098  2969 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:18.970569  3001 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.971390  2969 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:18.972308  2969 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:18.972764  2878 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.973320  2969 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.973958  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.974946  1721 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:18.975829  2878 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.926081  3034 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.920073  1712 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:18.903172  2968 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.922849  3032 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.932828  3033 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:18.933142  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:18.979188  1642 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.979497  1720 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.956373  1719 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:18.933897  1565 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:18.934665  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 64656.6us
I20260709 12:57:18.935491  2992 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.935987  2923 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.931759  2905 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:18.938303  1638 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:18.940748  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:18.941788  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:18.947166  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 46326us
I20260709 12:57:18.946127  2965 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:18.943089  3028 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.950624  1571 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:18.951757   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:18.949443  3027 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:18.957715  3026 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:18.958634  1537 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:18.950227  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 48163.9us
I20260709 12:57:18.977660  2845 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.989691  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:18.989612  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:18.979178  3033 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:18.991209  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:18.988888  1714 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.002297  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.008024  2971 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.008296  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.008476  2975 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.008977  2975 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.008258  3033 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.009476  2975 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.976662  3034 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.009776  1535 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:19.010962  2845 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.013161  2845 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.013790  2905 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:19.003800  2314 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.014703  2923 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.014647  1720 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.015223  2923 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:19.004467  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.015691  2923 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.015779  3038 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:19.015564  2992 consensus_queue.cc:1059] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:19.009807  3033 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.018121  3033 raft_consensus.cc:697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:19.019366  3033 consensus_queue.cc:237] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.018139  2992 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:19.021185  3027 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.021350  2941 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.021965  3027 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.022432  3034 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.022482  3027 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.023954  2941 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.024689  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:19.025002  1713 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:19.025609  2985 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.026125  2985 raft_consensus.cc:697] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:18.997567  1718 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.026894  3026 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.021308  2992 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:19.026788  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:19.028743  2905 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:19.024974  1537 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.045332  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.046144  1537 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.029237  3032 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:19.027061  2985 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.029248  3027 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.024673  1646 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:19.033407  1571 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:18.984575  3001 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.003324  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.008589  2971 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.041112  1714 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:19.050037  1470 catalog_manager.cc:5697] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 1 to 2, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:19.070012  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:19.054039  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 58595.6us
I20260709 12:57:19.055560  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.060868  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.077009  2905 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.077901  1712 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:19.061112  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.078927  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.079071  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.079161  2348 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:19.079603  1568 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:19.068583  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.062175  2935 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.056286  2968 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:19.064803  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.031471  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.066690  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.066903  3032 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:19.066762  2992 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.113415  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.114092  1645 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.116371  1645 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:19.067734  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.119108  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:19.067919  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.119724  2346 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.119655  2975 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.120389  1642 raft_consensus.cc:2393] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:19.121116  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.121294  3034 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.121943  3034 raft_consensus.cc:697] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:19.122179  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:19.122820  2340 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.123101  3034 consensus_queue.cc:237] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.068300  3027 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.124382  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.068537  3028 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.057806  2863 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.124825  3027 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.125191  2863 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:19.119786  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52125.8us
I20260709 12:57:19.125736  2863 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.126461  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.126735  2963 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.127336  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.069140  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:19.128810  1565 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:19.128860  3018 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.076687  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.086190  3026 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.129606  3018 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.077107  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:19.130242  3018 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.077224  1643 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.131385  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.131704  2971 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.132153  1643 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:19.132723  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.132952  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.133505  1643 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.133379  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.133992  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.134260  1638 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.134472  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.134797  1640 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:19.135116  1643 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.136004  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.080734  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.077124  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:19.130242  3026 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.083837  3038 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:57:19.084193  1718 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:19.140007  3038 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:19.087324  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.141461  2953 tablet_bootstrap.cc:700] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Time spent opening tablet: real 0.198s	user 0.001s	sys 0.001s
W20260709 12:57:19.092840  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.100888  1647 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.076373  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.101665  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.085386  2880 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.103268  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58424 (request call id 228) took 2169 ms. Trace:
I20260709 12:57:19.145860  1570 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:19.145629  2880 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.067579  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.109700  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.147480  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.110893  2935 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.068765  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.141072  3038 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:19.144989  2343 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:19.057508  2878 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.147548  3032 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:57:19.149138  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.130147  1639 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.085126  2950 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.116961  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.151011  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.144906  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:19.177124  1569 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:19.147568  1713 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:19.128382  1537 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.153680  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.178946  1647 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:19.153972  2349 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:19.154165  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.129480  2890 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.180536  2890 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:19.158247  2935 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.158522  1712 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:19.158928  2992 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.181849  2890 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.159139  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.152247  1469 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 2, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:57:19.189739  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 61407us
I20260709 12:57:19.135592  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.177888  1641 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.155414  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.085006  2968 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.161041  2975 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:19.161396  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.161350  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:19.162029  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.196202  1719 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:19.162282  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.109612  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:19.197510  2950 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.203763  2971 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:19.164275  3023 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.204792  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:19.204558  2971 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.204978  3023 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.197376  3026 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.200309  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.175222  2346 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.125332  3027 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.190480  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.211566  1642 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:19.173446  2965 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.190084  1535 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.198984  1714 raft_consensus.cc:2368] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3.
I20260709 12:57:19.197230  3028 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:19.209913  1572 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:19.214957  1720 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.192420  1469 catalog_manager.cc:5697] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 2, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:19.206997  3000 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:19.213513  2878 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.225639  3037 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.225798  1566 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:19.226200  3037 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.227278  2878 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.218034  1640 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.199606  2797 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.197558  2968 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:19.216996  1469 catalog_manager.cc:5697] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 2, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:19.207599  3024 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.237717  3037 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.238402  2965 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.239344  2340 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.240952  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.246333  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:19.246904  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.191361  2923 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.255055  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.255596  1642 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.218084  2950 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.245707  1469 catalog_manager.cc:5697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:19.217540  2852 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.207028  3023 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.261669  1638 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.261554  2852 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.262373  2878 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:19.263010  2878 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:19.263933  2852 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.266882  2923 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.249329  2341 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.267542  2923 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.268018  2923 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.268823  3017 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:57:19.269532  3024 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:19.220052  3026 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.247440  3000 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.273778  3026 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.252418  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.252301  2346 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
W20260709 12:57:19.253405  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:19.249938  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 105143us
I20260709 12:57:19.237775  2880 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.216111  2985 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:57:19.306877  1639 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:19.145547  1467 rpcz_store.cc:276] 0709 12:57:16.889656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.897052 (+  7396us) service_pool.cc:224] Handling call
0709 12:57:17.389989 (+492937us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269e090 00007f6a4273cf3a 00007f6a484f31cc 00007f6a485f137e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:19.058950 (+1668961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:18.501257 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:18.590665 (+ 89408us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:18.590723 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:57:18.590739 (+    16us) tablet.cc:662] Decoding operations
0709 12:57:18.591153 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:18.591251 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:18.591278 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:18.591624 (+   346us) tablet.cc:701] Row locks acquired
0709 12:57:18.591674 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:57:18.591828 (+   154us) write_op.cc:270] Start()
0709 12:57:18.591968 (+   140us) write_op.cc:276] Timestamp: P: 1783601838591762 usec, L: 0
0709 12:57:18.591998 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:57:18.592755 (+   757us) log.cc:844] Serialized 536 byte log entry
0709 12:57:18.898702 (+305947us) op_driver.cc:464] REPLICATION: finished
0709 12:57:18.942437 (+ 43735us) write_op.cc:301] APPLY: starting
0709 12:57:18.942550 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:18.942706 (+   156us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:18.942899 (+   193us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:18.943271 (+   372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:18.943571 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:18.943653 (+    82us) write_op.cc:312] APPLY: finished
0709 12:57:19.031243 (+ 87590us) log.cc:844] Serialized 23 byte log entry
0709 12:57:19.032092 (+   849us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:19.032173 (+    81us) write_op.cc:454] Released schema lock
0709 12:57:19.032231 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:19.032664 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:19.032699 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":826507,"reported_tablets":2,"spinlock_wait_cycles":363045760,"child_traces":[["op",{"apply.queue_time_us":25007,"apply.run_cpu_time_us":2647,"apply.run_wall_time_us":90199,"num_ops":1,"prepare.queue_time_us":251558,"prepare.run_cpu_time_us":11564,"prepare.run_wall_time_us":158604,"raft.queue_time_us":188384,"raft.run_cpu_time_us":6188,"raft.run_wall_time_us":15168,"replication_time_us":306541,"thread_start_us":439583,"threads_started":4,"wal-append.queue_time_us":108070}]]}
I20260709 12:57:19.251576  3038 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.305030  1469 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:19.248133  2971 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.315632  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:19.315829  1641 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:19.316237  1572 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:19.317164  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.261739  2975 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.294900  2905 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.320971  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.321614  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.322028  1569 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:19.322063  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.322772  1639 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.307523  2935 raft_consensus.cc:2764] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:57:19.325265  1570 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:19.314000  2797 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:19.257967  3028 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:19.308077  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 64862.3us
I20260709 12:57:19.335098  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.333160  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.336694  1639 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:19.337687  2923 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.338918  1643 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:19.266884  2863 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.341346  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.345007  1645 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:19.346750  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.347561  1639 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:19.349005  2878 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.349794  3026 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.350674  2797 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.354847  2968 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.356169  2968 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.357043  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:19.357242  2971 consensus_queue.cc:1059] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:19.357872  2341 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.358696  2923 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:19.361510  2888 consensus_queue.cc:1059] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:19.362742  2888 raft_consensus.cc:3055] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:19.362645  2934 consensus_queue.cc:1059] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:19.363191  2888 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:19.362545  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:19.348091  1684 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.331908  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.339001  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.371641  1641 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.371894  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.377065  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.329838  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.389741  1571 raft_consensus.cc:2368] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:19.379865  3028 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.384253  1569 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:19.334584  2975 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.338053  3048 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.339869  2905 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.385146  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:19.364210  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:19.398696  3000 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.387043  2863 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.387835  2878 raft_consensus.cc:3055] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:19.390121  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.379909  2963 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:19.417695  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.381239  2934 raft_consensus.cc:3055] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:19.397997  3018 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.398015  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:19.399916  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 156239us
I20260709 12:57:19.450647  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:19.401572  1640 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:19.421636  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.385854  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.396603  2941 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:19.405067  2968 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.441648  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.451977  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:19.455447  1569 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:19.455632  1535 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:19.436957  3028 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.436810  2878 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:19.461328  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.463117  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:19.420585  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 72726.1us
I20260709 12:57:19.465152  1569 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:19.449791  2934 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:19.471132  1535 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:19.439476  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 54415us
I20260709 12:57:19.436826  2936 consensus_queue.cc:1059] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:57:19.480813  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.455592  2863 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.479090  1535 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.485394  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:19.481550  1642 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:19.463104  3034 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.483835  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.487576  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.482796  2971 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:19.488801  3050 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:19.493077  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.498533  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:19.472549  2830 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:19.499993  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 102043us
I20260709 12:57:19.502390  1535 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:19.476956  2941 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:19.462658  2968 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.511708  1535 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:19.489542  3034 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.503368  2830 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.514137  3052 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:19.514230  2950 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.518222  3051 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.511965  3049 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.514634  2934 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:19.519084  3025 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:57:19.520676  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:19.523187  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.523582  3037 consensus_queue.cc:1059] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:19.509744  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.469105  2888 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.500157  2797 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.538141  2923 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.538604  2888 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.539247  3032 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.540700  3032 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.524573  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.526536  2890 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.497287  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.513935  1684 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:19.529995  2830 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.500721  3026 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.497601  3050 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.541790  1568 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:19.506980  2880 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.528196  3034 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.563714  3038 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.567085  2341 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:19.567978  3017 raft_consensus.cc:2764] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:57:19.528400  1572 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:19.546038  2975 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.546497  3028 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.546854  2986 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:57:19.547988  3001 raft_consensus.cc:3055] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:19.526965  3033 consensus_queue.cc:1059] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:57:19.548712  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.578543  1564 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:19.549758  1644 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:19.538177  2344 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.533792  2950 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.579493  2950 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.579890  1537 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.580948  3049 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.581319  3049 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.581667  3049 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.551411  1684 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:19.554042  1570 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.554184  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:19.554853  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.555552  1612 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:19.530525  3052 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.548257  2941 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.557842  2880 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.559902  2965 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.514750  2971 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.543116  2890 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.548492  2905 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.542981  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.576766  1642 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:19.560676  3050 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:19.548759  2878 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.576740  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.619202  1570 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:19.690972  1716 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:19.681851  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.686439  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:19.668035  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.692724  2963 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.682739  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.692790  1713 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:19.669781  2950 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:19.694253  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 139124us
I20260709 12:57:19.683275  3033 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:19.577930  3001 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:19.684652  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:19.693296  1718 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.685098  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.587682  2934 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:19.671156  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 136456us
I20260709 12:57:19.629165  3014 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.686496  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:19.713238  1719 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:19.586115  3028 raft_consensus.cc:697] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:19.705021  1647 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:19.704488  1714 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.674790  2971 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.697182  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:19.711400  2992 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:57:19.717335  3028 consensus_queue.cc:237] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.718461  2992 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:19.673528  2797 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.721995  1565 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:19.676354  3034 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.660135  3018 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.695706  3027 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.708531  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:19.709481  2968 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.631690  2863 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.706033  2923 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:19.695379  3033 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.591643  2880 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.674821  3037 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.589617  3052 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:19.694294  1712 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.686080  1721 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:19.693655  2963 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.716004  2950 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.660570  3048 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:19.729511  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:19.618234  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 66881.1us
W20260709 12:57:19.790866  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.791292  1684 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:19.617427  2890 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.709599  2969 raft_consensus.cc:3055] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:19.733724  1719 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:19.724927  2878 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.731117  3062 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:19.624433  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:19.743592  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:19.805971  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.656550  1563 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:19.808789  3062 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.810885  1570 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.811125  3062 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.739272  2923 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:19.724944  3034 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.799459  3001 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.804270  3057 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:19.792824  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 84360.6us
I20260709 12:57:19.818041  1537 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:19.821235  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:19.775619  3014 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:19.761152  2975 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:19.818385  2923 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.823201  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.823833  2878 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.824018  1564 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:19.824333  2878 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.824782  2878 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.825101  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:19.825881  1565 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:19.826927  3026 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.827754  2950 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:19.828794  2863 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.829278  2863 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.829700  2863 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.829824  1646 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.832216  1535 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:19.833688  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:19.838653  1535 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:19.834288  3053 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.247s	user 0.006s	sys 0.002s
W20260709 12:57:19.837297  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.800846  2969 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:19.845145  3001 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.845315  3060 raft_consensus.cc:3055] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:19.811020  3049 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.846882  3051 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.847103  3027 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.848183  3014 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.849169  2975 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.903949  1570 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:19.850473  2963 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.852788  2341 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.853302  2950 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:19.854650  2878 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.863300  3026 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.852788  2863 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.869257  2342 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:57:19.880900  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.894289  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:19.890059  3048 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:19.882951  3060 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:19.911302  1639 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.883173  3038 consensus_queue.cc:1059] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:57:19.873008  3017 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:57:19.908298  2950 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.912849  3026 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.947460  2863 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:19.949975  2975 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.951345  3060 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:19.953266  3060 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.956174  2878 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:19.956516  2340 raft_consensus.cc:2410] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:19.958279  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46898 (request call id 130) took 1221 ms. Trace:
I20260709 12:57:19.958657  1469 rpcz_store.cc:276] 0709 12:57:18.737494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:18.737679 (+   185us) service_pool.cc:224] Handling call
0709 12:57:19.958212 (+1220533us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:19.334715 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:19.361292 (+ 26577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:19.361326 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:57:19.361338 (+    12us) tablet.cc:662] Decoding operations
0709 12:57:19.362199 (+   861us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:19.362279 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:19.362335 (+    56us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:57:19.362957 (+   622us) tablet.cc:701] Row locks acquired
0709 12:57:19.362973 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:57:19.363137 (+   164us) write_op.cc:270] Start()
0709 12:57:19.363272 (+   135us) write_op.cc:276] Timestamp: P: 1783601839363087 usec, L: 0
0709 12:57:19.363293 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:57:19.396980 (+ 33687us) log.cc:844] Serialized 2069 byte log entry
0709 12:57:19.539942 (+142962us) op_driver.cc:464] REPLICATION: finished
0709 12:57:19.540701 (+   759us) write_op.cc:301] APPLY: starting
0709 12:57:19.540804 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:19.541012 (+   208us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:19.541162 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:19.613891 (+ 72729us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:19.614123 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:57:19.614184 (+    61us) write_op.cc:312] APPLY: finished
0709 12:57:19.614469 (+   285us) log.cc:844] Serialized 47 byte log entry
0709 12:57:19.614678 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:19.614809 (+   131us) write_op.cc:454] Released schema lock
0709 12:57:19.614856 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:19.615192 (+   336us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:19.615224 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":399,"apply.run_cpu_time_us":3079,"apply.run_wall_time_us":74491,"num_ops":5,"prepare.queue_time_us":8169,"prepare.run_cpu_time_us":3994,"prepare.run_wall_time_us":67649,"replication_time_us":176442}]]}
I20260709 12:57:19.966320  1716 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:19.970258  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:19.961473  3063 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:57:19.971086  1716 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:19.923381  3048 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:19.938719  2950 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:19.972302  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:19.977388  1719 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.974640  2346 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:19.974993  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.978685  1641 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.975214  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.980175  1646 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:19.962103  3026 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.976001  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:19.924240  2923 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:19.987463  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:19.994231  1639 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.004513  1639 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:19.980998  2344 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:19.983430  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:20.023568  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:19.996258  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:20.030103  1718 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:20.024360  1719 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.005225  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:20.033787  1537 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:20.034582  1638 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.050209  1713 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:20.053440  1537 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:20.031090  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:19.989666  3027 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:57:20.030444  3033 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:19.989106  3061 consensus_queue.cc:1059] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:57:20.064924  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:20.065058  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:20.065554  1716 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.063408  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:20.068250  1645 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.051157  1712 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:20.073145  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 281896us
W20260709 12:57:20.076205  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 285346us
I20260709 12:57:20.049901  1644 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:20.077178  1642 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:20.061069  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:20.049160  1640 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.080615  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:20.038033  3065 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:20.082031  1686 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:20.106714  1719 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.066534  3018 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.066720  3051 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.062350  3034 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:20.094321  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.118377  1716 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.057410  2863 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:57:20.109511  1715 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.118924  2890 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.037940  2830 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.010187  2969 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.107256  3050 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.113945  2971 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:20.124782  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:20.110872  3065 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.133002  1641 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.070858  3049 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.081029  3062 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:57:20.150302  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 159410us
I20260709 12:57:20.107728  2975 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:57:20.119971  3034 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:20.139639  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:20.082273  3033 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:20.137959  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:20.124192  3018 raft_consensus.cc:697] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:20.079409  2968 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:57:20.157012  1569 raft_consensus.cc:2368] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:20.160231  2969 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.141698  2878 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:20.163610  3032 consensus_meta.cc:287] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.000s
I20260709 12:57:20.164047  3066 raft_consensus.cc:3055] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:20.138885  2971 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.172415  2845 raft_consensus.cc:3055] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:20.174270  3050 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.134511  3051 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:20.175329  3024 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:20.175971  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:20.157050  3034 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.177389  2880 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.178933  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:20.179311  2890 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.179765  2905 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.141933  3065 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.180111  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:20.180689  2941 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:20.180929  1684 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:20.181882  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:20.192267  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 54384.9us
I20260709 12:57:20.192404  1645 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.193594  1719 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.209157  2971 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.202909  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:20.224807  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:20.224867  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:20.225067  1642 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:20.225462  1719 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:57:20.206670  3066 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:20.220625  2934 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:20.242439  2941 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:20.242204  3066 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.243548  3066 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.243417  2941 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.242200  3024 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.194792  2878 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.168577  1638 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.197854  2975 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:20.079779  3048 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.226686  1721 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.229516  1715 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.230069  3027 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:20.231019  2880 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.231810  1563 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:20.209321  2845 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:20.232985  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:20.234921  3051 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.215385  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:20.194484  3000 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:57:20.238288  2341 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.179773  3052 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.216742  3032 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:20.213614  2923 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.199343  3070 consensus_queue.cc:1059] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:57:20.226015  3049 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:57:20.241101  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:20.293049  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52024.1us
I20260709 12:57:20.294246  2888 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:20.226257  1686 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:20.296335  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 70153.7us
I20260709 12:57:20.297756  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:20.297061  3038 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:20.298743  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:20.245814  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 64962.1us
I20260709 12:57:20.300809  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:20.246124  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:20.223407  2905 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.301905  1645 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.247862  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:20.213030  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.019s	sys 0.029s
I20260709 12:57:20.252327  1719 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:20.209196  3061 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:57:20.261999  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:20.245076  3062 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.198419  3033 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.268486  1647 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.248968  3023 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:20.269762  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:20.322453  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52770.8us
I20260709 12:57:20.323685  1642 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:20.250766  2878 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.215233  3018 consensus_queue.cc:237] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.264063  2975 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:20.246487  3050 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:57:20.277244  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:20.280679  2845 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.281127  3000 raft_consensus.cc:3055] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:20.342708  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:20.344274  1467 catalog_manager.cc:5697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 3, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:20.281224  1644 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:20.281371  3070 raft_consensus.cc:3055] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:20.273731  2830 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.282861  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:20.285286  3026 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.302752  1716 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:20.294554  3071 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.169s	user 0.003s	sys 0.000s
I20260709 12:57:20.313464  2852 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.330258  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:20.340682  2975 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.331588  3062 raft_consensus.cc:697] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:20.337459  3049 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:20.339785  1537 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:20.339906  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:20.340184  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:20.341408  1566 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:20.379628  1570 raft_consensus.cc:2368] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:20.339221  1645 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.323187  3014 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:20.356880  1612 leader_election.cc:400] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:20.357409  1647 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.364425  1568 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:20.380168  1612 leader_election.cc:403] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:20.350458  1467 catalog_manager.cc:5697] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 2, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:20.381289  1467 catalog_manager.cc:5697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 2, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:20.312974  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.019s	sys 0.029s
I20260709 12:57:20.346661  3000 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:20.347800  3070 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:20.358815  3023 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:20.372831  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 72093.4us
I20260709 12:57:20.342182  3027 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:20.387799  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 43745.6us
I20260709 12:57:20.349334  1639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:57:20.388224  1568 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:20.382709  1467 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 2, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:20.371583  1716 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.385954  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:20.390736  1467 catalog_manager.cc:5697] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 2, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:20.387396  1570 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:20.393666  1570 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:57:20.378093  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 79438.1us
I20260709 12:57:20.394624  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:20.396193  1568 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:20.385293  2852 raft_consensus.cc:697] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:20.373684  2845 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.378726  2342 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.401835  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:20.375151  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:57:20.403179  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 63492.5us
I20260709 12:57:20.403849  3051 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:20.385059  3014 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:20.398548  2852 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.408543  3059 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.408888  3085 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:20.409132  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:20.409422  1565 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:57:20.410377  2950 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.411216  3069 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:20.415885  1537 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:20.396728  3023 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.397142  2888 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
W20260709 12:57:20.385124  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 689409us
I20260709 12:57:20.414019  2953 tablet_bootstrap.cc:492] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:57:20.405313  3027 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:20.424964  3051 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:20.503665  3051 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.422709  3065 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.507968  1566 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:20.435628  3023 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.430083  3085 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.515489  3085 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:20.516220  3085 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:20.421754  2344 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:20.423095  3014 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.433027  3024 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.428061  3069 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.517210  2880 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:57:20.546949  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 152373us
I20260709 12:57:20.424764  3059 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.541640  1721 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.529958  3085 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.551460  3084 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:20.557386  3084 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:20.558014  3084 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.561074  3084 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.502056  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:20.632074  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:20.632988  1569 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.639106  2342 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:20.641608  1639 raft_consensus.cc:606] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Received request to transfer leadership to TS c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:20.642078  1639 raft_consensus.cc:614] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:20.549077  3069 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:20.649721  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 233882us
I20260709 12:57:20.650739  1537 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:20.652590  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:20.566799  3085 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.654810  1568 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:20.655543  3074 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:20.656044  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:20.631002  2905 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.661536  1612 leader_election.cc:400] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:20.641717  2923 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:20.645466  3049 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:20.662832  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:20.644577  2880 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.640089  3023 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.724699  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:20.535091  3062 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.728135  1569 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:20.543143  3000 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.656682  3024 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.783628  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:20.721182  3078 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:57:20.786360  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:20.786583  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:20.782920  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 120164us
I20260709 12:57:20.784344  1716 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:20.786602  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:20.542788  3070 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.662262  3032 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:20.790120  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 65541.5us
I20260709 12:57:20.722399  3026 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.788771  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:20.789214  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:20.789710  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:20.749342  2969 consensus_meta.cc:287] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.001s
I20260709 12:57:20.788398  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:20.782722  2953 tablet_bootstrap.cc:492] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:20.730504  2905 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:20.664069  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 162147us
I20260709 12:57:20.793248  1718 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:20.793941  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:20.798107  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:20.799762  2344 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:20.802583  3069 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.748910  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:20.787557  3060 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:20.812775  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:20.810169  3024 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:20.659253  3027 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.815616  2830 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.816288  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:20.720973  2923 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:20.814920  1640 consensus_meta.cc:287] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.696s	user 0.003s	sys 0.007s
I20260709 12:57:20.824599  1719 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:20.797432  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:20.749318  2880 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:20.816553  2971 consensus_meta.cc:287] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.000s
I20260709 12:57:20.731882  3049 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.816797  1565 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:20.793916  3091 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.852291  3024 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.818367  2905 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.855216  2905 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.797209  2888 consensus_queue.cc:1059] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:57:20.817924  3070 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.861249  2923 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:20.863790  3087 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:57:20.846372  1640 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:20.844444  2950 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.804759  3061 consensus_queue.cc:1059] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:57:20.846478  3060 raft_consensus.cc:697] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:20.848788  2830 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:20.875837  1686 leader_election.cc:400] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:20.858438  3033 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.878621  1686 leader_election.cc:403] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:20.861809  2986 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:20.860955  2953 ts_tablet_manager.cc:1403] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 2.057s	user 0.048s	sys 0.061s
I20260709 12:57:20.884859  1717 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:20.794675  3057 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:57:20.885890  3066 consensus_meta.cc:287] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.002s
I20260709 12:57:20.886098  2934 raft_consensus.cc:3055] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:20.860549  2971 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.862318  3000 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.885107  3092 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:20.896860  3033 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
W20260709 12:57:20.870074  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53875.8us
I20260709 12:57:20.901753  3060 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:20.902544  3089 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:57:20.899557  2934 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:20.891647  2923 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.924430  2923 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.927284  2923 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:20.927794  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.895475  2986 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:20.897722  3091 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:20.897857  2950 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.896082  3074 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:20.923087  2934 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.944048  2934 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:20.912029  2878 consensus_meta.cc:287] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.002s
I20260709 12:57:20.946097  2878 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:20.946916  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.896894  2905 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:20.932017  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:20.950312  1572 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:20.930645  2986 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.953891  3085 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.937781  3059 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.984130  1718 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:20.985143  3059 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:20.985872  3085 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:20.985956  3059 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.938733  3049 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.939093  3069 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.942963  2880 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.941397  3052 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.990059  2880 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:20.990197  3052 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:20.990839  2880 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.991041  3052 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.994082  2880 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.935322  2830 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:20.994567  3052 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.995944  3059 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:20.997972  3014 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.949368  2950 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:20.966815  1713 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:20.956796  3066 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:20.964704  1712 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:20.930645  3092 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.040881  3066 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.043830  2971 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:21.045288  3091 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:21.048458  2845 consensus_meta.cc:287] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.006s
I20260709 12:57:21.034559  3092 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:20.960275  2905 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.040097  2314 leader_election.cc:400] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3.
I20260709 12:57:21.070102  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:21.080034  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 281992us
I20260709 12:57:21.094267  1713 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:21.095655  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.095918  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:21.096596  1644 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:21.096875  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 130085us
I20260709 12:57:21.097783  2342 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:21.098351  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:21.099251  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:21.099849  2992 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.101078  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:21.102051  2340 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:21.102702  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:21.103582  1712 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:21.096596  1640 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:20.965593  3074 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:21.121393  1715 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:21.066929  3023 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:21.113546  1610 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:21.109655  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:21.127688  3066 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.130389  2905 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.084448  2878 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:21.133783  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:21.134836  2344 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:21.146718  2314 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:21.148330  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:21.168365  3014 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:21.168949  3076 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:21.169669  3076 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:21.170308  3076 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.164762  2845 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:21.185942  2923 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:21.167834  3066 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:21.196607  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 45012us
I20260709 12:57:21.238972  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:21.247620  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:21.195626  3057 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.137144  2953 raft_consensus.cc:359] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.234302  2845 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:21.233866  2950 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:21.259022  3034 consensus_meta.cc:287] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.038s	user 0.006s	sys 0.006s
W20260709 12:57:21.260593  3038 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.961s	user 0.014s	sys 0.002s
I20260709 12:57:21.272663  3074 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.255213  2986 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:21.285934  1644 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
W20260709 12:57:21.286643  2975 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.901s	user 0.002s	sys 0.011s
I20260709 12:57:21.249503  3066 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.290460  3065 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:21.292579  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:21.317617  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 70095.4us
I20260709 12:57:21.291889  3076 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:21.320716  2845 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.354303  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:21.377831  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.017s	sys 0.032s
W20260709 12:57:21.378585  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.017s	sys 0.033s
I20260709 12:57:21.321285  2934 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:21.404409  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 50199us
I20260709 12:57:21.410930  3076 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.414134  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:21.415539  3099 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:21.353430  3014 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.353905  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.418848  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:21.323928  3034 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.427244  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.408802  3061 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.415550  3057 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:21.345180  2975 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:21.481805  1564 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:21.419708  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:21.492690  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.493414  1642 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:21.496590  1719 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:57:21.470193  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:21.477855  2343 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:21.504217  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:21.505431  1713 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:21.436384  2941 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:21.458591  2953 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:21.424152  2934 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:57:21.510368  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:21.511528  1716 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:21.465063  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:21.505972  1640 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:57:21.515031  3088 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.776s	user 0.006s	sys 0.000s
I20260709 12:57:21.517050  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:21.427624  3014 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.514786  2340 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:21.488392  3085 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.492949  3026 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.537128  3026 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:21.536926  2941 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.540025  3026 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:21.533104  1568 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:21.501516  1715 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:57:21.503971  1638 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.012s	sys 0.049s
I20260709 12:57:21.536458  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:21.548189  1642 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:21.461225  3099 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:21.495081  3057 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.563055  3099 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:21.576006  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.528674  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:21.528987  2950 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:57:21.548344  1638 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.012s	sys 0.049s
I20260709 12:57:21.570842  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:21.612547  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.618538  1645 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:21.619423  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 48671.4us
I20260709 12:57:21.620282  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:21.622390  1535 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:21.618656  1643 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:21.576915  1642 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
W20260709 12:57:21.614039  3032 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.020s	sys 0.022s
W20260709 12:57:21.628209  3032 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.020s	sys 0.022s
I20260709 12:57:21.612588  2341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 261) took 1259 ms. Trace:
I20260709 12:57:21.628978  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:21.573060  1567 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:21.628676  2341 rpcz_store.cc:276] 0709 12:57:20.327738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.330983 (+  3245us) service_pool.cc:224] Handling call
0709 12:57:20.361305 (+ 30322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:20.397978 (+ 36673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:20.398024 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:20.398729 (+   705us) log.cc:844] Serialized 26 byte log entry
0709 12:57:20.559301 (+160572us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:20.559368 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:20.559472 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:21.479790 (+920318us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b24002e4ac8. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f4cd9c4 00007f6a3f4cbacb 00007f6a3f686dc9 00007f6a3f686a55 00007f6a3f68609d 00007f6a422b810e 00007f6a422cf88c 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221
0709 12:57:21.541941 (+ 62151us) raft_consensus.cc:1685] finished
0709 12:57:21.544309 (+  2368us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:21.587086 (+ 42777us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1544,"raft.queue_time_us":13665,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":1722,"spinlock_wait_cycles":36094720,"thread_start_us":132736,"threads_started":1,"wal-append.queue_time_us":245669}
I20260709 12:57:21.542140  2344 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:21.638622  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1473) took 1199 ms. Trace:
I20260709 12:57:21.569994  2986 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.637413  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.573449  2878 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:21.637284  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.023s	sys 0.022s
I20260709 12:57:21.628708  2950 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:21.640620  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.023s	sys 0.023s
W20260709 12:57:21.641026  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 1.25304e+06us
I20260709 12:57:21.641261  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.650321  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:21.651436  1646 raft_consensus.cc:2393] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:21.639070  1564 rpcz_store.cc:276] 0709 12:57:20.427367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.427535 (+   168us) service_pool.cc:224] Handling call
0709 12:57:20.427888 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:21.482334 (+1054446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:21.621992 (+139658us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001a7554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:21.622204 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419381504}
I20260709 12:57:21.579617  3095 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:21.620375  3099 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:21.637221  3065 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:21.684747  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:21.687609  3096 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:57:21.631582  3032 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:21.688136  1644 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:21.691143  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.631546  3026 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:21.692090  1645 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:21.693401  1712 raft_consensus.cc:2368] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3.
I20260709 12:57:21.579003  3085 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.631098  2890 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:57:21.620155  2941 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:21.700153  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 58477.5us
I20260709 12:57:21.689769  3095 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.662920  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:21.707273  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.722446  1640 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:21.723203  2890 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:21.723981  2890 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:21.655759  2878 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.728984  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:21.686674  3099 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:21.691351  2934 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.735025  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:21.735813  1643 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:21.694278  3066 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.698841  3026 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:21.743106  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:21.744475  2890 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:21.578894  2953 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:21.689842  3032 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:21.730532  2941 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.733558  3099 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.750335  3026 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.748983  3057 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:21.768118  3097 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:57:21.759824  2888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.027s	sys 0.039s
W20260709 12:57:21.773111  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:21.752693  2344 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:21.747843  2934 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.759267  3034 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:21.778903  1538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.006s	sys 0.060s
I20260709 12:57:21.780017  3085 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:21.765630  2975 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:21.781797  1538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.006s	sys 0.060s
I20260709 12:57:21.767522  3051 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:21.758944  2941 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:21.777329  2888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.027s	sys 0.040s
I20260709 12:57:21.810154  2975 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:21.781934  3023 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.818822  2950 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:21.819056  3095 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:21.819623  2950 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.820508  2941 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.820331  2950 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.823587  2950 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.817278  3051 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:57:21.827493  3001 raft_consensus.cc:3055] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:21.828135  3001 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:21.828861  3051 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:21.829494  2975 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:21.833228  2934 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.799705  3014 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:21.824354  2950 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:57:21.852504  3001 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.872388  3001 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.839598  3051 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:21.834455  3023 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:21.846089  1563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.026s	sys 0.043s
I20260709 12:57:21.880144  3051 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:21.884182  1563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.026s	sys 0.044s
I20260709 12:57:21.891849  2878 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:21.905978  2934 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.908317  2934 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.912660  2934 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.925680  3026 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.929771  2975 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:21.931099  3026 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:21.936365  2953 ts_tablet_manager.cc:1434] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 1.042s	user 0.013s	sys 0.005s
W20260709 12:57:21.936966  2953 ts_tablet_manager.cc:1467] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Tablet startup took 1042ms
W20260709 12:57:21.937533  2953 ts_tablet_manager.cc:1469] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Trace:
0709 12:57:15.801838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.805230 (+  3392us) service_pool.cc:224] Handling call
0709 12:57:16.253705 (+448475us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b58001b4b98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f6101a2 00007f6a48551bb9 00007f6a47682d88 00007f6a47746a07 00007f6a47778f4e 00007f6a4775dfdd 00007f6a4775df89 00007f6a4775df19 00007f6a4775dee1
0709 12:57:16.294753 (+ 41048us) ts_tablet_manager.cc:934] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
0709 12:57:17.211126 (+916373us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:17.502297 (+291171us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:17.504545 (+  2248us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:18.211331 (+706786us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:18.217033 (+  5702us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:18.287786 (+ 70753us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:18.328028 (+ 40242us) inbound_call.cc:177] Queueing success response
0709 12:57:18.804266 (+476238us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:57:20.894125 (+2089859us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:57:21.013068 (+118943us) tablet_replica.cc:261] Starting instrumentation
0709 12:57:21.131445 (+118377us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":10354,"raft.queue_time_us":3995,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":2484,"spinlock_wait_cycles":69606656,"tablet-copy.queue_time_us":50916,"tablet-download-pool.queue_time_us":303,"tablet-download-pool.run_cpu_time_us":1530,"tablet-download-pool.run_wall_time_us":99453,"thread_start_us":219731,"threads_started":2}
I20260709 12:57:21.945220  3023 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:21.935909  3099 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.967967  3099 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:21.955503  2845 consensus_meta.cc:287] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.003s
I20260709 12:57:21.968933  2845 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:21.973924  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:21.974767  2344 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.984833  2934 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.985705  2934 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:21.988984  2934 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:21.990662  1613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.019s	sys 0.031s
W20260709 12:57:21.991182  1613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.019s	sys 0.031s
W20260709 12:57:21.991441  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.034s	sys 0.033s
W20260709 12:57:21.991907  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.034s	sys 0.033s
W20260709 12:57:22.013849  3027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.014s	sys 0.041s
W20260709 12:57:22.017376  3027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.014s	sys 0.041s
W20260709 12:57:22.014405  2852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.019s	sys 0.035s
W20260709 12:57:22.026360  1571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.114s	user 0.040s	sys 0.048s
W20260709 12:57:22.026733  1571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.040s	sys 0.048s
I20260709 12:57:22.018368  3057 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.014597  3034 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:22.023463  2941 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.018383  3105 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.026217  2888 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.021819  3026 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:22.026470  2934 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:22.019011  2852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.019s	sys 0.036s
W20260709 12:57:22.019065  2830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.008s	sys 0.040s
W20260709 12:57:22.031100  1537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.025s	sys 0.042s
W20260709 12:57:22.046526  1537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.025s	sys 0.042s
I20260709 12:57:22.048621  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:22.043339  3062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.005s	sys 0.050s
I20260709 12:57:22.029901  2845 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:22.032176  3027 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:22.024669  2863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.485s	user 0.030s	sys 0.037s
I20260709 12:57:22.051868  1564 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:22.036823  3034 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:22.042126  3105 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:22.064817  3113 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.042462  2888 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:22.087109  2346 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.014s	sys 0.041s
W20260709 12:57:22.105445  2346 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.014s	sys 0.042s
W20260709 12:57:22.050020  2985 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.013s	sys 0.030s
I20260709 12:57:22.075626  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:22.076277  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:22.036134  3057 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:22.046362  2830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.008s	sys 0.040s
W20260709 12:57:22.071229  2863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.534s	user 0.030s	sys 0.037s
I20260709 12:57:22.046133  2934 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:22.073580  3093 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.146s	user 0.021s	sys 0.028s
I20260709 12:57:22.072232  3027 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:22.066097  3062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.005s	sys 0.050s
I20260709 12:57:22.106993  1568 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:22.108044  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:22.045492  2941 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:22.109072  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:22.119194  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:22.046034  3026 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:22.153250  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:22.153910  1720 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
W20260709 12:57:22.104116  1641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.018s	sys 0.038s
W20260709 12:57:22.154469  1641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.018s	sys 0.038s
W20260709 12:57:22.108852  2985 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.013s	sys 0.030s
I20260709 12:57:22.151257  1716 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:22.113937  2923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.000s	sys 0.025s
I20260709 12:57:22.152266  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:22.146579  3017 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.004s	sys 0.022s
W20260709 12:57:22.165920  1639 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.006s	sys 0.019s
W20260709 12:57:22.117337  3093 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.022s	sys 0.028s
I20260709 12:57:22.178938  1564 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:22.118868  3060 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.011s	sys 0.047s
I20260709 12:57:22.186630  1716 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:22.484889  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:22.155645  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.013s	sys 0.013s
W20260709 12:57:22.485648  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.013s	sys 0.013s
W20260709 12:57:22.485989  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 1.32034e+06us
W20260709 12:57:22.146374  3091 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.007s	sys 0.023s
I20260709 12:57:22.120694  2344 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:22.116007  3102 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.262383  1566 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:22.184274  2797 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.011s	sys 0.020s
I20260709 12:57:22.297963  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:22.445173  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.011s	sys 0.045s
W20260709 12:57:22.317353  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:22.391111  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:22.192835  2923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.000s	sys 0.026s
I20260709 12:57:22.263289  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:22.264933  3017 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.004s	sys 0.022s
I20260709 12:57:22.111671  3051 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:22.287231  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:22.194622  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:22.339622  3104 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:22.267050  3024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.016s	sys 0.043s
I20260709 12:57:22.110976  3113 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:22.298429  3038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.008s	sys 0.036s
W20260709 12:57:22.444671  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.020s	sys 0.038s
I20260709 12:57:22.471143  1713 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
W20260709 12:57:22.472218  1719 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.009s	sys 0.025s
W20260709 12:57:22.460985  3065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.013s	sys 0.026s
I20260709 12:57:22.521324  1610 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:22.521318  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.000s	sys 0.046s
W20260709 12:57:22.522478  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.000s	sys 0.046s
I20260709 12:57:22.517479  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:22.518532  1719 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.010s	sys 0.025s
I20260709 12:57:22.523460  1713 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:22.516731  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.020s	sys 0.038s
W20260709 12:57:22.460677  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.004s	sys 0.029s
I20260709 12:57:22.476534  1568 raft_consensus.cc:2410] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:57:22.530105  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.005s	sys 0.029s
W20260709 12:57:22.466833  1718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.005s	sys 0.029s
W20260709 12:57:22.530817  1718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.005s	sys 0.029s
W20260709 12:57:22.477537  1639 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.010s	sys 0.025s
W20260709 12:57:22.478245  1717 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.029s	sys 0.013s
W20260709 12:57:22.492702  1538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.014s	sys 0.061s
W20260709 12:57:22.531965  1717 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.029s	sys 0.013s
W20260709 12:57:22.532047  1538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.014s	sys 0.061s
W20260709 12:57:22.491940  1572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.011s	sys 0.026s
W20260709 12:57:22.496052  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.012s	sys 0.045s
W20260709 12:57:22.497503  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:22.495811  1714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.015s	sys 0.040s
W20260709 12:57:22.472374  1638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.017s	sys 0.028s
I20260709 12:57:22.504740  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:22.491926  3060 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.480s	user 0.012s	sys 0.047s
W20260709 12:57:22.492476  3091 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.256s	user 0.007s	sys 0.024s
W20260709 12:57:22.495553  2797 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.013s	sys 0.021s
I20260709 12:57:22.654888  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:22.532061  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:22.655582  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:22.669809  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 941023us
I20260709 12:57:22.671367  1568 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:22.675309  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:22.532848  1572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.012s	sys 0.026s
W20260709 12:57:22.507804  3024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.018s	sys 0.046s
I20260709 12:57:22.677376  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1481) took 1156 ms. Trace:
W20260709 12:57:22.678331  1714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.019s	sys 0.042s
I20260709 12:57:22.544230  1569 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:22.678650  1564 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:22.632375  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1462) took 2303 ms. Trace:
W20260709 12:57:22.508129  2890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.011s	sys 0.031s
W20260709 12:57:22.503962  3032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.009s	sys 0.032s
I20260709 12:57:22.499440  2923 raft_consensus.cc:697] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:22.563220  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:22.500031  3102 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:22.729610  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:22.939916  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 414600us
I20260709 12:57:22.946177  1566 raft_consensus.cc:2410] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:22.827586  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 73) took 1343 ms. Trace:
I20260709 12:57:22.964685  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:22.679308  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.009s	sys 0.014s
I20260709 12:57:22.970562  1716 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:22.970733  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.255s	user 0.015s	sys 0.017s
W20260709 12:57:22.971184  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 1.30823e+06us
I20260709 12:57:22.972154  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:22.942103  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:22.731637  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:22.572983  1565 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:22.975389  1713 raft_consensus.cc:2393] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:22.584745  1721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.008s	sys 0.047s
W20260709 12:57:22.738794  3120 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:57:22.543249  2863 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.834532  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1180) took 1762 ms. Trace:
I20260709 12:57:22.611613  1712 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:22.823401  3051 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:22.978242  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:22.994598  1713 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:22.516366  3038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.009s	sys 0.036s
I20260709 12:57:22.572257  3106 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:22.739086  3115 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:57:22.944783  3032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.018s	sys 0.045s
I20260709 12:57:22.610872  3103 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.629163  2888 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:22.665002  2344 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:57:22.792083  3128 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:57:22.618327  2934 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:22.680330  1570 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:22.774214  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:22.571946  3105 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:22.668964  3027 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:22.824128  3138 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.551616  3061 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:22.679126  1563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.000s	sys 0.023s
I20260709 12:57:22.989979  1641 rpcz_store.cc:276] 0709 12:57:21.071961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.072118 (+   157us) service_pool.cc:224] Handling call
0709 12:57:21.103667 (+ 31549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:21.104065 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:21.104095 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:21.104782 (+   687us) log.cc:844] Serialized 26 byte log entry
0709 12:57:22.154884 (+1050102us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:22.154935 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.155025 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:22.834251 (+679226us) raft_consensus.cc:1685] finished
0709 12:57:22.834287 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.834442 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2636,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":1049615,"threads_started":1,"wal-append.queue_time_us":1724003}
I20260709 12:57:22.968873  1572 rpcz_store.cc:276] 0709 12:57:21.520800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.521635 (+   835us) service_pool.cc:224] Handling call
0709 12:57:21.522165 (+   530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:21.522533 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:21.522567 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:21.523682 (+  1115us) log.cc:844] Serialized 501 byte log entry
0709 12:57:22.677075 (+1153393us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:22.677112 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.677171 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:22.677209 (+    38us) raft_consensus.cc:1685] finished
0709 12:57:22.677218 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.677326 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1153027,"threads_started":1,"wal-append.queue_time_us":1121329}
W20260709 12:57:22.822027  3107 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:57:22.969916  1718 rpcz_store.cc:276] 0709 12:57:21.483938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.484777 (+   839us) service_pool.cc:224] Handling call
0709 12:57:21.485233 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:21.485529 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:21.485580 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:21.486199 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 12:57:22.531313 (+1045114us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:22.531376 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.531491 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:22.827272 (+295781us) raft_consensus.cc:1685] finished
0709 12:57:22.827313 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.827506 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280,"thread_start_us":987522,"threads_started":1,"wal-append.queue_time_us":1317143}
I20260709 12:57:22.993440  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 77) took 1676 ms. Trace:
I20260709 12:57:23.019304  2888 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.570405  3057 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:22.545586  3065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.014s	sys 0.027s
W20260709 12:57:22.980979  1721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.253s	user 0.015s	sys 0.061s
W20260709 12:57:22.678171  1638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.022s	sys 0.030s
I20260709 12:57:22.803838  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:22.944113  2890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.013s	sys 0.036s
I20260709 12:57:22.572029  3113 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:22.749327  3034 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:22.680081  3137 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:22.998734  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.011s	sys 0.019s
W20260709 12:57:23.092455  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.020s
W20260709 12:57:22.990164  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0122289920000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 12:57:22.679257  3101 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.009s	sys 0.016s
I20260709 12:57:22.661327  2992 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:22.570219  3026 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:22.824584  3145 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:22.610870  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:22.856139  2341 raft_consensus.cc:1217] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:22.820240  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:23.006589  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.980873  3108 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.511319  3104 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:22.980672  3091 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:22.940761  1571 rpcz_store.cc:276] 0709 12:57:20.328594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.328759 (+   165us) service_pool.cc:224] Handling call
0709 12:57:20.329473 (+   714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:20.332560 (+  3087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:20.332622 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:20.900481 (+567859us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b2c00000708. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4102da11 00007f6a4103d372 00007f6a4276fa01 00007f6a4273443a 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2
0709 12:57:20.905703 (+  5222us) log.cc:844] Serialized 506 byte log entry
0709 12:57:22.027221 (+1121518us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:22.027268 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.027353 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:22.632006 (+604653us) raft_consensus.cc:1685] finished
0709 12:57:22.632034 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.632291 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3043072,"thread_start_us":1114715,"threads_started":1,"wal-append.queue_time_us":1716713}
I20260709 12:57:23.015486  1713 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:22.991094  3024 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:22.993192  3130 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:23.009325  3106 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.016932  2346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 359) took 1959 ms. Trace:
I20260709 12:57:22.994638  3060 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.035311  1716 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:22.996381  3121 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:23.016731  3103 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:23.065311  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 123289us
I20260709 12:57:23.134922  1716 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:22.748907  2830 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.072465  3085 raft_consensus.cc:2764] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:57:23.074314  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 71) took 1591 ms. Trace:
I20260709 12:57:22.994009  2863 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.077765  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:23.070175  1639 rpcz_store.cc:276] 0709 12:57:21.316631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.316816 (+   185us) service_pool.cc:224] Handling call
0709 12:57:21.317263 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:21.317536 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:22.548228 (+1230692us) log.cc:844] Serialized 14 byte log entry
0709 12:57:22.992971 (+444743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:22.993023 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:22.993073 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.993271 (+   198us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.993389 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4675,"prepare.queue_time_us":761554,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":71958,"thread_start_us":1646731,"threads_started":2}
W20260709 12:57:23.059450  3132 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:57:23.080299  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 517138us
W20260709 12:57:23.061295  3017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.020s	sys 0.036s
I20260709 12:57:23.073298  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1125) took 1574 ms. Trace:
I20260709 12:57:23.085285  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:23.064155  1563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.003s	sys 0.029s
I20260709 12:57:23.078001  3065 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:23.080613  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:23.094595  3101 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.205s	user 0.010s	sys 0.025s
I20260709 12:57:23.128176  2346 rpcz_store.cc:276] 0709 12:57:21.057210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.057411 (+   201us) service_pool.cc:224] Handling call
0709 12:57:21.059843 (+  2432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:21.122958 (+ 63115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:21.123005 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:21.159672 (+ 36667us) log.cc:844] Serialized 501 byte log entry
0709 12:57:22.106028 (+946356us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:22.106089 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.117121 (+ 11032us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54006036d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:22.117188 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:23.016587 (+899399us) raft_consensus.cc:1685] finished
0709 12:57:23.016615 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:23.016855 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144033536,"thread_start_us":945831,"threads_started":1,"wal-append.queue_time_us":1392946}
I20260709 12:57:23.085865  3152 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:23.095172  3138 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.121461  3024 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:23.187122  1720 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:23.118211  2992 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.190024  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:23.193647  1641 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:23.205998  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.127626  2342 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:23.131029  3091 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:23.080892  2888 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.093166  2923 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.098580  3137 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.124682  3145 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:23.381843  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 279303us
I20260709 12:57:23.367269  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:23.231703  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.131448  3130 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.126350  3108 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.160533  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.345042  1647 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:23.545176  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.020s	sys 0.048s
I20260709 12:57:23.650482  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1197) took 1573 ms. Trace:
W20260709 12:57:23.698309  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.022s	sys 0.057s
W20260709 12:57:23.698820  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 726705us
I20260709 12:57:23.698478  1564 rpcz_store.cc:276] 0709 12:57:22.077159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:22.077329 (+   170us) service_pool.cc:224] Handling call
0709 12:57:23.650275 (+1572946us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b5400113d54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:23.650409 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63833472}
I20260709 12:57:23.699652  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:23.382143  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 192195us
I20260709 12:57:23.186113  1717 rpcz_store.cc:276] 0709 12:57:21.498533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.498699 (+   166us) service_pool.cc:224] Handling call
0709 12:57:21.513462 (+ 14763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:21.513727 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:22.548615 (+1034888us) log.cc:844] Serialized 14 byte log entry
0709 12:57:23.072157 (+523542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:23.072222 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:23.072276 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.072845 (+   569us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:23.073227 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1131604,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":157519,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7731,"thread_start_us":1519369,"threads_started":3}
I20260709 12:57:23.647377  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.301996  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1200) took 1184 ms. Trace:
I20260709 12:57:23.701939  1537 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:23.539381  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:23.131377  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1126) took 1632 ms. Trace:
W20260709 12:57:23.384284  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:23.702275  1569 rpcz_store.cc:276] 0709 12:57:22.117297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:22.117460 (+   163us) service_pool.cc:224] Handling call
0709 12:57:22.117884 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:22.944377 (+826493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.301655 (+357278us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400165dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:23.301911 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979927296}
W20260709 12:57:23.707357  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 340185us
I20260709 12:57:23.710304  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.185269  1567 raft_consensus.cc:2410] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:57:23.150455  1714 rpcz_store.cc:276] 0709 12:57:21.483130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.484614 (+  1484us) service_pool.cc:224] Handling call
0709 12:57:21.507738 (+ 23124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:21.516462 (+  8724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:21.516511 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:21.531213 (+ 14702us) log.cc:844] Serialized 26 byte log entry
0709 12:57:22.970969 (+1439756us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:22.989065 (+ 18096us) log.cc:844] Serialized 14 byte log entry
0709 12:57:23.073680 (+ 84615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.074049 (+   369us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:23.074110 (+    61us) raft_consensus.cc:1685] finished
0709 12:57:23.074127 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:23.074260 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19634,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":12027,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":10836,"thread_start_us":1422350,"threads_started":2,"wal-append.queue_time_us":1066118}
W20260709 12:57:23.194571  3116 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 0.584s	user 0.009s	sys 0.004s
I20260709 12:57:23.706346  1643 raft_consensus.cc:2368] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
W20260709 12:57:23.594697  1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.017s
W20260709 12:57:23.725037  1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.001s	sys 0.020s
W20260709 12:57:23.277900  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 184639us
I20260709 12:57:23.446308  3106 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:23.726477  2314 leader_election.cc:400] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3.
I20260709 12:57:23.194103  2941 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:23.150560  3059 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:23.234206  3157 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:23.370939  3154 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
W20260709 12:57:23.371901  3150 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
W20260709 12:57:23.371343  3148 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
W20260709 12:57:23.592149  1566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1194) took 1543 ms (client timeout 1623 ms). Trace:
I20260709 12:57:23.590554  1645 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:23.372597  3104 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:23.640017  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:23.361255  1712 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:23.194399  3164 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:23.373044  1640 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:23.715193  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.716707  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:23.489646  2985 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.009s	sys 0.007s
I20260709 12:57:23.772396  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.727023  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:23.349427  1642 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:23.773608  2346 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:23.733086  2312 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:23.277009  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-52bc0b3e08ea4bd78b344b833b97faed received from {username='slave'} at 127.0.0.1:58328
I20260709 12:57:23.540470  3166 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.447106  3124 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.449215  3143 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.783356  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.723436  3026 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:23.474223  3057 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:23.715092  3119 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 1.100s	user 0.007s	sys 0.012s
I20260709 12:57:23.714823  2342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59844 (request call id 373) took 1024 ms. Trace:
I20260709 12:57:23.707712  3161 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:23.149466  3162 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.736984  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.544749  3160 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.195s
I20260709 12:57:23.153187  2830 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.745035  3172 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.744913  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:23.370290  3147 consensus_queue.cc:1059] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.375s
I20260709 12:57:23.230777  3062 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:23.153868  3121 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.745939  3174 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.704741  3103 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:23.385066  3024 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:23.382261  3163 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:23.362118  3102 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:23.547022  3112 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.977s	user 0.004s	sys 0.007s
I20260709 12:57:23.762681  3157 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.881098  3175 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:23.881601  3175 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:23.881937  3175 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:23.883128  3157 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:23.794129  3124 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.883970  3157 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:23.749023  1639 raft_consensus.cc:2368] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:23.370879  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1188) took 2712 ms. Trace:
I20260709 12:57:23.618263  3167 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.153524  1718 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
W20260709 12:57:23.752221  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 50365.1us
I20260709 12:57:23.892864  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1143) took 1322 ms. Trace:
I20260709 12:57:23.893370  1718 rpcz_store.cc:276] 0709 12:57:22.570532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.077420 (+506888us) service_pool.cc:224] Handling call
0709 12:57:23.892780 (+815360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:23.340353  2934 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.354168  3038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58312 (request call id 9) took 9631 ms. Trace:
I20260709 12:57:23.754968  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:23.237699  3017 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:23.494362  1715 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:23.232425  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 75) took 2864 ms. Trace:
I20260709 12:57:23.276934  3061 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:23.206370  3113 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:23.133324  3060 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.759325  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:23.881129  2888 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:23.763370  1566 rpcz_store.cc:269] 0709 12:57:22.048465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:22.048582 (+   117us) service_pool.cc:224] Handling call
0709 12:57:22.075441 (+ 26859us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:23.591820 (+1516379us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54001fe854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:23.592055 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315879040}
I20260709 12:57:23.727020  2314 leader_election.cc:403] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:23.753801  2941 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:23.780397  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 140488us
W20260709 12:57:23.939069  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 206080us
I20260709 12:57:23.782301  3158 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:23.944952  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 218605us
I20260709 12:57:23.914507  3038 rpcz_store.cc:276] 0709 12:57:13.646791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.647020 (+   229us) service_pool.cc:224] Handling call
0709 12:57:13.778191 (+131171us) log.cc:844] Serialized 506 byte log entry
0709 12:57:23.230712 (+9452521us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":533,"raft.run_cpu_time_us":875,"raft.run_wall_time_us":874,"thread_start_us":1140407,"threads_started":1,"wal-append.queue_time_us":41183,"wal-append.run_cpu_time_us":1837,"wal-append.run_wall_time_us":1001846}
I20260709 12:57:23.943776  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:23.945437  3158 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.782368  3164 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.783449  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:23.784765  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 68165us
I20260709 12:57:23.709833  3129 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:23.759739  3153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.011s	sys 0.011s
I20260709 12:57:23.757756  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 77) took 1099 ms. Trace:
I20260709 12:57:23.978936  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:23.759516  3106 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.713231  3138 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.799350  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:23.995543  1645 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:23.494702  3156 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.272s
W20260709 12:57:23.779827  2985 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.009s	sys 0.016s
I20260709 12:57:23.803076  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:57:24.010460  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.011062  1642 raft_consensus.cc:606] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:24.011629  1642 raft_consensus.cc:614] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:23.805749  3168 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.474671  3065 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.277208  3152 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.855799  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:23.855015  3109 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:23.796041  3057 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.056813  3179 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.057011  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.058655  3057 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.058751  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:23.863461  3101 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:23.806753  3165 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.059916  3165 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.884572  3157 raft_consensus.cc:697] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:23.872187  3174 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.889947  3163 raft_consensus.cc:697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:23.866932  3062 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.891376  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:24.099982  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 208676us
I20260709 12:57:23.915409  3167 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.806699  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-52bc0b3e08ea4bd78b344b833b97faed on tablet 52bc0b3e08ea4bd78b344b833b97faed with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:23.917788  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:23.796236  3026 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.809147  3161 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.919524  3124 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:23.920276  3059 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:23.920398  2343 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:23.888576  1563 rpcz_store.cc:276] 0709 12:57:20.654802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.791790 (+136988us) service_pool.cc:224] Handling call
0709 12:57:20.813534 (+ 21744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:21.921491 (+1107957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:21.924168 (+  2677us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:21.950748 (+ 26580us) log.cc:844] Serialized 26 byte log entry
0709 12:57:23.237238 (+1286490us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:23.277548 (+ 40310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.310821 (+ 33273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:23.336967 (+ 26146us) raft_consensus.cc:1685] finished
0709 12:57:23.336994 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:23.367335 (+ 30341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54086,"raft.queue_time_us":175688,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"thread_start_us":2250287,"threads_started":2,"wal-append.queue_time_us":915413}
I20260709 12:57:23.923448  3024 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.924180  2934 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.925935  1647 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:23.878808  3103 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:23.888675  2863 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:23.644364  3085 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 12:57:23.939311  2923 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.859828  3172 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.944505  2941 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.945098  2888 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.135802  3171 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.194s
I20260709 12:57:24.136176  2888 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.137039  3167 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.137176  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.137873  1647 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:23.751340  3130 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:23.809612  3143 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.525205  2341 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:23.961529  1569 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:23.962257  1535 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:23.790699  3166 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:23.993472  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:23.993691  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:23.996886  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:23.861976  3091 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.008104  1564 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:24.004928  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:24.013415  1566 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:24.147145  2348 raft_consensus.cc:2368] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
W20260709 12:57:23.996425  3153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.011s	sys 0.012s
I20260709 12:57:24.056566  3109 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:23.806367  3162 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.064503  3168 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.064181  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:23.977227  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1145) took 1389 ms. Trace:
I20260709 12:57:24.066191  1716 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:23.979807  3176 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.067384  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.085268  3155 raft_consensus.cc:3055] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:24.171665  3176 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.091820  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.141017  3173 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.226s
I20260709 12:57:24.172988  1568 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:24.174124  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.174582  3121 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.174706  1568 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:24.171825  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.175586  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.175710  3190 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:23.931123  3017 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.176317  3190 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.178241  3017 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:23.998796  3177 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:23.708359  1721 rpcz_store.cc:276] 0709 12:57:21.499021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.501696 (+  2675us) service_pool.cc:224] Handling call
0709 12:57:21.579287 (+ 77591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:21.704016 (+124729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:21.719417 (+ 15401us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:21.727766 (+  8349us) log.cc:844] Serialized 26 byte log entry
0709 12:57:23.089377 (+1361611us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:23.092076 (+  2699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.098536 (+  6460us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:23.104397 (+  5861us) raft_consensus.cc:1685] finished
0709 12:57:23.119457 (+ 15060us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:23.129371 (+  9914us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49018,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":11484,"thread_start_us":1351975,"threads_started":1,"wal-append.queue_time_us":1097768,"wal-append.run_cpu_time_us":1916,"wal-append.run_wall_time_us":1001946}
I20260709 12:57:24.179176  3177 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.995052  3106 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:24.182274  3106 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.181713  3157 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.789584  2342 rpcz_store.cc:276] 0709 12:57:22.690200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:22.792316 (+102116us) service_pool.cc:224] Handling call
0709 12:57:23.709965 (+917649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:24.012425  3147 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.185371  3147 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.186136  3163 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.188006  3147 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:24.104156  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:23.994685  3129 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.189448  3060 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.045267  3160 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.117517  1645 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:24.059844  3101 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:23.996260  1567 rpcz_store.cc:276] 0709 12:57:22.654760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:22.668797 (+ 14037us) service_pool.cc:224] Handling call
0709 12:57:23.753580 (+1084783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:24.122077  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.191817  1639 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
W20260709 12:57:24.111529  1537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.526s (SENT) [suppressed 35 similar messages]
W20260709 12:57:24.127696  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 142406us
W20260709 12:57:24.193596  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 231430us
I20260709 12:57:24.129457  1646 raft_consensus.cc:2368] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
I20260709 12:57:23.979136  3164 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.194336  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:24.195192  3159 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:24.195523  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:24.195792  3159 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:24.196218  3164 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:24.196506  3159 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.118512  3108 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.196868  2863 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:24.197187  3108 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:24.197350  2863 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:24.197839  2863 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.197765  3108 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.199268  1610 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:24.200057  3108 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.201061  3185 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:24.123106  3059 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.123338  2992 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:24.138258  2888 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.144865  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:24.034904  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.131742  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.203819  3130 raft_consensus.cc:3055] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.204049  1565 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:24.204202  3130 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:24.205080  3130 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.205871  3130 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.130857  3137 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.139086  2830 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.142369  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.210727  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.211263  1642 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:24.212222  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.212764  1642 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:24.138185  3172 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.157229  2941 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.158403  3170 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.160476  3109 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.161219  1640 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:24.132469  3027 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:24.169123  1715 rpcz_store.cc:276] 0709 12:57:22.571102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.279507 (+708405us) service_pool.cc:224] Handling call
0709 12:57:23.383030 (+103523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:23.931152 (+548122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.960667 (+ 29515us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:24.123617  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.041s	sys 0.021s
I20260709 12:57:24.133723  3103 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.170250  3153 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:24.171701  3024 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:24.172235  3155 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:24.091120  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:24.175071  3189 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.948011  3113 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.191838  1644 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:24.214246  1684 leader_election.cc:400] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
I20260709 12:57:24.237914  1572 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
W20260709 12:57:24.061339  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 114694us
I20260709 12:57:24.239817  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:24.165189  3104 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:24.169572  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:24.229493  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:24.229910  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.041s	sys 0.021s
I20260709 12:57:24.215251  3158 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:24.106400  3061 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.191321  3057 raft_consensus.cc:2764] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:57:24.196899  3164 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:57:24.252951  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:24.212888  3108 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:24.234977  1570 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.212443  3143 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:24.238765  1684 leader_election.cc:403] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:57:24.262084  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50023.6us
W20260709 12:57:24.245082  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 907367us
I20260709 12:57:24.265590  1686 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:24.231150  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:24.248404  2349 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:24.254117  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:24.270447  3180 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:57:24.232636  3153 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:24.273084  1684 leader_election.cc:400] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:24.275173  1684 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:24.235021  1657 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.EndTabletCopySession from 127.0.0.1:58328 (request call id 83) took 1138 ms. Trace:
I20260709 12:57:24.247354  3104 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.243547  3133 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.190179  3160 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.251770  2830 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:24.272142  3024 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.312994  3191 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:57:24.313412  3024 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.261468  3108 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:24.283241  3147 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:24.275652  3143 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.274459  3158 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
I20260709 12:57:24.252027  3156 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:57:24.307572  3085 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:24.310837  2888 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:24.273651  2992 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:57:24.238617  3170 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.312587  3104 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.339888  3165 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.311936  3145 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.315636  3129 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.311596  3166 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.325650  3147 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.307076  3185 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:57:24.327412  3108 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.325892  2830 raft_consensus.cc:697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:24.290319  3193 consensus_queue.cc:1059] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:57:24.241218  3189 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.322822  3133 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.301100  1657 rpcz_store.cc:276] 0709 12:57:23.096257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.118211 (+ 21954us) service_pool.cc:224] Handling call
0709 12:57:24.226754 (+1108543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:24.338564  3062 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.378961  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1138) took 1033 ms. Trace:
I20260709 12:57:24.325780  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.403419  3143 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.405241  2830 consensus_queue.cc:237] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.406427  3197 raft_consensus.cc:3055] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:24.402371  3147 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.289912  3184 consensus_queue.cc:1059] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.134s
I20260709 12:57:23.931346  1638 rpcz_store.cc:276] 0709 12:57:20.321711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.324810 (+  3099us) service_pool.cc:224] Handling call
0709 12:57:20.374619 (+ 49809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:20.390593 (+ 15974us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:21.631046 (+1240453us) log.cc:844] Serialized 14 byte log entry
0709 12:57:23.116807 (+1485761us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:23.121721 (+  4914us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:23.125679 (+  3958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.130932 (+  5253us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:23.185663 (+ 54731us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1649736,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2618,"raft.queue_time_us":358984,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7624,"spinlock_wait_cycles":1524480,"thread_start_us":2659006,"threads_started":2,"wal-append.queue_time_us":982466,"wal-append.run_cpu_time_us":1403,"wal-append.run_wall_time_us":1027378}
I20260709 12:57:24.418859  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1144) took 1848 ms. Trace:
I20260709 12:57:24.416525  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1124) took 2918 ms. Trace:
I20260709 12:57:24.469585  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.469122  1716 rpcz_store.cc:276] 0709 12:57:22.570838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.152712 (+581874us) service_pool.cc:224] Handling call
0709 12:57:23.230876 (+ 78164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.164260 (+933384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.418549 (+254289us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54002c38d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:24.418788 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919771392}
I20260709 12:57:24.450548  1647 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
W20260709 12:57:24.449584  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 196725us
W20260709 12:57:24.451097  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 175975us
I20260709 12:57:24.451594  1686 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:24.450176  1646 rpcz_store.cc:276] 0709 12:57:23.345813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.723897 (+378084us) service_pool.cc:224] Handling call
0709 12:57:24.378704 (+654807us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54001c4654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:24.378885 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763710848}
I20260709 12:57:24.455941  1718 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:57:24.456276  3170 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.461975  3168 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:24.475870  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:24.476735  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.470556  1714 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:24.418071  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:24.474005  1684 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:24.479759  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:24.479674  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:24.481465  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.482117  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:24.482504  1717 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:24.482967  1717 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:24.469784  1719 rpcz_store.cc:276] 0709 12:57:21.498144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.499156 (+  1012us) service_pool.cc:224] Handling call
0709 12:57:21.518608 (+ 19452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:21.747265 (+228657us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:22.941357 (+1194092us) log.cc:844] Serialized 14 byte log entry
0709 12:57:23.652797 (+711440us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b18000290e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d423a 00007f6a4273ea2a
0709 12:57:24.415462 (+762665us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18000290e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287
0709 12:57:24.415644 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:24.415696 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:24.415743 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.416274 (+   531us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54001752d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:24.416317 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:24.416445 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23956,"prepare.queue_time_us":898386,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":7823,"raft.queue_time_us":208371,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3054,"spinlock_wait_cycles":539520640,"thread_start_us":1070127,"threads_started":3,"wal-append.queue_time_us":800418}
I20260709 12:57:24.457314  1712 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:57:24.332036  3155 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.487938  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.486187  1642 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:57:24.489135  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 232817us
I20260709 12:57:24.490633  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.491183  1716 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
W20260709 12:57:24.494800  1535 connection.cc:256] RPC call timeout handler was delayed by -1.1795929560000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 12:57:24.495347  1535 connection.cc:256] RPC call timeout handler was delayed by -1.1525849340000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 12:57:24.496968  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.497628  1569 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:24.497582  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.498670  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.499274  1718 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:24.499392  1569 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:24.460529  3197 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:57:24.508679  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 396828us
I20260709 12:57:24.509017  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.510681  1569 raft_consensus.cc:2410] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:24.457315  3101 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:24.506644  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.516721  1571 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:24.520686  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:24.526360  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:24.529464  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 49788.1us
W20260709 12:57:24.530512  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50895us
I20260709 12:57:24.531427  1564 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:24.531543  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:24.532043  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.532560  1720 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:24.533636  1570 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:24.534035  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.534600  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.534920  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:24.535288  1570 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:24.534646  1571 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:24.536258  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.515012  1717 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.460083  3143 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.534318  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:24.487732  3158 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:24.487457  3191 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:24.538421  1716 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:24.538332  1718 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:24.539703  1717 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.538267  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.540495  1719 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:24.490080  3170 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:24.504101  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.542629  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:24.543320  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.507247  3156 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:24.503347  3168 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:24.542706  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:24.548743  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.547703  1537 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:24.550374  1570 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:24.551218  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.516417  2985 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.519469  3155 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.556037  3156 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:24.507023  3165 consensus_queue.cc:1059] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:57:24.492071  3164 consensus_queue.cc:1059] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:57:24.538828  3193 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.557180  1720 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:24.566840  1537 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:24.560111  1642 raft_consensus.cc:2410] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:24.541911  3158 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.545117  3170 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:24.380295  3153 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.518462  3159 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:24.927428  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.928262  1716 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:24.929451  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.930154  1714 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
W20260709 12:57:24.782663  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 111052us
W20260709 12:57:24.932299  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 365499us
I20260709 12:57:24.678015  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:24.666291  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 132015us
W20260709 12:57:24.812758  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.786243  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.806537  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.940680  1566 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:24.749212  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:24.616953  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.545583  2934 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:24.882529  2923 consensus_meta.cc:287] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.726s	user 0.012s	sys 0.001s
W20260709 12:57:24.882344  2863 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.005s
W20260709 12:57:24.797096  3179 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.740s	user 0.013s	sys 0.009s
W20260709 12:57:24.997102  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 49286.7us
W20260709 12:57:24.941905  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 407017us
I20260709 12:57:24.559517  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.556371  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.038432  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.077430  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.620929  3191 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:24.940024  3170 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:24.801836  3138 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:24.567974  3156 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:25.038733  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:24.615656  3085 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.038529  2923 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.942591  1686 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:24.565878  3101 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:24.946297  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.038162  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.000422  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:25.279893  1570 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:25.280359  1720 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:25.280897  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.615262  3062 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.648s
I20260709 12:57:25.038162  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.617586  3059 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.568259  2985 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:24.943598  1568 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
W20260709 12:57:24.683357  3178 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.453s	user 0.004s	sys 0.000s
I20260709 12:57:24.945161  1537 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:25.298076  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 352960us
I20260709 12:57:25.299237  1537 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:25.300222  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:25.303081  1720 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.299678  2346 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:25.264858  3085 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.868908  3168 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:24.566740  1715 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:24.682924  3026 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:24.556497  3024 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:24.941255  3163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.015s	sys 0.002s
I20260709 12:57:24.615430  3201 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:24.704656  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.763150  3192 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.746423  3160 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:24.942785  1717 raft_consensus.cc:2376] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3. Re-sending same reply.
I20260709 12:57:24.616019  3165 raft_consensus.cc:3055] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:24.945534  2890 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:25.087374  3147 consensus_meta.cc:287] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.003s
W20260709 12:57:25.218345  3186 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:57:24.558549  3017 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.082192  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.767725  3133 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:24.803545  3176 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:24.620800  3103 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:24.946870  3158 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.558281  3113 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:25.105973  3175 consensus_meta.cc:287] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.224s	user 0.008s	sys 0.014s
I20260709 12:57:25.038486  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:24.876658  3104 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:25.222733  3106 consensus_meta.cc:287] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.034s	user 0.015s	sys 0.001s
I20260709 12:57:25.281456  1566 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
W20260709 12:57:25.067787  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.937108  3164 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.282997  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.363286  3017 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:25.038496  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:25.080964  2343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 380) took 1189 ms. Trace:
I20260709 12:57:25.085777  3161 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:25.170380  3143 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:25.390089  2343 rpcz_store.cc:276] 0709 12:57:23.891869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.910844 (+ 18975us) service_pool.cc:224] Handling call
0709 12:57:23.919920 (+  9076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:23.920212 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:24.620681 (+700469us) log.cc:844] Serialized 14 byte log entry
0709 12:57:24.962350 (+341669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:24.999946 (+ 37596us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:25.039394 (+ 39448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:25.080741 (+ 41347us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:25.080894 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6415,"raft.queue_time_us":11824,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":114851,"thread_start_us":302375,"threads_started":1,"wal-append.queue_time_us":663004}
I20260709 12:57:25.228178  3177 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:25.284592  1647 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:25.392168  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1196) took 1176 ms. Trace:
I20260709 12:57:25.392511  1647 rpcz_store.cc:276] 0709 12:57:24.215576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.962677 (+747101us) service_pool.cc:224] Handling call
0709 12:57:25.392110 (+429433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:25.381362  3106 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.231437  3179 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3.
I20260709 12:57:25.366097  3217 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.223441  1642 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:25.264433  3191 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:25.370762  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.228881  2863 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.282701  3138 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.962803  3091 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.332s
I20260709 12:57:25.334671  1714 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.962967  3199 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.337s
I20260709 12:57:24.945858  3204 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.360s
W20260709 12:57:25.348086  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 405528us
W20260709 12:57:25.334105  3163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.024s	sys 0.015s
I20260709 12:57:25.313586  3085 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:25.337841  2341 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.186s	user 0.016s	sys 0.008s
W20260709 12:57:25.360081  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 60902.8us
I20260709 12:57:25.352278  3185 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:25.356849  2342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 381) took 1214 ms. Trace:
I20260709 12:57:25.350044  3165 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:25.357609  2890 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.442466  3162 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:25.442847  2890 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.373190  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:25.377004  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1134) took 3126 ms. Trace:
I20260709 12:57:25.355712  3101 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:25.379618  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:25.379669  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:25.380510  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:25.479437  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 106315us
I20260709 12:57:25.480335  1644 raft_consensus.cc:2393] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:25.381755  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.481076  1570 raft_consensus.cc:2410] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:57:25.283058  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.382556  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:25.370257  3109 consensus_meta.cc:287] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.139s	user 0.009s	sys 0.012s
I20260709 12:57:25.385087  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.371165  3215 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.387073  2314 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:25.389290  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.391161  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 85) took 1327 ms. Trace:
I20260709 12:57:25.264292  3193 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.366178  3159 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:25.295224  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:24.961767  3172 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.349s
I20260709 12:57:25.361799  3192 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:25.509162  3124 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:25.443431  3165 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.363234  3147 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:25.549130  2863 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:25.548547  3101 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.549726  2344 raft_consensus.cc:2368] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
W20260709 12:57:25.551108  1640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1150) took 1751 ms (client timeout 2121 ms). Trace:
I20260709 12:57:25.551819  3190 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:25.551527  1640 rpcz_store.cc:269] 0709 12:57:23.799973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.855426 (+ 55453us) service_pool.cc:224] Handling call
0709 12:57:25.550908 (+1695482us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b54000f82d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:25.551046 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178194816}
I20260709 12:57:25.552412  3179 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:25.552838  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.552965  3179 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:25.553562  3038 raft_consensus.cc:3055] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:25.414487  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:25.415710  3213 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:57:25.554109  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.417851  3170 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:25.421121  3214 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 12:57:25.421708  3208 log.cc:927] Time spent T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:57:25.422256  3211 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:57:25.429759  1571 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:25.393611  3017 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.431151  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.432039  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.432570  1714 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:25.607815  1647 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:25.608079  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1161) took 1062 ms. Trace:
I20260709 12:57:25.479671  3162 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:25.358100  3201 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.377619  3175 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:25.444201  1713 rpcz_store.cc:276] 0709 12:57:22.250903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.121191 (+870288us) service_pool.cc:224] Handling call
0709 12:57:23.121649 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:23.130123 (+  8474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:23.130165 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:23.149877 (+ 19712us) log.cc:844] Serialized 26 byte log entry
0709 12:57:23.755080 (+605203us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:23.755125 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.755200 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:24.556200 (+801000us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:25.376605 (+820405us) raft_consensus.cc:1685] finished
0709 12:57:25.376634 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:25.376919 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7996,"raft.queue_time_us":421282,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":172,"spinlock_wait_cycles":7620480,"thread_start_us":454846,"threads_started":1,"wal-append.queue_time_us":775060}
W20260709 12:57:25.612607  1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1144) took 2264 ms (client timeout 2218 ms). Trace:
I20260709 12:57:25.510397  3192 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:25.482558  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.500859  1572 rpcz_store.cc:276] 0709 12:57:24.063632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.063842 (+   210us) service_pool.cc:224] Handling call
0709 12:57:25.391010 (+1327168us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b54002b5cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:25.391109 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169256192}
I20260709 12:57:25.504194  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.505333  1566 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:25.505757  1567 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:25.506192  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:25.506661  3197 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.506997  3193 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:25.381534  3206 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:57:25.520617  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 133618us
I20260709 12:57:25.429032  1563 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:25.547650  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1207) took 1060 ms. Trace:
I20260709 12:57:25.548938  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.553937  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.601069  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.601783  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.398012  3217 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:25.384590  3168 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:25.602386  1639 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.429987  3138 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.604558  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1141) took 2257 ms. Trace:
I20260709 12:57:25.654099  1641 rpcz_store.cc:276] 0709 12:57:23.346876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.602204 (+2255328us) service_pool.cc:224] Handling call
0709 12:57:25.604098 (+  1894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:25.604276 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:25.604301 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:25.604342 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:25.604368 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:25.604424 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:25.604509 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:25.604939  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.461653  3199 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:25.608521  1714 rpcz_store.cc:276] 0709 12:57:24.545975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.301377 (+755402us) service_pool.cc:224] Handling call
0709 12:57:25.334499 (+ 33122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:25.607823 (+273324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:25.608026 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:25.434199  1686 connection.cc:256] RPC call timeout handler was delayed by -1.2076454269999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 12:57:25.559412  3109 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.649729  3217 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.627548  2985 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:25.607893  1642 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:25.658876  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.659705  1641 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:25.659930  1714 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.479910  3177 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:25.441910  2342 rpcz_store.cc:276] 0709 12:57:24.142027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.222174 (+1080147us) service_pool.cc:224] Handling call
0709 12:57:25.285875 (+ 63701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:25.313401 (+ 27526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:25.333844 (+ 20443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:25.356422 (+ 22578us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:25.356503 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:25.356596 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:25.356776 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:25.482434  2340 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:25.481464  1684 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:25.675191  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.509173  3191 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.614101  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:25.675884  1644 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:25.614886  3147 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:25.649765  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:25.615242  3104 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:25.615552  3170 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:25.615736  1719 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:25.617012  3155 consensus_meta.cc:287] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.048s	user 0.011s	sys 0.000s
I20260709 12:57:25.617200  3189 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:25.621152  3218 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:57:25.624261  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:25.624451  3085 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.624814  3165 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:25.545734  3215 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.601970  2345 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:25.553573  3179 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:25.629007  1569 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
W20260709 12:57:25.613032  1643 rpcz_store.cc:269] 0709 12:57:23.347930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.757983 (+410053us) service_pool.cc:224] Handling call
0709 12:57:25.612405 (+1854422us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400336b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:25.612547 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3502693120}
I20260709 12:57:25.633632  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:25.637568  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.641793  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.642000  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.642268  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.642699  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.479308  3216 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:57:25.644680  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:25.626284  3169 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:25.641350  3060 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:25.645761  3197 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.646509  1716 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:57:25.617031  3108 consensus_meta.cc:287] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.163s	user 0.011s	sys 0.000s
I20260709 12:57:25.647658  1645 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:25.647840  3175 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:25.648434  3193 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:25.648583  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:25.648725  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.649219  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.553978  3038 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:25.644199  1638 rpcz_store.cc:276] 0709 12:57:24.487254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.389087 (+901833us) service_pool.cc:224] Handling call
0709 12:57:25.547584 (+158497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:25.653183  3201 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:25.911875  1568 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:25.862248  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:25.697233  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.912773  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.674233  1639 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:25.628403  3162 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:25.733047  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:25.861678  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 380283us
I20260709 12:57:25.697643  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.929041  1713 raft_consensus.cc:2393] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:25.929557  1570 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 1.
I20260709 12:57:25.929750  1684 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:25.930874  1647 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:25.921109  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.937079  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.938647  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:25.935554  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 290925us
I20260709 12:57:25.940637  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:25.943317  1644 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:25.656116  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:25.814813  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.729641  1565 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:25.948462  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.949268  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.950080  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:25.950793  1713 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:25.950855  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1502) took 1246 ms. Trace:
I20260709 12:57:25.951257  1570 rpcz_store.cc:276] 0709 12:57:24.704178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.946747 (+1242569us) service_pool.cc:224] Handling call
0709 12:57:25.950796 (+  4049us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:25.951565  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:25.952925  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.953173  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.953852  1641 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:25.953994  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:25.826588  3106 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:25.809320  3138 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:25.978183  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 48525.2us
I20260709 12:57:25.969997  1641 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.799590  3109 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:25.969648  1644 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.975216  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:25.963086  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:25.961052  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:25.992856  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.971127  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:25.737161  2341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 374) took 2882 ms. Trace:
I20260709 12:57:25.945152  3192 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:26.011956  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.011205  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.027037  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1505) took 1065 ms. Trace:
I20260709 12:57:26.027458  1564 rpcz_store.cc:276] 0709 12:57:24.961732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.947949 (+986217us) service_pool.cc:224] Handling call
0709 12:57:26.026972 (+ 79023us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.030010  1566 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:25.979475  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:25.977856  3158 consensus_meta.cc:287] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 12:57:26.032271  1645 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:25.976724  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.700717  3153 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.913782  3060 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:26.044313  3060 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.045037  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.045305  3060 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.045814  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 86) took 1117 ms. Trace:
I20260709 12:57:26.046171  1568 rpcz_store.cc:276] 0709 12:57:24.928823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.028990 (+1100167us) service_pool.cc:224] Handling call
0709 12:57:26.045750 (+ 16760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.049683  3085 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:26.054492  1717 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:26.055249  3162 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:25.970427  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:25.975395  1570 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:25.936986  3108 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:25.976095  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.060294  1569 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:25.701857  3190 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:26.017741  1643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:57:26.082515  1643 raft_consensus.cc:606] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:26.082959  1643 raft_consensus.cc:614] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:26.019914  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1145) took 2671 ms. Trace:
I20260709 12:57:26.022713  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:25.945375  3195 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.013550  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1147) took 2520 ms. Trace:
I20260709 12:57:26.084997  1641 rpcz_store.cc:276] 0709 12:57:23.505721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.954507 (+2448786us) service_pool.cc:224] Handling call
0709 12:57:25.969553 (+ 15046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.013015 (+ 43462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.013474 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.013971  1684 leader_election.cc:400] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
I20260709 12:57:26.085831  1684 leader_election.cc:403] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:26.021270  1572 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:26.086421  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1501) took 1398 ms. Trace:
I20260709 12:57:26.086653  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:26.086745  1572 rpcz_store.cc:276] 0709 12:57:24.687939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.946691 (+1258752us) service_pool.cc:224] Handling call
0709 12:57:26.086363 (+139672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.033051  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1208) took 1507 ms. Trace:
I20260709 12:57:25.914235  3215 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.083760  1644 rpcz_store.cc:276] 0709 12:57:23.348267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.954290 (+2606023us) service_pool.cc:224] Handling call
0709 12:57:25.969123 (+ 14833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.019646 (+ 50523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.019855 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.030643  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1498) took 1469 ms. Trace:
I20260709 12:57:25.675357  3199 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:25.954377  3147 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:26.090919  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 77100.3us
I20260709 12:57:26.091663  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:26.022255  2341 rpcz_store.cc:276] 0709 12:57:22.855018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:22.855177 (+   159us) service_pool.cc:224] Handling call
0709 12:57:22.855899 (+   722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:23.525004 (+669105us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:25.460628 (+1935624us) log.cc:844] Serialized 14 byte log entry
0709 12:57:25.675272 (+214644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:25.736694 (+ 61422us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:25.736773 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:25.736877 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:25.737059 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15825,"raft.queue_time_us":372569,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":2449,"thread_start_us":491075,"threads_started":2}
I20260709 12:57:26.021925  1715 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:25.945173  3152 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:25.732527  2890 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:26.042841  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.043136  3017 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:26.070176  3164 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.070320  1564 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:26.033766  1721 raft_consensus.cc:2410] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:26.023198  3193 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:26.087483  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.088527  1566 rpcz_store.cc:276] 0709 12:57:24.561234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.024481 (+1463247us) service_pool.cc:224] Handling call
0709 12:57:26.024820 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.030390 (+  5570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.030590 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.093128  1684 leader_election.cc:400] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:26.119077  1684 leader_election.cc:403] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:26.119815  1684 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:26.041502  3158 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.108006  1642 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:26.081050  2985 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.087118  1638 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.088019  1645 rpcz_store.cc:276] 0709 12:57:24.525615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.934183 (+1408568us) service_pool.cc:224] Handling call
0709 12:57:26.032980 (+ 98797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.113746  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 90) took 1075 ms. Trace:
I20260709 12:57:26.127832  1564 rpcz_store.cc:276] 0709 12:57:25.038833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.035727 (+996894us) service_pool.cc:224] Handling call
0709 12:57:26.069940 (+ 34213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.113409 (+ 43469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.113686 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.117213  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.094640  3192 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.105463  3162 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.116627  3164 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.122057  1718 raft_consensus.cc:2410] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:26.105219  3168 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:26.125490  1566 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:26.138461  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:26.094991  3195 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:26.130525  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.130894  2890 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:26.131146  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:26.149850  3217 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.131323  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 81) took 1676 ms. Trace:
I20260709 12:57:26.151263  1721 rpcz_store.cc:276] 0709 12:57:24.454869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.457612 (+  2743us) service_pool.cc:224] Handling call
0709 12:57:25.624139 (+1166527us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800150f98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60feee 0000000000375939 00007f6a476831e0 00007f6a4774c0c4 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:26.128557 (+504418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9562368}
I20260709 12:57:26.104612  3147 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:26.152590  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.154677  3147 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:26.134459  3156 consensus_meta.cc:287] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.001s
I20260709 12:57:26.155493  3156 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.158545  3156 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:26.100683  1572 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:26.124310  3138 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:26.059019  3038 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:26.139823  1713 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:26.129854  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:26.162397  2342 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:26.140300  1566 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.164534  1566 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:26.144341  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:26.128983  3197 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.167203  3197 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:26.167356  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.167724  3197 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.168813  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.169705  1714 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:26.148916  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.170570  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.171301  1714 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:26.171336  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.149405  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.173666  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.175073  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:26.175774  2345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 268) took 2163 ms (client timeout 2089 ms). Trace:
I20260709 12:57:26.175997  1715 raft_consensus.cc:2393] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:26.177122  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.177836  1719 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:26.134842  3192 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.190717  1564 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.172482  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.197579  1714 raft_consensus.cc:2393] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:26.198575  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.142735  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:26.209266  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.191941  3192 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.211447  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.212183  1714 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:26.213583  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.214228  1714 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:26.222019  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:26.193969  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.195581  3017 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:26.202278  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:26.242585  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 88) took 1492 ms (client timeout 1875 ms). Trace:
W20260709 12:57:26.243098  1716 rpcz_store.cc:269] 0709 12:57:24.750248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.948043 (+197795us) service_pool.cc:224] Handling call
0709 12:57:26.242344 (+1294301us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54002c33d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:26.242516 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597417216}
I20260709 12:57:26.247987  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:26.209969  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1158) took 2283 ms. Trace:
W20260709 12:57:26.176303  2345 rpcz_store.cc:269] 0709 12:57:24.011994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.058327 (+ 46333us) service_pool.cc:224] Handling call
0709 12:57:26.175529 (+2117202us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54005e01d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:26.175665 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3113220352}
I20260709 12:57:26.226841  3174 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:26.232939  3152 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:26.258212  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.287091  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.290755  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:26.291316  1646 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.298990  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58430 (request call id 227) took 6925 ms. Trace:
I20260709 12:57:26.301442  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1493) took 1801 ms. Trace:
I20260709 12:57:26.301919  1571 rpcz_store.cc:276] 0709 12:57:24.500266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.536034 (+ 35768us) service_pool.cc:224] Handling call
0709 12:57:26.300973 (+1764939us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400094054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:26.301365 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053806336}
I20260709 12:57:26.303189  2985 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:26.303671  2985 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.251775  1640 rpcz_store.cc:276] 0709 12:57:23.922427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.086829 (+2164402us) service_pool.cc:224] Handling call
0709 12:57:26.135223 (+ 48394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.142830 (+  7607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.147104 (+  4274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:26.187958 (+ 40854us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:26.192153 (+  4195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.201478 (+  9325us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.205880 (+  4402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.306314  1640 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:26.306882  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1199) took 2087 ms. Trace:
I20260709 12:57:26.307210  1640 rpcz_store.cc:276] 0709 12:57:24.219212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.305663 (+2086451us) service_pool.cc:224] Handling call
0709 12:57:26.305978 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.306643 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.306826 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.252012  3059 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:26.310117  3217 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:26.312193  1571 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:26.313347  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.313897  1571 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:26.313000  1566 raft_consensus.cc:2955] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:26.314563  3038 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.314734  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.315837  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.316568  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.317216  1570 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:26.318032  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.318106  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.318807  1570 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:26.319171  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.319866  1564 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:26.319772  1570 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.316490  1571 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:26.321834  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 91) took 1373 ms. Trace:
I20260709 12:57:26.322292  1642 rpcz_store.cc:276] 0709 12:57:24.948065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.934552 (+986487us) service_pool.cc:224] Handling call
0709 12:57:26.308626 (+374074us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b5400337554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:26.321766 (+ 13140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142428928}
I20260709 12:57:26.324723  1714 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:26.332449  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.337760  1720 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:26.340438  1646 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:26.255280  3199 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:26.348827  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:26.357887  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.360733  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:26.361455  1571 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:26.397063  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:26.397789  2341 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:26.398794  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:26.399537  2341 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:26.401026  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:26.401887  1642 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:26.402168  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:26.402554  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1201) took 2168 ms. Trace:
I20260709 12:57:26.402897  1642 rpcz_store.cc:276] 0709 12:57:24.233818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.357756 (+2123938us) service_pool.cc:224] Handling call
0709 12:57:26.401605 (+ 43849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.402275 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.402473 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.403338  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:26.404325  1642 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:26.406064  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1204) took 2079 ms. Trace:
I20260709 12:57:26.406425  1642 rpcz_store.cc:276] 0709 12:57:24.326708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.403763 (+2077055us) service_pool.cc:224] Handling call
0709 12:57:26.404048 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.405814 (+  1766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.406012 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.400323  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:57:26.357066  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.299372  1467 rpcz_store.cc:276] 0709 12:57:19.373160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.373317 (+   157us) service_pool.cc:224] Handling call
0709 12:57:19.427883 (+ 54566us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269e090 00007f6a4273cf3a 00007f6a484f31cc 00007f6a485f137e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:26.298894 (+6871011us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:20.548732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:20.754804 (+206072us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:20.784953 (+ 30149us) write_op.cc:435] Acquired schema lock
0709 12:57:20.787912 (+  2959us) tablet.cc:662] Decoding operations
0709 12:57:20.899124 (+111212us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:20.913714 (+ 14590us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:20.916567 (+  2853us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:57:20.925639 (+  9072us) tablet.cc:701] Row locks acquired
0709 12:57:20.925678 (+    39us) write_op.cc:260] PREPARE: finished
0709 12:57:20.925906 (+   228us) write_op.cc:270] Start()
0709 12:57:20.926082 (+   176us) write_op.cc:276] Timestamp: P: 1783601840925841 usec, L: 0
0709 12:57:20.926125 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:57:20.927149 (+  1024us) log.cc:844] Serialized 2094 byte log entry
0709 12:57:23.071145 (+2143996us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:24.098911 (+1027766us) op_driver.cc:464] REPLICATION: finished
0709 12:57:25.433829 (+1334918us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b1800323b60. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:57:25.433978 (+   149us) write_op.cc:301] APPLY: starting
0709 12:57:25.434058 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:25.434225 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:25.434251 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:25.434967 (+   716us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:25.435148 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:57:25.435195 (+    47us) write_op.cc:312] APPLY: finished
0709 12:57:25.435441 (+   246us) log.cc:844] Serialized 47 byte log entry
0709 12:57:25.609062 (+173621us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:25.613152 (+  4090us) write_op.cc:454] Released schema lock
0709 12:57:25.640115 (+ 26963us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:25.728887 (+ 88772us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:25.928296 (+199409us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4,"reported_tablets":10,"spinlock_wait_cycles":47316736,"child_traces":[["op",{"apply.queue_time_us":297262,"apply.run_cpu_time_us":57603,"apply.run_wall_time_us":230949,"num_ops":5,"prepare.queue_time_us":29236,"prepare.run_cpu_time_us":54191,"prepare.run_wall_time_us":1951220,"raft.queue_time_us":206456,"raft.run_cpu_time_us":12759,"raft.run_wall_time_us":396425,"replication_time_us":3080232,"spinlock_wait_cycles":58748544,"thread_start_us":2019843,"threads_started":5,"wal-append.queue_time_us":1873079,"wal-append.run_cpu_time_us":47958,"wal-append.run_wall_time_us":2186069}]]}
I20260709 12:57:26.425001  2349 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:26.428414  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.433179  1570 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:26.438102  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.349030  3179 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:26.445838  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:26.426291  3221 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:26.424527  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:26.452208  1571 raft_consensus.cc:2368] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:26.430315  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 88) took 2194 ms. Trace:
I20260709 12:57:26.449915  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:57:26.461339  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 225694us
W20260709 12:57:26.465920  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:26.488456  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.548132  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.549047  1564 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
W20260709 12:57:26.561555  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 420437us
I20260709 12:57:26.562326  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.565069  1717 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:26.567533  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.568387  1720 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:26.456364  2341 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:26.450642  3158 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:26.573333  1535 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:26.459846  3221 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:57:26.577391  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 453283us
W20260709 12:57:26.578317  2314 leader_election.cc:336] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.564s (SENT)
I20260709 12:57:26.587428  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.592388  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:26.587810  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:26.589818  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:26.590258  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.599467  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.600244  1720 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:26.603789  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:26.610430  1571 raft_consensus.cc:2393] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:26.617554  3017 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:26.619450  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.620168  1720 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
W20260709 12:57:26.624162  3232 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:57:26.625483  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1516) took 1312 ms. Trace:
I20260709 12:57:26.625969  1568 rpcz_store.cc:276] 0709 12:57:25.313149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.046949 (+733800us) service_pool.cc:224] Handling call
0709 12:57:26.047293 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:26.047490 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.047521 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:26.047985 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:57:26.255378 (+207393us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:26.255434 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.255524 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:26.625191 (+369667us) raft_consensus.cc:1685] finished
0709 12:57:26.625227 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.625415 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":206961,"threads_started":1,"wal-append.queue_time_us":366936}
I20260709 12:57:26.573832  3169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59242 (request call id 80) took 7247 ms. Trace:
I20260709 12:57:26.650096  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:26.584913  3217 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:57:26.637109  3165 consensus_meta.cc:287] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.000s
I20260709 12:57:26.601616  3147 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:26.664108  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:26.667596  1645 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:26.646386  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:26.663254  3162 consensus_meta.cc:287] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 12:57:26.672899  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.654892  3217 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.461337  1640 rpcz_store.cc:276] 0709 12:57:24.231607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.308123 (+2076516us) service_pool.cc:224] Handling call
0709 12:57:26.308511 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.343784 (+ 35273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.347972 (+  4188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:26.358011 (+ 10039us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:26.360524 (+  2513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.415590 (+ 55066us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.426324 (+ 10734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.675544  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:26.685930  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:26.677364  3085 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.687544  3085 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.687566  3165 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.688048  3085 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.688112  3165 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.688599  3165 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.693097  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:26.694270  3153 consensus_meta.cc:287] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
I20260709 12:57:26.680066  3162 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
W20260709 12:57:26.694846  3229 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 12:57:26.695345  1721 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:26.695986  3138 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.696446  3138 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.696568  3162 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.696920  3138 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.697046  3162 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.697517  3162 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.701156  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:26.699700  1470 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:26.667526  3158 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:26.686672  3215 consensus_meta.cc:287] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 12:57:26.681972  3217 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:26.725899  3225 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 1.100s	user 0.007s	sys 0.000s
I20260709 12:57:26.715040  1470 catalog_manager.cc:5697] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:26.719800  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:26.727499  2346 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 272) took 2668 ms (client timeout 1762 ms). Trace:
W20260709 12:57:26.740972  2346 rpcz_store.cc:269] 0709 12:57:24.059558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.144475 (+ 84917us) service_pool.cc:224] Handling call
0709 12:57:26.727231 (+2582756us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54006c0cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:26.727400 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2521498496}
I20260709 12:57:26.710929  3158 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.728199  3059 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.747817  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1195) took 2531 ms. Trace:
I20260709 12:57:26.748411  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:26.711911  2345 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
W20260709 12:57:26.758728  2314 leader_election.cc:336] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.875s (SENT)
I20260709 12:57:26.759443  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:26.755429  3130 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.760576  3130 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:26.761050  3130 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:26.762315  3238 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:57:26.763460  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1194) took 2548 ms. Trace:
I20260709 12:57:26.733240  3215 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.763823  1647 rpcz_store.cc:276] 0709 12:57:24.215153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.101110 (+1885957us) service_pool.cc:224] Handling call
0709 12:57:26.116200 (+ 15090us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:26.116656 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.116693 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:26.122053 (+  5360us) log.cc:844] Serialized 26 byte log entry
0709 12:57:26.536223 (+414170us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:26.537551 (+  1328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.537649 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:26.763239 (+225590us) raft_consensus.cc:1685] finished
0709 12:57:26.763266 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.763405 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1966,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":6024,"thread_start_us":392578,"threads_started":1,"wal-append.queue_time_us":528366}
I20260709 12:57:26.766278  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:26.766812  1647 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.770015  3108 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:26.770871  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:26.772118  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:26.772962  3192 consensus_meta.cc:287] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.000s
I20260709 12:57:26.773453  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:26.773360  3192 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:26.774251  2346 raft_consensus.cc:2393] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:26.774515  2348 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:57:26.775362  2985 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:26.667256  3221 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:26.777777  1647 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:26.777938  3192 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:26.778543  3221 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.778642  3192 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:57:26.778986  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.783499  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:26.784264  1645 raft_consensus.cc:2393] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:57:26.785185  3230 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:57:26.758096  2344 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:26.778833  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:26.749536  3158 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:26.788723  3179 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:26.789021  2341 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:26.791424  3165 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.751808  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:26.766757  3215 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:26.767418  1570 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:26.793462  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:26.792486  3085 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:26.793789  1638 consensus_meta.cc:287] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.001s
I20260709 12:57:26.747997  1470 catalog_manager.cc:5697] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:26.796160  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:26.799856  3164 consensus_meta.cc:287] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.657s	user 0.002s	sys 0.007s
I20260709 12:57:26.802701  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:26.807307  1645 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.846884  1572 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:26.807590  1535 connection.cc:256] RPC call timeout handler was delayed by -1.0122052239999562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 12:57:26.847873  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:57:26.815384  1639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1214) took 1511 ms (client timeout 1761 ms). Trace:
I20260709 12:57:26.748838  3059 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:26.733904  3235 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:57:26.801328  3158 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.851351  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.850345  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:26.849714  1639 rpcz_store.cc:269] 0709 12:57:25.303842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.414300 (+110458us) service_pool.cc:224] Handling call
0709 12:57:26.815192 (+1400892us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b54001b4ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:26.815313 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110687616}
I20260709 12:57:26.857295  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 92) took 1744 ms. Trace:
I20260709 12:57:26.846112  2349 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:26.847898  3129 consensus_queue.cc:1059] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:57:26.772204  3162 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.922360  3162 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:26.767735  3138 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.861747  1569 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
W20260709 12:57:26.861685  1565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1485) took 2364 ms (client timeout 2135 ms). Trace:
W20260709 12:57:26.925218  1565 rpcz_store.cc:269] 0709 12:57:24.496866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.501401 (+  4535us) service_pool.cc:224] Handling call
0709 12:57:25.548762 (+1047361us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:26.861370 (+1312608us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b5400132c54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:26.861581 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133102592}
I20260709 12:57:26.865175  2348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 382) took 2665 ms. Trace:
I20260709 12:57:26.865554  3174 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.927062  3174 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.872474  2342 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:26.927802  3174 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.874310  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.928938  1719 raft_consensus.cc:2393] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:26.929402  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1582) took 1247 ms. Trace:
I20260709 12:57:26.929764  1719 rpcz_store.cc:276] 0709 12:57:25.682082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.179283 (+497201us) service_pool.cc:224] Handling call
0709 12:57:26.781117 (+601834us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800150f98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:26.874159 (+ 93042us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5800150f98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fe9c 00007f6a3f60fa5b 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:26.929336 (+ 55177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60090880}
I20260709 12:57:26.931044  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.844780  1638 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:26.933126  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 94) took 1307 ms. Trace:
I20260709 12:57:26.933267  1642 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:26.933508  1638 rpcz_store.cc:276] 0709 12:57:25.625309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.949184 (+323875us) service_pool.cc:224] Handling call
0709 12:57:26.933062 (+983878us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.934680  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:26.642591  3169 rpcz_store.cc:276] 0709 12:57:19.316569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.319626 (+  3057us) service_pool.cc:224] Handling call
0709 12:57:19.379783 (+ 60157us) log.cc:844] Serialized 501 byte log entry
0709 12:57:26.557951 (+7178168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82904,"raft.run_cpu_time_us":1641,"raft.run_wall_time_us":53194,"thread_start_us":522628,"threads_started":2,"wal-append.queue_time_us":133806,"wal-append.run_cpu_time_us":2007,"wal-append.run_wall_time_us":1105020}
I20260709 12:57:26.875581  3085 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:26.877945  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 84) took 2933 ms. Trace:
I20260709 12:57:26.939087  1641 rpcz_store.cc:276] 0709 12:57:23.949357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.876952 (+2927595us) service_pool.cc:224] Handling call
0709 12:57:26.877309 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.877509 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.877551 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:26.877616 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:26.877662 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.877737 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.877877 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.940689  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:26.941592  1641 raft_consensus.cc:2393] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:26.942154  3165 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:26.942557  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:26.878878  1567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1483) took 2382 ms (client timeout 1817 ms). Trace:
I20260709 12:57:26.944043  2985 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:26.882603  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1197) took 2663 ms. Trace:
I20260709 12:57:26.883206  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:26.851105  3164 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:26.807623  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:26.806205  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.926662  2348 rpcz_store.cc:276] 0709 12:57:24.199309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.367510 (+2168201us) service_pool.cc:224] Handling call
0709 12:57:26.425412 (+ 57902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:26.774902 (+349490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.864933 (+ 90031us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400600ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:26.865119 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802254592}
W20260709 12:57:26.918257  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:26.943886  1567 rpcz_store.cc:269] 0709 12:57:24.496112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.503709 (+  7597us) service_pool.cc:224] Handling call
0709 12:57:26.878621 (+2374912us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400094554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:26.878783 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496191360}
I20260709 12:57:26.875582  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.985998  1720 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:26.987318  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.988111  1720 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:26.809101  3217 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:26.945438  1641 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:26.947252  2340 raft_consensus.cc:1240] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:26.932431  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.991930  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:26.993019  1641 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:26.992947  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.994155  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:26.994372  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.994891  1641 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.995652  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.845106  3108 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:57:26.997095  1566 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:26.972182  2341 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.951578  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:27.000082  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 90) took 2198 ms. Trace:
I20260709 12:57:27.000514  1639 rpcz_store.cc:276] 0709 12:57:24.801876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.999172 (+2197296us) service_pool.cc:224] Handling call
0709 12:57:26.999505 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.999703 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.999739 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:26.999792 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:26.999833 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.999909 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:27.000018 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.002403  1639 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:27.003139  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1168) took 1765 ms. Trace:
I20260709 12:57:27.003535  1639 rpcz_store.cc:276] 0709 12:57:25.237337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.001679 (+1764342us) service_pool.cc:224] Handling call
0709 12:57:27.002080 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:27.002859 (+   779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.003075 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.936434  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:26.964042  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 113720us
I20260709 12:57:27.009558  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:26.967466  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:26.953603  1643 rpcz_store.cc:276] 0709 12:57:24.218835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.112709 (+1893874us) service_pool.cc:224] Handling call
0709 12:57:26.127871 (+ 15162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:26.563944 (+436073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.563981 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:26.564480 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:57:26.746182 (+181702us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:26.746239 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.746320 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:26.882381 (+136061us) raft_consensus.cc:1685] finished
0709 12:57:26.882399 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.882541 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3356,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":582363,"threads_started":2,"wal-append.queue_time_us":223319}
I20260709 12:57:26.859450  3059 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.866035  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:26.972389  1537 leader_election.cc:336] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.526s (SENT)
W20260709 12:57:27.016683  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44343us
W20260709 12:57:26.973899  3197 consensus_meta.cc:287] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.000s
I20260709 12:57:26.974292  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:26.978479  3164 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:26.964046  3215 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:26.979678  1721 raft_consensus.cc:2410] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:26.962971  1645 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:27.036056  1639 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:27.015129  1714 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:26.859499  3201 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.012499  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:27.038196  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 352303us
I20260709 12:57:27.038884  1684 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:27.038973  1535 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:27.038820  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.029217  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:26.966089  3138 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:26.973275  3169 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:27.034237  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.058396  1719 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:26.919404  1563 rpcz_store.cc:276] 0709 12:57:25.112795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.030127 (+917332us) service_pool.cc:224] Handling call
0709 12:57:26.030529 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:26.037396 (+  6867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.037457 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:26.038201 (+   744us) log.cc:844] Serialized 26 byte log entry
0709 12:57:26.418296 (+380095us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:26.786498 (+368202us) log.cc:844] Serialized 14 byte log entry
0709 12:57:26.808596 (+ 22098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.847524 (+ 38928us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:26.857073 (+  9549us) raft_consensus.cc:1685] finished
0709 12:57:26.857099 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.857243 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252,"prepare.queue_time_us":370961,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":24683,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":3282,"thread_start_us":624868,"threads_started":2,"wal-append.queue_time_us":568490}
I20260709 12:57:27.025074  1572 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:27.038857  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.066385  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.059554  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:26.967063  3130 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.140477  1641 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
W20260709 12:57:27.141441  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 75181.4us
I20260709 12:57:27.141992  1641 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.142675  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1213) took 1864 ms. Trace:
I20260709 12:57:27.142549  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:27.143146  1641 rpcz_store.cc:276] 0709 12:57:25.278087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.141308 (+1863221us) service_pool.cc:224] Handling call
0709 12:57:27.141647 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.142377 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.142621 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.026077  3199 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:57:27.146696  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 107877us
I20260709 12:57:27.152110  1643 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:57:27.153825  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 101392us
W20260709 12:57:27.154085  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 115166us
I20260709 12:57:27.155113  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:27.152123  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:27.149955  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.157750  1684 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:27.160036  1641 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.161407  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.163096  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.169724  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.170315  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:27.171169  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.171958  1719 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:27.171514  1684 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:27.169863  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1171) took 1921 ms. Trace:
I20260709 12:57:27.174260  1643 rpcz_store.cc:276] 0709 12:57:25.248341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.036570 (+1788229us) service_pool.cc:224] Handling call
0709 12:57:27.146317 (+109747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:27.169581 (+ 23264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.169795 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.176040  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.039670  3201 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:27.053731  3169 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:27.184993  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:27.185670  1717 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.032285  3197 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.189050  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.134383  3252 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.190919  1719 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:27.191239  1643 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.191846  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:27.193270  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:27.198675  1720 raft_consensus.cc:2410] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:27.177490  2985 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:27.152230  3164 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:27.202411  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.169298  3207 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.176879  3085 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:27.182652  3215 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:27.181665  3193 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.180388  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.187981  3201 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.226089  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1209) took 2675 ms. Trace:
I20260709 12:57:27.233254  1642 rpcz_store.cc:276] 0709 12:57:24.550877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.407136 (+1856259us) service_pool.cc:224] Handling call
0709 12:57:26.933067 (+525931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.933763 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.225857 (+292094us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54001932d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:27.226025 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155085184}
I20260709 12:57:27.235020  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1208) took 1782 ms. Trace:
I20260709 12:57:27.235556  1569 rpcz_store.cc:276] 0709 12:57:25.452751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.085838 (+633087us) service_pool.cc:224] Handling call
0709 12:57:26.861538 (+775700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.924910 (+ 63372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.234772 (+309862us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400132c50. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:27.234946 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773609728}
I20260709 12:57:27.229099  1716 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.189456  3192 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:27.192293  3252 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.241253  1719 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:27.241901  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet acc3fcdecc7546fe92075e15e904c331 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:57:27.242388  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.243852  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.244689  1719 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:27.245474  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:27.198500  3199 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.182703  3138 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:57:27.181169  3162 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 12:57:27.247390  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 495627us
I20260709 12:57:27.219013  3108 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.251111  1719 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:27.219058  3207 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:27.255442  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:27.237789  3193 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.224179  3085 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:27.260664  3168 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.229206  2985 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:27.264847  1717 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
W20260709 12:57:27.265453  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 110812us
I20260709 12:57:27.273293  3124 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.215610  3251 consensus_queue.cc:1059] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 12:57:27.301800  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 46409.3us
I20260709 12:57:27.225152  3164 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.295967  1646 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:27.246646  3252 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.335057  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:27.250262  3199 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.295295  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:27.338361  1719 raft_consensus.cc:606] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.338733  1719 raft_consensus.cc:614] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:27.265939  3207 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.332196  1612 leader_election.cc:400] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:27.340629  1612 leader_election.cc:403] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:57:27.341933  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 178931us
I20260709 12:57:27.296881  3085 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.344658  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.274181  3193 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.335690  1717 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:27.295091  3195 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.344902  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.345897  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.255703  3215 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:57:27.297031  3168 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:27.342731  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:27.295738  3254 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:27.327028  1638 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.351670  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.340322  3199 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.331053  3258 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.353886  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.265054  3108 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.250479  3169 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.346633  3129 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:27.366437  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:27.369830  1646 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:27.366650  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.367161  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.370635  1719 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:27.370798  1717 raft_consensus.cc:2393] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:27.344841  3158 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:27.350431  3172 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:27.372900  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:27.376876  3172 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.374986  3108 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.378075  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.377308  3172 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.378693  3164 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:27.353389  3168 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.381623  3197 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:27.381837  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.363148  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.359022  3195 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:57:27.383929  3256 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:57:27.385314  3265 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:27.385739  3265 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:27.386148  3265 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.386365  3172 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.388464  3172 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.388957  2343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 269) took 1033 ms. Trace:
I20260709 12:57:27.389355  2343 rpcz_store.cc:276] 0709 12:57:26.355619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.364721 (+  9102us) service_pool.cc:224] Handling call
0709 12:57:26.456515 (+ 91794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:26.600388 (+143873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.612990 (+ 12602us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:26.684768 (+ 71778us) log.cc:844] Serialized 26 byte log entry
0709 12:57:27.180820 (+496052us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:27.188371 (+  7551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.188476 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:27.388711 (+200235us) raft_consensus.cc:1685] finished
0709 12:57:27.388730 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:27.388903 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5284,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":14955,"thread_start_us":420125,"threads_started":1,"wal-append.queue_time_us":517550}
I20260709 12:57:27.391913  3147 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:27.392560  3147 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:27.393154  3059 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.393908  3147 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.395494  3059 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:27.402202  1713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1588) took 1445 ms (client timeout 1736 ms). Trace:
W20260709 12:57:27.402949  1713 rpcz_store.cc:269] 0709 12:57:25.956439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.962808 (+  6369us) service_pool.cc:224] Handling call
0709 12:57:27.401933 (+1439125us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400300a54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:27.402118 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274210048}
I20260709 12:57:27.359377  3165 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.420137  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.422935  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:27.423219  1718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1169) took 1779 ms (client timeout 1843 ms). Trace:
I20260709 12:57:27.363467  3258 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.423588  1713 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
W20260709 12:57:27.423702  1718 rpcz_store.cc:269] 0709 12:57:25.643805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.648319 (+  4514us) service_pool.cc:224] Handling call
0709 12:57:27.422998 (+1774679us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400084154. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:27.423142 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479456128}
I20260709 12:57:27.342401  3259 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:57:27.367090  3254 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:27.428433  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:27.425117  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.424638  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:27.437129  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 86388.8us
I20260709 12:57:27.440807  3251 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.444527  3169 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:27.429039  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 94746.7us
I20260709 12:57:27.439646  3254 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.438563  1713 raft_consensus.cc:2368] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4.
I20260709 12:57:27.441516  3274 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:27.421111  3130 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:27.423938  3165 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:27.454114  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:27.438408  3250 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:57:27.518328  3263 log.cc:927] Time spent T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:57:27.518909  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:27.522627  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.428331  3258 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:27.533708  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 168368us
W20260709 12:57:27.534236  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.534091  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:27.534576  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.534684  1718 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:27.535634  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.536288  1718 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:27.537204  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:27.537789  1718 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:27.538743  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 187156us
I20260709 12:57:27.438408  3268 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:27.543783  1612 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.733s (SENT)
I20260709 12:57:27.540762  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:27.567250  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 387995us
I20260709 12:57:27.569681  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.490218  3165 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:27.570832  1612 leader_election.cc:336] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.736s (SENT)
I20260709 12:57:27.573726  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:27.574726  1612 leader_election.cc:336] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.807s (SENT)
W20260709 12:57:27.575488  1612 leader_election.cc:336] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.817s (SENT)
I20260709 12:57:27.575681  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:27.575851  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.576246  1720 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:27.577260  1612 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.894s (SENT)
I20260709 12:57:27.577452  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1172) took 1927 ms. Trace:
W20260709 12:57:27.571902  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 400477us
I20260709 12:57:27.482184  3195 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:27.578217  1718 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:27.578399  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:27.577832  1716 rpcz_store.cc:276] 0709 12:57:25.649967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.244035 (+594068us) service_pool.cc:224] Handling call
0709 12:57:26.257233 (+ 13198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.236996 (+979763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.577240 (+340244us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54002ddf54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:27.577389 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234486528}
I20260709 12:57:27.580984  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.533816  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:27.539661  3130 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.582419  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.427187  2985 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:27.592917  3269 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:57:27.593077  3085 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.646400  3085 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:27.647050  3201 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:27.597342  2341 consensus_meta.cc:287] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.001s
I20260709 12:57:27.598382  3193 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.599867  3168 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.566937  3059 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.582319  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:27.581431  1684 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:27.632923  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 50575us
I20260709 12:57:27.582105  3138 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:27.572829  3108 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:27.597257  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:27.574888  3129 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:27.633702  3252 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.647238  3124 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:27.597204  3038 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.579929  3257 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:27.670763  1643 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.671213  1716 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:57:27.672245  1643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:57:27.589102  3271 raft_consensus.cc:3055] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:57:27.644470  3253 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.318s	user 0.010s	sys 0.000s
I20260709 12:57:27.659754  3085 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:27.677409  3108 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:57:27.675922  3271 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:27.680603  3085 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.683741  3085 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.684235  3168 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:27.685774  3193 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:27.681306  1716 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:27.637605  3259 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.695098  3259 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.695595  3259 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.633024  1720 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:27.669612  3124 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.661150  1719 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:27.650763  2341 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:27.653522  3165 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.573516  3268 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.673132  1643 raft_consensus.cc:606] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:57:27.653388  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 81694.6us
W20260709 12:57:27.676321  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 226049us
I20260709 12:57:27.717932  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:27.666356  3038 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:27.636116  3130 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.693017  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1174) took 1994 ms. Trace:
W20260709 12:57:27.694038  3174 consensus_meta.cc:287] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.766s	user 0.006s	sys 0.007s
I20260709 12:57:27.726212  3174 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.657734  3059 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:27.656736  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 75380.1us
I20260709 12:57:27.582046  3270 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.702111  3179 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:27.697399  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:27.703353  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:27.706900  1646 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:26.748891  1644 rpcz_store.cc:276] 0709 12:57:24.215367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.103139 (+1887772us) service_pool.cc:224] Handling call
0709 12:57:26.106707 (+  3568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.106951 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:26.572205 (+465254us) log.cc:844] Serialized 14 byte log entry
0709 12:57:26.746742 (+174537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:26.746801 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:26.746858 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.746944 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.747085 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":578664,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":95,"thread_start_us":620264,"threads_started":2}
I20260709 12:57:27.723536  3038 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.724866  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:27.694706  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.721560  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:27.681743  3252 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.729768  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:27.698562  1720 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:27.733052  1718 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:27.715160  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.734634  1571 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:27.738188  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:27.742502  1537 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:27.743084  3235 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:57:27.731114  3270 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.725997  1712 rpcz_store.cc:276] 0709 12:57:25.698350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.326508 (+628158us) service_pool.cc:224] Handling call
0709 12:57:26.414197 (+ 87689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:26.447098 (+ 32901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.449593 (+  2495us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:26.614379 (+164786us) log.cc:844] Serialized 26 byte log entry
0709 12:57:27.036261 (+421882us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:27.039860 (+  3599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.134221 (+ 94361us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:27.643920 (+509699us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:27.688745 (+ 44825us) raft_consensus.cc:1685] finished
0709 12:57:27.688774 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:27.692939 (+  4165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5734,"spinlock_wait_cycles":9799424,"thread_start_us":358074,"threads_started":1,"wal-append.queue_time_us":566149}
I20260709 12:57:27.742988  1720 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.750334  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.746297  3193 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:27.752106  3130 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:27.746867  3283 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:27.758437  3193 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:27.759640  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.729379  3251 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:57:27.764081  1610 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:27.765829  2312 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.772665  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:57:27.774879  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 119190us
I20260709 12:57:27.773345  2349 raft_consensus.cc:2376] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3. Re-sending same reply.
I20260709 12:57:27.780699  2348 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:27.760157  3259 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.717432  3195 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.759611  3158 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:27.746582  3275 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:27.787567  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 51370.8us
I20260709 12:57:27.788756  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.772833  3165 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.749385  3270 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.780455  3147 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:27.795857  3212 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:27.779760  3257 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:27.781446  3252 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:27.683228  3271 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.800585  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:27.761921  3272 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 12:57:27.746479  3278 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
W20260709 12:57:27.810570  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 273769us
I20260709 12:57:27.771873  3284 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:57:27.777690  3169 consensus_queue.cc:1059] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:57:27.789155  3285 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:27.801879  3201 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.799937  3215 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:27.791107  3158 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:27.804677  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:27.836910  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.808876  3268 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:27.804687  3275 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:27.812561  3273 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:27.840976  3174 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.855620  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:27.858487  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.839627  3271 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.836210  3251 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:27.843068  3212 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.868252  3282 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.868769  3282 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:27.869180  3282 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.868956  3085 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.871305  3085 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:27.833182  3277 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:57:27.873282  1716 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:27.845503  3285 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:27.873667  3212 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.875036  3259 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.874691  3285 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.875747  3212 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:27.861471  3268 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:27.877668  3199 consensus_meta.cc:287] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.004s
I20260709 12:57:27.854827  3289 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.878067  3199 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.878571  3289 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.879269  3258 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:27.876138  3207 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.003s
I20260709 12:57:27.880090  3199 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.880220  3207 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.881362  3275 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.889423  1638 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:27.882884  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:27.884598  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:27.873972  3059 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.862591  3174 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.894582  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:27.904011  1717 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:27.890600  3215 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:27.905337  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 104800us
I20260709 12:57:27.909052  1535 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:27.900591  3289 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.917387  3266 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:27.917826  3266 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:27.918275  3266 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.921101  2341 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:57:27.922211  3217 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:27.904964  3251 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:27.901813  2340 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
W20260709 12:57:27.925050  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 141431us
I20260709 12:57:27.934144  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.927141  3252 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:27.927421  3207 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:27.934543  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:27.927853  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.936524  3252 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.942569  3273 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.933146  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1169) took 2685 ms. Trace:
I20260709 12:57:27.949108  1639 rpcz_store.cc:276] 0709 12:57:25.247704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.004469 (+1756765us) service_pool.cc:224] Handling call
0709 12:57:27.035802 (+ 31333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:27.036427 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.932903 (+896476us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54001e3cd0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:27.933071 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67292032}
W20260709 12:57:27.929675  2345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 268) took 1574 ms (client timeout 1700 ms). Trace:
W20260709 12:57:27.950402  2345 rpcz_store.cc:269] 0709 12:57:26.355317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.359006 (+  3689us) service_pool.cc:224] Handling call
0709 12:57:27.929415 (+1570409us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54003f70d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:27.929566 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549204352}
I20260709 12:57:27.938148  1535 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:27.913885  3265 consensus_meta.cc:287] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 12:57:27.952724  3217 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:27.952769  3265 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.954000  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1187) took 1101 ms. Trace:
I20260709 12:57:27.954499  1718 rpcz_store.cc:276] 0709 12:57:26.853007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.658704 (+805697us) service_pool.cc:224] Handling call
0709 12:57:27.659133 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.737244 (+ 78111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.953712 (+216468us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b54002df854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:27.953928 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169258240}
I20260709 12:57:27.955861  1535 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.924538  3258 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:27.965129  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:27.958204  1535 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:27.959002  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.967303  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.968683  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:27.970535  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:28.001173  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.001654  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:28.010492  1686 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:28.011796  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 183490us
W20260709 12:57:28.010954  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52805.2us
I20260709 12:57:28.013361  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:27.903040  3174 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:27.935833  3251 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:27.898092  3158 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.024605  1718 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:28.028337  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:28.027443  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:28.009706  3265 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.011616  3197 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.925267  3124 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.018080  3268 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:28.017886  3297 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:28.019083  3254 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:28.038407  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:28.038838  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:28.021188  3258 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:28.038106  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 67642.3us
I20260709 12:57:28.009430  3059 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:57:28.029961  3217 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:57:28.133363  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:28.116475  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.135744  1718 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:28.028541  3277 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:28.019953  3212 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:57:28.024150  3085 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:57:28.019541  3270 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.044524  3195 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.036422  3305 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:28.026543  3221 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.117s
I20260709 12:57:28.142900  3258 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.045002  3294 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:28.121964  3285 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:57:28.173048  3277 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:28.178102  3138 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.178534  3268 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.030210  3280 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.144s
I20260709 12:57:28.120999  3124 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.174465  2345 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:28.182049  3254 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.044340  3169 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:28.126291  3303 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:28.141430  3165 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:28.149271  3158 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.150254  3174 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.036818  3197 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.201016  3129 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.201893  3221 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:28.218739  3129 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:28.218958  3221 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.219645  3197 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.222254  3221 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:28.044134  3215 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.151s
W20260709 12:57:28.122946  3262 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.878s	user 0.004s	sys 0.000s
I20260709 12:57:28.195236  3300 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:28.120239  3038 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.296114  3174 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:28.297190  3174 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.297720  3174 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.297967  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 233) took 8627 ms. Trace:
I20260709 12:57:28.298120  3038 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.304225  2342 raft_consensus.cc:1240] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:28.310544  3124 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:28.311450  3124 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.312091  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 100) took 1071 ms. Trace:
I20260709 12:57:28.188228  3195 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:28.175346  1566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 97) took 1604 ms (client timeout 1920 ms). Trace:
W20260709 12:57:28.313365  1566 rpcz_store.cc:269] 0709 12:57:26.570979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.587583 (+ 16604us) service_pool.cc:224] Handling call
0709 12:57:28.175039 (+1587456us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54001847d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:28.175240 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919672576}
I20260709 12:57:28.314173  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1226) took 1625 ms. Trace:
W20260709 12:57:28.274405  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 415796us
I20260709 12:57:28.315287  3195 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:28.044312  3199 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.174s
I20260709 12:57:28.316251  1537 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:28.317538  3199 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.318012  3199 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:28.275084  1567 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.321034  1567 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:28.322034  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1191) took 1348 ms. Trace:
I20260709 12:57:28.322567  1716 rpcz_store.cc:276] 0709 12:57:26.973621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.694090 (+720469us) service_pool.cc:224] Handling call
0709 12:57:27.694431 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.873722 (+179291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.321381 (+447659us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002c33d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:28.321720 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410912512}
I20260709 12:57:28.323117  1567 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.285742  3325 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:28.180388  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:28.277240  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 143881us
I20260709 12:57:28.195832  3059 consensus_queue.cc:1243] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer c05ea12435084ad9b281ed3a0a2ecebe log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:57:28.280220  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1163) took 3044 ms. Trace:
I20260709 12:57:28.325497  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:28.207136  3138 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:28.326937  3212 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:28.314618  1642 rpcz_store.cc:276] 0709 12:57:26.688572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.234279 (+545707us) service_pool.cc:224] Handling call
0709 12:57:27.252807 (+ 18528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.381171 (+128364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:27.381207 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:27.381260 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:27.381295 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.313642 (+932347us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001b62d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:28.313729 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:28.313977 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1784,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":159,"spinlock_wait_cycles":294264064}
I20260709 12:57:28.217276  3254 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.191552  3258 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:28.342094  3138 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:28.343396  3059 consensus_queue.cc:1059] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:28.343815  2342 raft_consensus.cc:1813] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Handling vote request from an unknown peer 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:28.327205  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1620) took 1061 ms. Trace:
W20260709 12:57:28.343441  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.344856  1721 rpcz_store.cc:276] 0709 12:57:27.273996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.330937 (+ 56941us) service_pool.cc:224] Handling call
0709 12:57:28.326714 (+995777us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54001761d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:28.327014 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966103296}
I20260709 12:57:28.207880  3268 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.233279  3270 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.164949  3271 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:57:28.349170  1567 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.229655  3277 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.351815  3085 raft_consensus.cc:3055] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.352250  3085 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:28.044127  3282 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.298537  1470 rpcz_store.cc:276] 0709 12:57:19.670584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.670750 (+   166us) service_pool.cc:224] Handling call
0709 12:57:28.297700 (+8626950us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:27.432981 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:27.439724 (+  6743us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:27.439762 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:57:27.439783 (+    21us) tablet.cc:662] Decoding operations
0709 12:57:27.440437 (+   654us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:27.440500 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:27.440532 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:57:27.440891 (+   359us) tablet.cc:701] Row locks acquired
0709 12:57:27.440909 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:57:27.441054 (+   145us) write_op.cc:270] Start()
0709 12:57:27.441159 (+   105us) write_op.cc:276] Timestamp: P: 1783601847441007 usec, L: 0
0709 12:57:27.441181 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:57:27.441995 (+   814us) log.cc:844] Serialized 1312 byte log entry
0709 12:57:27.647332 (+205337us) op_driver.cc:464] REPLICATION: finished
0709 12:57:27.783558 (+136226us) write_op.cc:301] APPLY: starting
0709 12:57:27.783643 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:27.786347 (+  2704us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:27.810044 (+ 23697us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:27.883969 (+ 73925us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:27.884198 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:57:27.884257 (+    59us) write_op.cc:312] APPLY: finished
0709 12:57:27.884532 (+   275us) log.cc:844] Serialized 35 byte log entry
0709 12:57:27.884744 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:27.884851 (+   107us) write_op.cc:454] Released schema lock
0709 12:57:27.884893 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:27.888448 (+  3555us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:27.888495 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":286952,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":135987,"apply.run_cpu_time_us":3201,"apply.run_wall_time_us":104842,"num_ops":3,"prepare.queue_time_us":331792,"prepare.run_cpu_time_us":3676,"prepare.run_wall_time_us":45665,"replication_time_us":206007,"thread_start_us":307811,"threads_started":2}]]}
I20260709 12:57:28.358642  3168 raft_consensus.cc:3055] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:28.359102  3168 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:28.359375  3282 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.360749  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.360970  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.046790  3289 consensus_queue.cc:1059] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 12:57:28.363795  3289 raft_consensus.cc:3055] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:28.193655  3294 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.365105  3294 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.365852  1647 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.191192  3305 raft_consensus.cc:697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:28.381639  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:28.272591  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 237359us
I20260709 12:57:28.333386  1612 leader_election.cc:400] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4.
I20260709 12:57:28.334496  3217 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:28.334750  3251 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:28.312510  1638 rpcz_store.cc:276] 0709 12:57:27.240872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.427446 (+186574us) service_pool.cc:224] Handling call
0709 12:57:28.311666 (+884220us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b54003c69d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:28.311847 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199400832}
I20260709 12:57:28.344508  2342 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:28.319669  3199 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.391239  3199 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.353670  3255 consensus_queue.cc:1059] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:57:28.392702  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.393007  3272 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:28.393627  3255 raft_consensus.cc:3055] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:28.393819  1638 raft_consensus.cc:2368] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 4.
I20260709 12:57:28.231182  3300 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.394151  3255 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:28.368031  2345 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:28.364328  3289 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:28.372071  1641 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:28.397459  1641 pending_rounds.cc:85] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 1
I20260709 12:57:28.397794  1641 pending_rounds.cc:107] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:28.398226  3251 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.398775  3251 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:28.368062  3168 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.400013  3168 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.375849  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:28.402048  3130 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.003s	sys 0.004s
W20260709 12:57:28.402544  3130 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.003s	sys 0.004s
I20260709 12:57:28.376098  3192 consensus_queue.cc:1059] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:28.372633  3164 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.329509  1640 rpcz_store.cc:276] 0709 12:57:25.235799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.001423 (+1765624us) service_pool.cc:224] Handling call
0709 12:57:27.001925 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:27.002402 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:27.002449 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:27.003126 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 12:57:27.272973 (+269847us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:27.273036 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.295345 (+ 22309us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:28.122133 (+826788us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:28.279394 (+157261us) raft_consensus.cc:1685] finished
0709 12:57:28.279455 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:28.279925 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4012,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7980,"spinlock_wait_cycles":9893120,"thread_start_us":252233,"threads_started":1,"wal-append.queue_time_us":241740}
I20260709 12:57:28.377964  3197 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.330928  3124 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.382521  3305 consensus_queue.cc:237] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.203794  3307 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:28.383977  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.431592  1647 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:28.385270  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.387235  1612 leader_election.cc:403] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:28.403595  3251 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.436066  3307 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.393392  3304 raft_consensus.cc:993] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:57:28.395571  3255 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.395494  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.307729  1469 catalog_manager.cc:5697] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 2, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.398170  1641 raft_consensus.cc:2889] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.417218  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.419983  3197 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:28.423923  1567 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:28.509168  3273 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:28.510251  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.511219  1567 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.384568  3268 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:28.433347  1646 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
W20260709 12:57:28.435439  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 102465us
I20260709 12:57:28.513844  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.514376  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:28.385700  3085 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.421648  3300 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:28.465260  3304 raft_consensus.cc:1081] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:57:28.517400  3255 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:28.523195  3085 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.523732  1640 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:28.524713  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:28.445076  3291 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.010s	sys 0.012s
I20260709 12:57:28.412096  3258 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.437664  3164 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:28.467209  3260 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.224s	user 0.006s	sys 0.000s
I20260709 12:57:28.473094  3129 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.479712  1713 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:57:28.531251  3291 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.014s	sys 0.027s
I20260709 12:57:28.480782  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:28.481061  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.482057  3251 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.482167  3259 raft_consensus.cc:3055] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:28.482919  3289 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.484198  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:28.478830  3294 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.485945  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:28.490084  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.490950  1569 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:28.491015  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.491901  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.492697  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.492841  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.493670  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.494180  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.497359  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.498571  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.547695  1638 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:28.540143  3259 raft_consensus.cc:740] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:28.548732  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.549674  1638 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:28.550061  3259 consensus_queue.cc:260] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.550834  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.551590  3259 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:28.552634  2348 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:28.503963  2342 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.541242  1646 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:28.546788  1612 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:28.547291  1712 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:28.547161  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.557235  3289 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.557435  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1176) took 2609 ms. Trace:
I20260709 12:57:28.558017  1721 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.558439  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.559060  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.560938  3162 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.561743  3164 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:28.586781  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:28.562366  2985 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.588150  2985 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:28.563737  3266 consensus_meta.cc:287] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.009s
I20260709 12:57:28.565454  3258 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.566217  1647 raft_consensus.cc:2393] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:28.588442  2345 raft_consensus.cc:2410] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:28.567122  3174 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:28.568483  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.581871  1639 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:28.583843  1564 raft_consensus.cc:2410] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:57:28.584299  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.584393  1568 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:28.585129  3162 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.586948  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.563398  1572 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:28.551622  1638 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:28.593791  1719 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.553472  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.597350  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.596040  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:28.575901  3257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.016s	sys 0.005s
I20260709 12:57:28.576018  3192 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.601691  1571 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:28.636013  1645 raft_consensus.cc:2368] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:28.638762  3326 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:28.640529  1568 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:28.640683  2343 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.632764  1469 catalog_manager.cc:5697] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 2, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.642160  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.732117  1639 raft_consensus.cc:1813] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Handling vote request from an unknown peer 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:28.733044  1639 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:28.642817  1570 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:57:28.643296  3333 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:28.735726  3333 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:28.736328  3333 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.736598  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.738657  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.740410  1572 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:57:28.643802  3129 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.644944  3162 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:28.646135  1712 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.647414  3273 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:28.650064  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.745491  1712 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:28.746379  1684 leader_election.cc:400] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 4.
I20260709 12:57:28.746732  1684 leader_election.cc:403] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:28.747131  1712 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:28.651535  3108 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:57:28.652268  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 107166us
I20260709 12:57:28.748708  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:28.654368  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.655055  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.750171  3164 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.750439  1647 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.655647  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:28.655582  3266 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.657220  2348 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:28.574805  1715 rpcz_store.cc:276] 0709 12:57:25.947572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.881159 (+933587us) service_pool.cc:224] Handling call
0709 12:57:26.881620 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:26.882038 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:26.882071 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:26.882584 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:57:27.218809 (+336225us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:27.223831 (+  5022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.238798 (+ 14967us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:28.466069 (+1227271us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:28.553006 (+ 86937us) raft_consensus.cc:1685] finished
0709 12:57:28.553040 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:28.557255 (+  4215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"spinlock_wait_cycles":6198016,"thread_start_us":306505,"threads_started":1,"wal-append.queue_time_us":360262}
I20260709 12:57:28.658979  3254 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:28.754757  3266 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.756182  3254 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:28.664825  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.662834  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.666960  2985 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.667467  1717 pending_rounds.cc:85] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 1
I20260709 12:57:28.758443  1717 pending_rounds.cc:107] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:28.758701  1644 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:57:28.759281  1644 pending_rounds.cc:85] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:57:28.759605  1644 pending_rounds.cc:107] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:57:28.759904  1644 raft_consensus.cc:2889] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.744571  3273 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.760215  3333 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.761824  1647 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:28.762480  3273 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:28.671046  1720 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.762940  3333 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:28.681268  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:28.676156  1568 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:28.681667  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:28.682821  3326 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:28.727785  1569 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:28.685009  1713 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:28.674006  3257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.016s	sys 0.005s
I20260709 12:57:28.695660  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.696427  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.730791  1721 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:28.758750  1717 raft_consensus.cc:2889] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.669014  3174 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:28.670168  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:28.763090  1712 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.671558  1714 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:57:28.769534  1566 raft_consensus.cc:2410] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:28.695605  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.776631  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:28.775306  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 289587us
I20260709 12:57:28.784399  1565 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:28.784298  1568 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.785898  1568 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:28.786222  3328 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:57:28.786486  3294 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:28.787556  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.788058  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:28.789777  3038 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.790428  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.791185  1684 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:28.791194  1571 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:28.792256  3193 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:28.792768  3193 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:28.793259  3193 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.795049  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.795699  1647 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.796124  1641 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:28.797307  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.798530  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.782178  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:28.769495  3326 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.815205  1568 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:57:28.817600  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.817988  1568 pending_rounds.cc:85] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 5
I20260709 12:57:28.817937  1647 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:28.822369  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.825096  1568 pending_rounds.cc:107] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:57:28.826120  1568 raft_consensus.cc:2889] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.827368  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.826161  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.836351  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.837370  1571 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:28.837786  1645 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.838366  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:28.822651  2985 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:28.840078  1646 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:28.843608  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.844338  1569 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:28.845376  1647 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:28.795710  3257 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:28.816205  3129 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:57:28.847146  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:28.851477  1718 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:28.853655  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 198351us
I20260709 12:57:28.822305  3162 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:57:28.853835  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.851734  1684 leader_election.cc:400] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:28.856108  1684 leader_election.cc:403] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:57:28.859200  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.852732  3158 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:28.857378  1639 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:28.867116  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:28.871356  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 122779us
I20260709 12:57:28.872073  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:28.857489  2985 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.883409  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.885387  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:28.870018  1565 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:57:28.896836  1646 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:28.896867  1716 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.887070  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:28.900775  3267 log.cc:927] Time spent T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:57:28.903967  1565 pending_rounds.cc:85] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 4
I20260709 12:57:28.904340  1565 pending_rounds.cc:107] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:57:28.904609  1565 raft_consensus.cc:2889] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.904728  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:28.906316  1646 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.886941  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:28.908911  1646 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:28.913062  1718 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:28.911593  1714 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:28.913674  2312 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:28.886260  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:28.918673  1719 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:28.918087  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.918205  1571 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:28.916343  3257 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.871109  3147 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:28.927323  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.910058  3307 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4.
I20260709 12:57:28.895845  3085 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.918195  3289 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:28.919538  1719 pending_rounds.cc:85] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 1
I20260709 12:57:28.941988  1639 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:28.943392  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:28.944243  1719 pending_rounds.cc:107] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:28.945376  1719 raft_consensus.cc:2889] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.894340  3279 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:57:28.875439  3179 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:57:28.940949  3199 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.927629  3124 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:28.875433  3291 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.950121  1646 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:28.952097  1644 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.944151  3289 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:28.955646  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 112867us
I20260709 12:57:28.916962  2985 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:28.962666  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 72822.5us
I20260709 12:57:28.964192  1639 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.963367  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:28.954910  3129 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:28.971823  1684 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:28.973704  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.961859  3289 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.954519  1567 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:28.977121  1646 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:28.984773  3129 raft_consensus.cc:697] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:28.985885  3129 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:28.992298  1684 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:28.955466  3291 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:57:28.993935  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 79352.5us
W20260709 12:57:28.998647  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 113363us
I20260709 12:57:29.001588  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.000830  1568 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:29.001551  1684 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:28.961565  3147 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.006572  1639 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:57:29.004843  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:28.979733  3270 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:57:28.997021  3197 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:28.999737  2340 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:29.019542  1639 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.998656  1640 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:29.022203  2312 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:29.019280  3291 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.024561  3268 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.009310  3124 consensus_queue.cc:1059] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:57:29.006567  3172 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:57:29.006490  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:29.020888  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:28.996232  3199 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.028138  1684 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:29.010123  3162 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.029028  3268 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:29.032998  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:29.040266  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.037086  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:29.014006  3279 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:57:29.041226  3268 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.043157  3158 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:29.043668  3158 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.045399  1571 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:29.046239  1644 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:29.051306  1639 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:29.042258  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:29.036667  3273 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.061798  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:29.020615  3193 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.060429  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.040023  3291 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.064857  1639 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:57:29.064976  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 116428us
I20260709 12:57:29.060060  3279 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:29.069769  1568 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:29.070678  1645 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:29.030982  3259 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:57:29.074213  1713 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:29.085440  2312 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:29.090274  3147 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.090909  3147 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.091065  3193 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:29.092733  3274 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:29.093173  3192 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.093338  3274 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:29.093611  1647 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:29.094031  3192 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.094515  3192 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.094894  3192 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.096632  1569 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:29.097150  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:29.099462  2985 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.100190  2985 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.101279  1568 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:29.063369  1565 raft_consensus.cc:2376] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2. Re-sending same reply.
I20260709 12:57:29.103611  2348 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:29.089201  3197 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.072935  3164 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 4.
I20260709 12:57:29.121174  1643 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:29.078239  3199 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:29.130502  1686 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.700s (SENT) [suppressed 65 similar messages]
I20260709 12:57:29.133662  3038 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:29.134609  1641 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:29.135819  3192 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.136129  3197 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.138181  3192 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:29.139319  3331 log.cc:927] Time spent T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.334s	user 0.003s	sys 0.004s
I20260709 12:57:29.085201  3273 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.150607  3273 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.121523  3108 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:29.154958  3307 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:29.155268  3108 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:57:29.160924  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 139229us
I20260709 12:57:29.175629  3085 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:29.158138  3108 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.180581  1712 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:29.180678  3108 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.183166  1639 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:57:29.186323  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.158169  1565 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:29.195063  3268 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.189755  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.199745  1568 raft_consensus.cc:1813] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Handling vote request from an unknown peer 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:29.200425  1568 raft_consensus.cc:2410] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:57:29.201215  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.201586  1571 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:29.201784  1568 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:29.202903  1571 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:29.094516  3274 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.204072  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.204770  1569 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:29.204809  3347 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:29.205704  3347 raft_consensus.cc:697] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.205909  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.206672  1566 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
W20260709 12:57:29.207566  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.207706  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:29.208437  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.208726  1563 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:29.184374  3158 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.212154  3158 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:29.213920  2985 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.209743  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.218708  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:29.202772  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.215421  1684 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:29.218942  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:29.217115  3199 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:29.224692  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 94346.1us
I20260709 12:57:29.226109  1570 raft_consensus.cc:2410] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:29.228371  1565 raft_consensus.cc:1240] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:57:29.233806  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:29.222360  3162 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:29.234244  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 192069us
I20260709 12:57:29.237130  1572 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:29.225422  1638 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:29.247267  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:29.247148  1646 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:57:29.231735  3273 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.227624  3257 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:57:29.224566  3326 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.245015  2985 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.244354  3193 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:29.246321  3164 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:29.262322  3349 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:57:29.268724  3305 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:29.271217  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 198502us
I20260709 12:57:29.272614  3124 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:29.272796  3193 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.274673  3270 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:29.275308  3193 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:29.276046  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:29.231317  3251 consensus_queue.cc:1059] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:57:29.277853  3326 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.288925  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:29.292127  1714 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:29.278985   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:57:29.279464  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.253322  3038 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.231750  3199 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:29.286896  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.287424  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:29.279100  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:29.246326  3266 consensus_queue.cc:1059] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:57:29.284963  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 66131.2us
I20260709 12:57:29.295746  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:29.303289  1570 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:29.302543  1565 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:29.296243  1712 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:29.296737  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:29.289335  3179 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:57:29.224220  3347 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.298264  3349 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.298615  3038 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:29.298794  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:29.291254  3268 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:29.299293  1644 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:29.299481  1719 raft_consensus.cc:2393] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:29.304275  1718 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:29.291000  3273 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:57:29.280848  3164 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:29.306025  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44368.7us
W20260709 12:57:29.324440  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.340876  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:29.286314  3279 raft_consensus.cc:697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:29.338786  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.280009  2985 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.326743  3349 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.294317  3289 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.328593  3038 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.329066  3147 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:29.359406  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 94849.6us
I20260709 12:57:29.343078  3193 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.345583  3164 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:29.345876  1638 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.364989  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:29.358438  3350 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.362154  3305 raft_consensus.cc:3055] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.369761  3251 raft_consensus.cc:3055] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:29.382369  3350 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.386562  3251 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:29.386794  3350 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.450634  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.451323  1719 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:29.452512  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.453290  1719 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:29.454802  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:29.455346  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.455950  1719 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:29.457146  1720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46160
I20260709 12:57:29.457814  1720 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:29.458153  1720 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.382571  3305 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:29.393241  3349 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.390865  3193 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.402966  3199 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.403359  3289 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.405170  3362 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:57:29.405656  1612 connection.cc:256] RPC call timeout handler was delayed by -1.7034945899999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 12:57:29.477916  1612 connection.cc:256] RPC call timeout handler was delayed by -1.624457179999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 12:57:29.478535  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3259568349999427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 12:57:29.478919  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1988982799999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 12:57:29.479274  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1052043659999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 12:57:29.406248  3359 consensus_queue.cc:1059] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:29.407238  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:29.407591  3342 raft_consensus.cc:3055] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.481127  1566 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.408165  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:29.411062  3257 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:29.414769  2345 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:29.417192  3279 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.418476  3274 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:29.422669  3085 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:29.391779  3162 consensus_queue.cc:1059] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:29.425144   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:29.427801  2985 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.377187  3268 consensus_queue.cc:1059] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:57:29.448675  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.495886  1713 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.445279  3251 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.449607  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:29.463580  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.468237  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:29.468571  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 73593.8us
I20260709 12:57:29.471413  1721 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:29.499661  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.474251  1572 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:29.475464  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:29.483162  3291 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.484433  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.484969  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.486104  3172 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:29.486521  3085 raft_consensus.cc:3055] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.486137  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.486295  3257 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:29.487201  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 79170.4us
I20260709 12:57:29.488359  3162 raft_consensus.cc:3055] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:29.475979  3158 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:57:29.497514  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:29.517340  2345 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:29.517398  3254 raft_consensus.cc:3055] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:29.518005  3254 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.518296  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:29.519904  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:29.520028  1535 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:29.481240  3199 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.506377  2985 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.522122  3251 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.507571  3085 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.523703  3085 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.519021  3254 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.524945  3085 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.525072  3307 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.525324  3254 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:29.525923  3307 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:29.505733  3291 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.527733  3307 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:29.529012  3291 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.528817  3305 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.530225  3305 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.530652  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:29.534829  3326 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.535842  3129 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:57:29.537493  1612 leader_election.cc:336] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.573s (SENT)
I20260709 12:57:29.507784  1718 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:29.483422  3342 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:29.481055  3362 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:29.506755  3172 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:29.502480  1719 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:29.511065  3162 raft_consensus.cc:740] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.488634  3350 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.513094  1712 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:29.514364  3345 consensus_queue.cc:1059] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:29.514359  1684 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:29.515396  3193 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:29.515775  3349 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.516011  3359 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.539469  3199 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:29.503859  1720 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.540122  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:29.566413  1721 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:29.491562  3038 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:29.574757  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 60483.3us
W20260709 12:57:29.576074  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 56151.7us
W20260709 12:57:29.576231  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 196412us
I20260709 12:57:29.543092  1566 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:29.560456  3266 raft_consensus.cc:3055] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:29.549288  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:29.540866  1713 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:29.577198  1720 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:29.579202  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:29.577539  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:29.583866  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:29.574486  3326 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:29.590548  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.578575  3168 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:29.581722  3266 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:29.599545  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:29.576313  3367 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.589599  3354 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:57:29.624310  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 86847.8us
I20260709 12:57:29.596251  3289 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.621649  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:29.599076  3193 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.633088  3193 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.633605  3193 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:29.634023  3357 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:57:29.633524  3162 consensus_queue.cc:260] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.636240  1720 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:29.599119  1638 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:29.632148  3289 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.627710  3274 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.628780  3168 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.654381  1535 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:29.637837  3354 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:29.659512  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.669597  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:29.626658  3363 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:57:29.630908  3164 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.654452  3289 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.606573  3342 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.642750  3257 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.647475  3367 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.645682  3197 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:29.686393  1721 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:29.668895  3273 raft_consensus.cc:3055] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.689460  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:29.689754  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:29.693200  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52145.3us
I20260709 12:57:29.693903  1720 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:29.695055  3251 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:29.622334  3172 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.677729  3279 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:57:29.700954  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 111629us
I20260709 12:57:29.702396  1537 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:29.704833  3162 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.726130  1537 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:29.740607  3367 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:29.742677  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 58189.2us
I20260709 12:57:29.743046  3367 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.631524  3362 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:29.748615  1612 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.719s (SENT)
I20260709 12:57:29.749311  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:29.750871  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.662391  3274 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.753242  2348 raft_consensus.cc:1240] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:29.746476  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:29.765256  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:29.695712  3273 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:29.736385  3197 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.769838  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:29.780795  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:29.782106  1641 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.755859  3366 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:29.784246  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:29.784670  3370 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:57:29.785296  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:29.756778  3347 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:29.785882  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:29.804474  1721 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:29.786976  3376 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:57:29.676604  3266 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.806694  3266 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:29.749871  3363 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.785545  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:29.797677  1644 raft_consensus.cc:3055] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:29.797676  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 49071.4us
I20260709 12:57:29.798214  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:29.766516  3350 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.782358  3362 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:29.788584  3364 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:57:29.781597  3326 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:29.813320  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 118066us
W20260709 12:57:29.834846  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 108814us
I20260709 12:57:29.836319  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:29.772835  1715 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:29.765211  3251 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 12:57:29.846560  1612 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.854s (SENT)
I20260709 12:57:29.815234  1644 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:29.843287  1640 raft_consensus.cc:2410] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:29.861410  1639 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:29.813746  3363 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:29.814877  3380 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:29.819005  3038 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:29.886773  1721 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:29.849821  3359 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.814962  3300 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.888011  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:29.842983  3347 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.790684  3168 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.875216  2343 raft_consensus.cc:2393] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:29.891260  1644 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.790524  3385 consensus_queue.cc:1059] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
W20260709 12:57:29.897902  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:29.902140  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 55629.7us
W20260709 12:57:29.905002  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:29.905881  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.908578  1644 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.883476  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:29.910292  1612 leader_election.cc:336] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.871s (SENT)
I20260709 12:57:29.912839  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:29.911581  1572 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:57:29.889382  3164 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:29.892653  3268 raft_consensus.cc:3055] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.899923  3350 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:29.900148  3251 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.884907  3279 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:57:29.923604  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.919489  3385 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:29.930799  3347 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.821033  3354 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.931859  3394 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:57:29.933096  3365 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:57:29.918622  2985 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.918879  1563 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:29.938711  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 72105.4us
I20260709 12:57:29.916903  3268 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:29.869072  3273 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.944859  1643 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:57:29.939922  3326 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.899720  3300 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.954396  3268 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.955505  3268 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.957078  3273 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:29.960975  1612 leader_election.cc:336] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.883s (SENT)
I20260709 12:57:29.961395  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:29.962435  1612 leader_election.cc:336] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.925s (SENT)
I20260709 12:57:29.962787  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:29.963788  1612 leader_election.cc:336] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.091s (SENT)
I20260709 12:57:29.964807  3038 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.928357  3350 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:29.965512  3038 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.906417  3197 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:29.966001  3350 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:29.911850  3380 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:29.973354  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50291.7us
I20260709 12:57:29.938763  3359 raft_consensus.cc:3055] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.978677  3274 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:29.979336  3361 consensus_queue.cc:1059] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 12:57:29.980615  3381 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:57:29.977376  3359 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:29.978478  1639 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:29.929760  3164 consensus_queue.cc:1059] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:57:29.986838  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.989573  3162 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:29.991364  3199 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:29.992844  3399 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:29.996801  3369 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:57:29.998993  3300 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:30.007074  1638 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:30.007570  3193 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:29.934896  3363 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:29.992237  1686 leader_election.cc:336] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.888s (SENT)
I20260709 12:57:30.040681  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:29.981257  1640 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:30.034842  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:30.036046  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 54504.8us
W20260709 12:57:30.039088  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 74496.5us
I20260709 12:57:30.043314  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:30.043614  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:30.044493  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.048375  1646 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:30.052052  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.053103  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:30.054291  3326 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:30.054665  1716 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:30.064993  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:30.066558  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.067355  1564 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:30.070236  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:30.073422  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 81224.3us
I20260709 12:57:30.077913  1572 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:30.077991  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.079623  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.080729  1566 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:30.081750  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:30.099387  1721 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:57:30.099239  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.100903  1569 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:30.102270  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:30.102820  3349 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 12:57:30.103500  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:30.104364  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:30.108597  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:30.094784  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:30.109396  1718 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:30.109937  3108 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.110375  3193 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:30.111220  1612 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.088805  3279 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.057178  3300 raft_consensus.cc:3055] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:30.044978  3385 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:57:30.057394  3305 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.116503  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.100060  1721 pending_rounds.cc:85] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 1
I20260709 12:57:30.041486  3162 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.122439  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.069247  3345 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:30.095371  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:30.127122  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:30.119344  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.123632  1569 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.089012  3085 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.073313  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:30.126076  1566 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:30.123631  1721 pending_rounds.cc:107] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:30.128752  1721 raft_consensus.cc:2889] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:30.129508  1646 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:30.131045  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:30.131170  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.131203  1716 raft_consensus.cc:2368] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3.
I20260709 12:57:30.131747  1646 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:30.133694  1564 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:30.096470  3164 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:30.134959  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.073976  3402 consensus_queue.cc:1059] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:57:30.120335  3300 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:30.139348  1713 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:30.140545  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.142534  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.142702  1535 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.143255  1646 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:30.112684  3257 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:57:30.129951  3268 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:30.203935  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.171911  1569 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:30.134503  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.120729  3359 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.136834  3108 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:30.046829  3399 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.127491  3305 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:30.181010  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.145323  1712 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:30.237808  3411 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.124s	user 0.000s	sys 0.002s
W20260709 12:57:30.233210  3377 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.335s	user 0.002s	sys 0.001s
W20260709 12:57:30.305562  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 194417us
I20260709 12:57:30.169875  1715 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:30.313115  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 99033.7us
W20260709 12:57:30.169726  3254 consensus_meta.cc:287] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.003s
I20260709 12:57:30.317029  1612 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.141227  3164 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.223762  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:30.218052  3162 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:30.287158  1641 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:30.173563  1646 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:30.337160  1641 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:57:30.156384  3371 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.421s	user 0.000s	sys 0.005s
I20260709 12:57:30.228549  3038 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.155887  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.346467  1563 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:30.346563  1640 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:30.347360  3385 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:30.348204  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1245) took 1401 ms. Trace:
I20260709 12:57:30.349814  3305 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.350381  3305 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.350461  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.350958  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.351346  1646 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:30.351809  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.352253  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.352633  1646 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:30.353029  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.353904  1646 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:30.212878  3268 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.354652  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.356127  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.342053  3402 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:30.245101  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:30.357404  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.357676  3390 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:30.357535  3402 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.358052  1565 raft_consensus.cc:2376] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4. Re-sending same reply.
I20260709 12:57:30.344110  3359 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.345613  3399 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:30.265763  3389 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.359467  3389 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.359795  3164 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:30.360085  3402 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.351351  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.361070  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.361582  3389 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.348604  1645 rpcz_store.cc:276] 0709 12:57:28.947034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:29.073147 (+126113us) service_pool.cc:224] Handling call
0709 12:57:29.088454 (+ 15307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:29.125801 (+ 37347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:29.125837 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:29.170407 (+ 44570us) log.cc:844] Serialized 26 byte log entry
0709 12:57:29.415111 (+244704us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b1800312ee0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1 00007f6a426efa0f
0709 12:57:29.603666 (+188555us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:29.603737 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:29.604987 (+  1250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:30.025705 (+420718us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:30.347993 (+322288us) raft_consensus.cc:1685] finished
0709 12:57:30.348019 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:30.348148 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5053,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":45511,"spinlock_wait_cycles":71373056,"thread_start_us":188320,"threads_started":1,"wal-append.queue_time_us":458780}
I20260709 12:57:30.361584  1569 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.364940  1564 raft_consensus.cc:2410] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:57:30.366775  3108 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.369392  1569 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:30.370710  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.371449  1565 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:57:30.371965  1565 pending_rounds.cc:85] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 1
W20260709 12:57:30.338948  3357 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:57:30.374845  1570 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:30.372320  1565 pending_rounds.cc:107] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:30.373484  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.375504  1565 raft_consensus.cc:2889] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:30.375648  1569 raft_consensus.cc:2376] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4. Re-sending same reply.
I20260709 12:57:30.375847  1568 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:30.376626  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.381016  1569 raft_consensus.cc:2410] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:57:30.351372  3300 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.382997  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.384019  1566 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:30.387208  1715 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:30.366508  3289 consensus_meta.cc:287] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.001s
I20260709 12:57:30.393826  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.397935  1644 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:30.358166  3390 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:57:30.399356  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 59752.2us
W20260709 12:57:30.399983  3266 consensus_meta.cc:287] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.002s
I20260709 12:57:30.384068  3300 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.401187  3380 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:30.365139  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.405154  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.410296  1571 raft_consensus.cc:2410] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:30.402854  1716 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:30.410751  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.413130  1565 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.411841  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:30.414443  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.416339  1537 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:30.424392  1566 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:30.426102  1720 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:30.429666  1537 leader_election.cc:400] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3.
I20260709 12:57:30.430099  1537 leader_election.cc:403] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:30.350914  3305 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:30.412575  3362 consensus_meta.cc:287] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
W20260709 12:57:30.434142  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.456275  1568 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
W20260709 12:57:30.431860  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 114957us
I20260709 12:57:30.458464  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:30.459180  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44839.3us
W20260709 12:57:30.459997  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 317344us
I20260709 12:57:30.428196  3380 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.406894  3289 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.465137  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.452994  3147 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.431823  3361 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:57:30.460775  3417 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:30.458854  3418 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:57:30.467470  3390 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.464926  3038 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.463843  3366 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3.
I20260709 12:57:30.534513  3422 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.534776  3305 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.431228  3266 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:30.535784  3266 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:30.535825  3038 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.465540  3409 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:30.538091  3038 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:30.428627  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:30.518303  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 55050.1us
I20260709 12:57:30.523039  1564 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:30.538933  1686 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.523721  3359 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.535015  3422 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.536273  3266 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:30.533747  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 70730us
I20260709 12:57:30.550379  3422 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:30.526970  1569 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
W20260709 12:57:30.555637  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:30.556216  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:30.545312  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 86920us
W20260709 12:57:29.969594  3397 consensus_queue.cc:1175] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" responder_term: 4 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:57:30.315795  3394 consensus_queue.cc:1175] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "20c9ad12e0d0435f95be2eda5b653b39" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:57:30.545563  3420 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:30.547000  3414 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:30.550410  1535 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.538226  3254 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:57:30.556741  3164 raft_consensus.cc:2764] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:57:30.567746  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.571630  3289 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.532860  3147 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.572741  2345 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:30.542748  3380 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:57:30.574785  3390 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.575088  3147 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.583256  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:30.585378  1565 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:30.584574  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:30.531045  3399 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:57:30.564518  3414 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:30.586735  3359 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:30.603868  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 141974us
I20260709 12:57:30.588807  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:30.607859  1644 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:30.585136  3422 consensus_queue.cc:1059] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:57:30.600593  3414 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:30.588691  3326 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:57:30.610797  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:30.612483  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.609848  1686 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.584426  3420 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.647792  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.602604  3108 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:30.606899  3158 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:57:30.653081  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.653165  1645 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 2: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:30.653105  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:30.659312  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:30.656021  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 46306.8us
I20260709 12:57:30.660351  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.659494  1646 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:30.661475  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.661757  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.662793  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.663763  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.664299  1566 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:30.653674  2340 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 2: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:30.666953  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:30.668751  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.668853  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.670233  1564 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:30.671128  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.667971  1644 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 1.
I20260709 12:57:30.655232  3108 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:30.673962  3108 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.667429  3305 consensus_queue.cc:1059] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:57:30.679657  3108 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.681058  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.682375  3108 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.683255  3361 raft_consensus.cc:2764] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:57:30.686327  3420 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.691738  3362 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:30.697512  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.661399  3162 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:30.665403  2341 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:30.706269  3158 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:30.700459  1647 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:30.706842  3158 raft_consensus.cc:697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:30.661543  3422 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.710246  1642 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:30.667685  3359 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.666556  3399 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.718616  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.666797  3266 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.708222  3158 consensus_queue.cc:237] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.718019  3380 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.714912  3427 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.717029  3199 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.717181  3429 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.717581  3108 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.731005  1642 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:30.718550  3422 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:30.732812  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.717269  3359 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:57:30.743598  1686 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.727818  3326 raft_consensus.cc:3055] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:30.733165  3399 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:30.749179  3428 consensus_queue.cc:1059] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:57:30.755290  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.731863  3427 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.747972  3162 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:30.740447  3199 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.742790  3108 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.760991  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.763981  3342 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.765503  3251 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:30.765926  3251 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:30.766870  3251 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.768071  3251 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:30.750334  3359 consensus_queue.cc:1243] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer c05ea12435084ad9b281ed3a0a2ecebe log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:57:30.769431  3266 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.772189  3108 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.753425  3380 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:30.772951  3199 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:30.774951  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.776140  3427 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:30.778986  3402 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:30.779551  3402 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.781669  3402 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.747871  3326 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:30.782961  3164 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:30.789678  3164 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:30.789161  3326 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.741848  3429 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.796228  3393 raft_consensus.cc:3055] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:30.796679  3393 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:30.797669  3393 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.797669  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:30.798911  3393 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:30.810539  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 49625.4us
I20260709 12:57:30.800838  3162 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.816124  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:30.812947  3108 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.822465  3162 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:30.813649  3164 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.825243  3164 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:30.825201  3162 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.828846  3108 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:30.829998  3108 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.832540  3417 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:30.835760  3429 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:30.847208  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.849021  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.849644  1571 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:30.850225  3347 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.854166  3289 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:30.803478  3422 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.821928  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:30.859222  1686 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:30.859872  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.867046  1639 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:30.861850  1645 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:57:30.868893  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.869702  1645 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:30.884347  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.885361  1645 raft_consensus.cc:2393] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:30.886379  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.887161  1645 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:30.888289  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:30.899865  1645 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.888314  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:30.890141  3413 raft_consensus.cc:3055] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:30.891624  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.902726  1639 raft_consensus.cc:2393] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:30.891978  1569 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:30.894811  1646 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:30.892001  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:30.895852  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 73449us
W20260709 12:57:30.905982  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 84134.2us
I20260709 12:57:30.906230  1721 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:30.907147  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:30.908778  1565 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:30.881271  3354 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.881558  3326 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:30.913476  1566 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:30.914592  1566 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:30.914492  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:30.919106  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 59903.9us
I20260709 12:57:30.907497  3164 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.905110  3413 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:30.919992  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:30.921633  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.921957  3179 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.927723  1647 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:30.928854  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:30.907840  3433 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:30.935544  1645 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:30.915784  3428 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.931316  1566 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.941525  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:30.942117  1647 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:30.915521  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:30.944147  3164 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:30.946209  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:30.947769  1566 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.926215  3429 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.955245  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:30.956446  1686 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.959987  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:30.940932  3433 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.971923  3433 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:30.962246  3345 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:57:30.972891  3164 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.976706  3300 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:30.976915  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:30.977248  3300 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:30.977922  2341 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:30.978259  3300 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.979281  3085 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:30.979772  3085 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:30.980242  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:30.950691  3417 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:30.981168  3417 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:30.981549  3417 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.981765  3085 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:30.982426  3085 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.982280  1686 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:30.982983  3085 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:30.983855  3399 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:30.963868  3162 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.984207  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.018893  1566 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:57:30.987133  3038 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.951208  3380 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:57:31.020965  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 101036us
I20260709 12:57:30.993616  1567 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:57:30.994230  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:30.917666  3354 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:30.997002  3441 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.533843   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:30.945068  3108 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:31.000474  1647 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
W20260709 12:57:31.004521  3424 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.355s	user 0.003s	sys 0.000s
I20260709 12:57:31.030674  1647 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:31.004457  3417 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.005985  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:31.036181  1642 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.007073  3389 raft_consensus.cc:3055] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:31.006886  3414 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:31.010181  1643 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:31.010690  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.012267  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:30.977164  3268 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:31.012946  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.011641  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:30.986451  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:31.060355  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 73995.2us
I20260709 12:57:31.061571  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:31.019481  1566 pending_rounds.cc:85] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 4
I20260709 12:57:31.062299  1566 pending_rounds.cc:107] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:57:31.062574  1566 raft_consensus.cc:2889] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:30.953612  1640 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:31.008533  3289 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:31.022483  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:30.937407  3179 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.082203  2348 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
W20260709 12:57:31.023706  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.020924  1572 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:31.013147  3172 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.027729  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:31.033128  1647 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:30.994232  3347 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:31.023305  1567 pending_rounds.cc:85] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 1
I20260709 12:57:31.087642  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:31.047024  1571 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:31.047465  1569 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:31.081226  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:31.038061  3389 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:31.020633  3399 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:31.088464  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.046413  3363 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:31.090394  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 62773.1us
I20260709 12:57:31.131038  1535 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:31.059500  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.036438  3418 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:57:31.059266  3368 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:31.045722  3446 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
W20260709 12:57:31.118748  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:31.151149  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 70003.6us
I20260709 12:57:31.119925  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.120133  1713 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:57:31.037288  3251 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:57:31.121178  3362 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:31.145911  3377 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:57:31.126343  1686 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:31.085362  3433 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:31.117138  1567 pending_rounds.cc:107] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:31.086177  3279 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.172416  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.172680  1535 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:31.173123  2341 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:31.172906  3279 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.173753  3273 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.174054  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1560) took 1075 ms. Trace:
I20260709 12:57:31.174243  3273 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.174454  1572 rpcz_store.cc:276] 0709 12:57:30.098297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:30.118070 (+ 19773us) service_pool.cc:224] Handling call
0709 12:57:30.985437 (+867367us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000d8a20. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426abdc0 00007f6a42737e18 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:31.173869 (+188432us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400042754. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:31.173966 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982862592}
I20260709 12:57:31.174832  3273 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.086500  3289 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.176056  3289 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.176677  3420 raft_consensus.cc:3055] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:31.177085  3420 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:57:31.177619  3439 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:57:31.177919  3420 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:31.178993  3437 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:57:31.179247  3420 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.036496  3441 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:31.181455  3447 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:57:31.181993  3390 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:31.182344  3441 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.182407  3390 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:30.972934  3413 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.183768  3413 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.183812  3390 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.184854  3347 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:31.162717  3199 consensus_queue.cc:1059] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:57:31.185313  3347 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:31.121272  3422 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:31.185786  3347 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.185860  3199 raft_consensus.cc:3055] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:31.186389  3199 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:31.187170  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.187915  1568 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 2: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:31.188012  3279 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:31.187202  3428 consensus_queue.cc:1175] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:57:31.188954  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.190090  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.190287  3445 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:31.190706  1568 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:31.190994  3397 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:31.185376  3390 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.191601  3397 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.193806  3397 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.187216  3199 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.195633  3199 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:31.196508  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:31.147965  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 107295us
I20260709 12:57:31.156560  1566 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:31.197767  1566 pending_rounds.cc:85] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 1
I20260709 12:57:31.198050  1566 pending_rounds.cc:107] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:31.198356  1566 raft_consensus.cc:2889] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:31.128401  3162 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:31.157492  1571 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:31.123781  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.202473  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:31.125880  3268 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.126120  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.117396  2340 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:31.162231  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:31.142256  3385 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:31.165421  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:31.164718  3433 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:31.169325  3440 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:57:31.171152  2345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 416) took 1640 ms. Trace:
I20260709 12:57:31.190423  3393 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:31.187170  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:31.148507  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.200196  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:31.202575  1642 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:31.158457  3038 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:57:31.159883  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.203316  1717 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:31.158716  3361 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:31.206634  3416 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:57:31.206957  3179 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.207588  3380 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.159934  3359 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:57:31.208550  3435 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:31.208873  3417 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:31.209215  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 47047.4us
I20260709 12:57:31.205351  3273 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.212771  3268 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:31.214618  3431 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.402s	user 0.002s	sys 0.000s
I20260709 12:57:31.215456  3162 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.217465  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.167589  1567 raft_consensus.cc:2889] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:31.234171  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.157918  3368 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:31.279527  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.285934  3345 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.127380  3085 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:31.205363  3394 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:31.300370  3380 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.226032  3433 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.220405  3385 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.314162  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:31.204490  3300 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:31.361583  3300 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.362962  3158 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:31.363948  3300 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.331164  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:31.284986  3393 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.366413  3393 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.367733  1570 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:31.367949  1565 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:31.283916  3361 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.368775  3354 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.369097  3361 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.330215  3038 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.369398  3266 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:31.369870  3266 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:31.369735  3038 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.370477  3162 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.370759  3266 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.370447  3347 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.371775  3368 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.371913  3266 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.372053  3038 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.225212  2345 rpcz_store.cc:276] 0709 12:57:29.530533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:29.553939 (+ 23406us) service_pool.cc:224] Handling call
0709 12:57:29.593518 (+ 39579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:30.573482 (+979964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:31.170849 (+597367us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54004781d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:31.171063 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216080128}
I20260709 12:57:31.372932  3347 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:31.374871  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.380939  3251 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.381108  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1280) took 1010 ms. Trace:
I20260709 12:57:31.381548  3251 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.381608  1567 rpcz_store.cc:276] 0709 12:57:30.370645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:30.375236 (+  4591us) service_pool.cc:224] Handling call
0709 12:57:30.389684 (+ 14448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:30.993265 (+603581us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54000dcb20. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426abdc0 00007f6a427361c0 00007f6a42737231 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c
0709 12:57:31.356350 (+363085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:31.381039 (+ 24689us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393080576}
I20260709 12:57:31.382685  3414 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.336874  3345 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.383606  1572 raft_consensus.cc:2410] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:57:31.384225  3450 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:57:31.384392  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.333102  3422 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:31.385154  3385 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.340322  3268 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:31.385339  3422 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.387421  3422 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.343250  3390 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.388137  3390 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.388453  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.390513  3390 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.344888  1564 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:57:31.391129  1564 pending_rounds.cc:85] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 1
I20260709 12:57:31.390913  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:31.391391  1564 pending_rounds.cc:107] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:31.391681  1564 raft_consensus.cc:2889] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:31.393282  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.346662  3380 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:31.347573  2343 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:31.205618  3399 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.326223  3416 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:31.339761  3418 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.337638  1640 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:31.406380  2312 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:31.400105  1610 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:31.398085  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:31.412457  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:31.368072  3289 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:31.415096  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 249703us
I20260709 12:57:31.409334  1610 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:31.420310  1720 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:31.418648  3428 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.423048  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:31.423290  3428 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.416750  3368 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:31.423708  1721 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.424255  3368 raft_consensus.cc:697] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:31.417616  3390 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:31.425243  3390 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.425588  3390 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.425406  3368 consensus_queue.cc:237] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.426973  3347 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:31.428834  1715 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:31.417092  3354 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:31.429975  3354 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.429901  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.430545  3354 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.430738  1641 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:31.432238  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.415884  3418 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.433337  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:31.434991  3418 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.435134  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:31.400321  3342 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.435958  3342 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.436988  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.437767  1712 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:31.440442  3417 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:31.441720  3417 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:31.442130  1564 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:31.442878  3307 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:31.443205  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.443890  1570 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:31.383589  3361 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.397571  3422 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:31.444936  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.445230  3251 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.445604  1568 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:31.446292  3361 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.447556  1638 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:31.447853  3345 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:31.448706  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 598870us
W20260709 12:57:31.448992  3305 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:57:31.449753  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.449983  2343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 295) took 1227 ms. Trace:
I20260709 12:57:31.450340  2343 rpcz_store.cc:276] 0709 12:57:30.222872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:30.223381 (+   509us) service_pool.cc:224] Handling call
0709 12:57:31.449814 (+1226433us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54005b3454. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:31.449911 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326817664}
I20260709 12:57:31.451397  1565 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:31.452015  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:31.452665  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.453298  1566 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:31.441783  1567 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:31.455076  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:31.443342  3307 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.458031  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:31.460860  3420 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.414430  3416 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.480356  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.487612  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:31.488539  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.490048  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:31.491040  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.488626  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:31.498127  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 352101us
I20260709 12:57:31.503269  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:31.504078  1714 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.507138  1721 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:31.423770  3428 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:31.479928  3443 log.cc:927] Time spent T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.513s	user 0.003s	sys 0.001s
I20260709 12:57:31.510519  1715 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:31.519938  1716 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:31.480400  3307 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.447896  3342 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.486430  3172 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.523634  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.500864  3199 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:31.527709  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:31.515990  1721 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:31.419148  3414 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:57:31.479828  3158 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:31.531500  1720 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:31.537261  3038 raft_consensus.cc:3055] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:31.537456  3158 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.537767  3038 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:31.539274  3038 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.540113  3158 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.532229  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:31.535873  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.530539  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.537981  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.527522  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.544348  1715 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 1.
I20260709 12:57:31.541189  3393 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.543404  3423 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:31.545709  3393 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.537806  1721 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:31.550408  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:31.552973  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.552973  3345 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:31.553838  3345 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:31.554198  3345 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:31.556969  3164 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:31.557389  3164 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:31.557760  3164 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.565930  3458 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:31.566560  3458 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:31.567118  3458 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.569588  3345 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.572549  3199 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:31.573014  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.573328  3199 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.575706  3416 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.506713  3268 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.444949  3422 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.480242  3347 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:57:31.525269  3380 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:31.581732  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:31.593307  1715 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.486204  3162 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:57:31.591984  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.597741  1571 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
W20260709 12:57:31.600194  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.499662  3420 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.531280  3172 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:31.598392  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 99373.5us
I20260709 12:57:31.612149  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.618235  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:31.659777  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:31.661943  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:31.670158  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:31.674544  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.682717  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:31.685947  1716 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:57:31.657840  3172 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.520802  3389 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.662838  3429 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.686403  1716 pending_rounds.cc:85] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 1
I20260709 12:57:31.666086  3257 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:31.706985  1716 pending_rounds.cc:107] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:31.715081  1716 raft_consensus.cc:2889] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:31.673270  3108 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:31.709414  1715 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:31.590453  3268 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.615204  3300 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 12:57:31.657809  3254 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 12:57:31.723944  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.739272  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.742201  1715 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:31.609678  3460 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
W20260709 12:57:31.746477  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44134us
I20260709 12:57:31.699265  3435 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:31.709237  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.691233  3354 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.762581  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.718394  3345 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.736907  3108 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:31.767788  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.790913  1716 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:31.718103  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.699438  3342 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:57:31.794400  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:31.773303  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 155147us
W20260709 12:57:31.716241  3413 consensus_meta.cc:287] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.001s
I20260709 12:57:31.706987  3326 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:57:31.713900  3362 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 12:57:31.786825  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.789798  1537 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:31.744673  3433 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.805194  1537 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:31.814054  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:31.816094  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.817312  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:31.818446  1718 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.794421  3108 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:31.816828  1643 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:31.833568  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:31.819685  3454 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 12:57:31.821779  3461 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:57:31.822993  3464 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:31.825980  3456 log.cc:927] Time spent T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:57:31.827728  3273 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.803470  1567 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:31.834175  2348 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.836704  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.837055  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:31.752377  3385 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:31.843552  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 95903.8us
I20260709 12:57:31.802955  3380 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:31.816347  3368 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:31.831657  3416 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:31.844962  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:31.831442  3409 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.858197  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.859052  1566 raft_consensus.cc:2410] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:57:31.839741  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.862637  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:31.863441  3462 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:57:31.857609  3409 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:57:31.865799  3444 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.867s	user 0.003s	sys 0.000s
W20260709 12:57:31.867208  3467 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:57:31.867671  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.872445  3172 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.878186  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:31.842286  3464 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:31.879983  1572 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:31.880419  3257 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.890829  3409 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.887616  1568 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:31.889868  1714 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:31.857717  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.897018  1570 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:31.854992  3420 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.879331  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:31.903103  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.907436  1686 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:31.906687  2345 raft_consensus.cc:2368] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5.
I20260709 12:57:31.924436  2343 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:31.925050  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:31.904918  3464 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.922878  3390 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:31.904219  3463 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:57:31.927074  3254 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.928017  3158 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.927753  3254 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:57:31.903856  3465 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:57:31.928874  3254 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:31.930613  3466 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:57:31.930922  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:31.931773  1645 raft_consensus.cc:2393] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:31.906133  3273 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.909451  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.932437  3273 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.928607  3158 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.934466  3158 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.935410  3273 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.912039  3257 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.939378  1643 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:31.939836  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.940435  1645 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:31.926397  1686 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:31.942930  1718 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:31.945307  1645 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:31.920920  2348 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:31.908075  3477 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:57:31.952770  1568 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:31.940337  1535 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:31.917712  3354 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:31.905921  3172 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:31.949046  3471 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:57:31.896678  3326 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.958988  3475 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:57:31.966315  3326 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:31.949541  1644 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:31.969174  1644 pending_rounds.cc:85] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 1
I20260709 12:57:31.969550  1644 pending_rounds.cc:107] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:31.969990  1644 raft_consensus.cc:2889] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:31.914064  3385 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.951179  3300 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:31.954370  1535 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:57:31.938637  3473 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 12:57:31.888972  3428 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.956555  1645 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:31.950029  1642 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:31.918991  3433 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.958722  3483 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.965039  3361 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:31.960167  3390 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:31.911386  3307 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:31.986526  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.989151  1644 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:31.991653  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.992312  1644 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:31.993162  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:31.993731  1644 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.994170  3254 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:31.990341  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.987210  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.997260  3254 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.997430  1645 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:31.977197  3273 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:31.977921  3326 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.027514  3307 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:31.998543  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:32.029045  1645 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:32.029304  3393 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.029982  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:31.975244  3300 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.031337  3300 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.999912  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:32.037457  1535 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:32.038216  3266 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:32.038312  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:32.038817  3266 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.039065  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:32.039256  3385 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:32.002543  3164 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.039716  1639 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:32.039945  3385 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:32.040539  3385 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.001139  1646 raft_consensus.cc:2368] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
I20260709 12:57:32.041654  1720 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:32.042443  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:32.042541  1686 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:32.005086  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:32.006791  1563 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:31.989403  3483 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.009670  3257 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.008033  3464 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.050801  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:32.051985  2340 raft_consensus.cc:2410] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:32.052757  3390 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:32.053346  3390 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.053484  3464 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:32.053892  3390 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.054128  3038 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:32.055835  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:31.997907  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:32.056602  2347 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:32.057236  2343 raft_consensus.cc:2393] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:32.058416  3464 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:32.059026  3464 raft_consensus.cc:697] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:32.059237  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:32.059526  3422 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.060956  3345 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:32.014707  1644 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:32.061573  3164 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:32.062430  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:32.063375  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:32.014957  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:32.064590  1642 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:32.065490  3289 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.065699  3172 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:32.066253  3289 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:32.066879  3289 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:32.016036  3409 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.017172  3428 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:32.018380  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:31.946928  3380 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.067955  2348 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.070004  3409 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:32.071455  1569 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:31.987129  3361 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.039326  3266 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:32.002945  3458 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.043192  1645 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:32.031354  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:32.044683  1639 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:32.044790  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:32.032505  3199 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:32.060293  3464 consensus_queue.cc:237] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.022625  3273 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:32.074131  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.106791  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:32.079066  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.107769  1715 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:32.087218  2348 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:32.091166  1719 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:32.097564  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:32.112249  1610 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:32.113003  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:32.082437  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:32.101853  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.052358  3483 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.115617  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:32.116300  1716 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:32.105909  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 61200.4us
I20260709 12:57:32.061543  3345 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.077384  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:32.122458  1714 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:32.123195  1717 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:32.124133  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.113803  1721 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:32.124765  1715 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:32.118315  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:32.119940  3359 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:32.119994  3368 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:32.106910  1718 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:32.130246  1714 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:32.130348  1713 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:32.089259  3361 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:32.088011  3162 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.088511  3305 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.131093  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:32.140977  1719 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:32.068202  3289 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.065510  3354 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:57:32.143468  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:32.147133  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.150480  1717 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:32.121685  3422 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:32.121750  3342 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:32.129752  3345 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.134305  3172 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:32.132411  3359 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.157127  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.162716  1717 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:32.180323  1717 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:32.133391  3399 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:57:32.150077  3409 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:32.186877  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 67255.5us
I20260709 12:57:32.172534  3342 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.180209  3172 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.147076  3305 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.179428  3359 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.162170  3393 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:57:32.177222  3422 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:32.146777  3162 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.181885  3387 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:32.206888  3429 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:32.208916  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:32.209677  1564 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.194331  3342 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.191890  3478 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.187698  3368 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:32.189890  3380 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:57:32.198901  3172 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:32.207538  3429 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.213099  1712 raft_consensus.cc:2410] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:32.192836  3409 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.249908  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:32.186326  3273 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.256381  3257 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:32.242645  3305 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.259922  3257 raft_consensus.cc:697] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:32.254154  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:32.234798  3368 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.261427  3257 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:32.238286  3478 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.256982  3428 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:57:32.268116  3458 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:32.269624  1564 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:32.275688  1644 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:32.268625  3422 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.287128  1719 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:32.288686  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:32.289398  1564 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:32.295096  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:32.280406  3420 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:32.305269  1564 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:32.305334  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:32.308709  1644 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:32.309887  3495 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.310536  3495 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.313608  3495 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:32.315421  3474 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.494s	user 0.001s	sys 0.002s
I20260709 12:57:32.318954  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:32.318874  3172 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:32.324569  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58424 (request call id 229) took 12090 ms (client timeout 15000 ms). Trace:
I20260709 12:57:32.327538  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:32.329133  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 175416us
I20260709 12:57:32.323909  3359 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.300184  3414 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.346822  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:32.347687  1644 raft_consensus.cc:2393] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:57:32.341861  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 220931us
I20260709 12:57:32.340422  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:32.345126  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:32.345808  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:32.350481  1537 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:32.353049  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:32.354000  1537 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:32.356824  1719 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:32.358923  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:32.293462  3483 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:57:32.292996  3326 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:57:32.360682  1535 leader_election.cc:400] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5.
I20260709 12:57:32.330621  3413 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:32.390348  1535 leader_election.cc:403] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:32.343088  3420 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:32.343289  3433 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.396692  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:32.325814  1469 rpcz_store.cc:269] 0709 12:57:20.233693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.233897 (+   204us) service_pool.cc:224] Handling call
0709 12:57:32.324453 (+12090556us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:28.993323 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:29.129429 (+136106us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:29.129488 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:57:29.129502 (+    14us) tablet.cc:662] Decoding operations
0709 12:57:29.130113 (+   611us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:29.130217 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:29.130247 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:57:29.130701 (+   454us) tablet.cc:701] Row locks acquired
0709 12:57:29.130758 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:57:29.130925 (+   167us) write_op.cc:270] Start()
0709 12:57:29.131081 (+   156us) write_op.cc:276] Timestamp: P: 1783601849130863 usec, L: 0
0709 12:57:29.131119 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:57:29.188299 (+ 57180us) log.cc:844] Serialized 929 byte log entry
0709 12:57:29.937034 (+748735us) op_driver.cc:464] REPLICATION: finished
0709 12:57:30.157322 (+220288us) write_op.cc:301] APPLY: starting
0709 12:57:30.221568 (+ 64246us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:30.221777 (+   209us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:30.222001 (+   224us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:30.222585 (+   584us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:30.222917 (+   332us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:57:30.222996 (+    79us) write_op.cc:312] APPLY: finished
0709 12:57:30.223335 (+   339us) log.cc:844] Serialized 29 byte log entry
0709 12:57:30.223584 (+   249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:30.223695 (+   111us) write_op.cc:454] Released schema lock
0709 12:57:30.223761 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:30.224193 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:30.224236 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15585,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":187605,"apply.run_cpu_time_us":2836,"apply.run_wall_time_us":86400,"num_ops":2,"prepare.queue_time_us":225029,"prepare.run_cpu_time_us":24411,"prepare.run_wall_time_us":335901,"raft.queue_time_us":277322,"raft.run_cpu_time_us":16017,"raft.run_wall_time_us":142878,"replication_time_us":792156,"thread_start_us":312714,"threads_started":4,"wal-append.queue_time_us":273484,"wal-append.run_cpu_time_us":10696,"wal-append.run_wall_time_us":1906369}]]}
I20260709 12:57:32.404793  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.406188  1712 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:32.407698  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:32.409781  3162 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:32.411355  3162 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.412953  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.363536  3393 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:32.414582  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:32.411922  3162 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:32.395342  3108 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.002s
I20260709 12:57:32.416342  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:32.385795  3478 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:32.424561  3478 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.425472  3478 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.362313  3414 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.431706  3414 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.377555  3172 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.421299  1564 raft_consensus.cc:2393] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:32.413983  1712 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:32.415269  3433 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.437899  1640 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:32.437608  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.451397  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:32.412173  3266 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.434805  3108 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.456470  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.461130  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:32.463374  1564 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:32.400686  3307 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:57:32.467621  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:32.435297  3393 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:32.413409  3158 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.438999  3495 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:32.473584  1571 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:32.449432  3409 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.467033  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.487572  3393 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:32.492750  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:32.492585  3393 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.479885  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:32.493566  1712 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.495021  1564 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:32.499404  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:32.460831  3300 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.493863  3409 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5.
I20260709 12:57:32.516230  3162 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:32.533991  3266 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.534425  3496 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:32.535002  3266 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:32.535346  3496 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.541005  3359 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.535648  3266 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.577919  3266 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:32.554594  3389 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:32.562101  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.502286  3433 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.494113  3390 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.602483  3158 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:32.610764  3361 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.520103  3108 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.625012  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1233) took 1169 ms. Trace:
I20260709 12:57:32.626617  3300 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:32.631215  3268 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:32.636077  3385 consensus_meta.cc:287] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.007s
I20260709 12:57:32.724308  3385 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:32.726157  3488 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.536s	user 0.004s	sys 0.000s
I20260709 12:57:32.727931  3385 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.644610  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:32.729991  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 85462.5us
I20260709 12:57:32.731106  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 131) took 1530 ms. Trace:
I20260709 12:57:32.648998  3478 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:32.654320  3468 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.841s	user 0.002s	sys 0.000s
I20260709 12:57:32.731580  1647 rpcz_store.cc:276] 0709 12:57:31.200953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.201126 (+   173us) service_pool.cc:224] Handling call
0709 12:57:31.218931 (+ 17805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:31.219192 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:31.397888 (+178696us) log.cc:844] Serialized 14 byte log entry
0709 12:57:32.653000 (+1255112us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:32.658196 (+  5196us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b1800364a80. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d423a
0709 12:57:32.730707 (+ 72511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:32.730777 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:32.730834 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:32.730920 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:32.731041 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":360193,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":18073,"raft.queue_time_us":195,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":133,"spinlock_wait_cycles":41172480,"thread_start_us":374774,"threads_started":2,"wal-append.queue_time_us":366463}
W20260709 12:57:32.739152  3345 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.553s	user 0.003s	sys 0.008s
I20260709 12:57:32.711900  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:32.751303  1644 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.712806  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:32.753331  1639 raft_consensus.cc:2393] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:32.715889  3417 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:32.716596  3326 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.717850  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:32.720077  3361 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:32.722088  1470 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 4, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:32.733531  3420 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:32.741148  1565 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:32.803861  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.805450  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:32.741916  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:32.742544  3429 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.742962  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:32.814327  1641 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:32.641920  1638 rpcz_store.cc:276] 0709 12:57:31.455420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.460927 (+  5507us) service_pool.cc:224] Handling call
0709 12:57:31.525241 (+ 64314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:31.691348 (+166107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:31.695836 (+  4488us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:31.764974 (+ 69138us) log.cc:844] Serialized 26 byte log entry
0709 12:57:31.855833 (+ 90859us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:31.860668 (+  4835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:32.624028 (+763360us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540020a3d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:32.624117 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:32.624204 (+    87us) raft_consensus.cc:1685] finished
0709 12:57:32.624249 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:32.624910 (+   661us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312835968,"thread_start_us":24539,"threads_started":1,"wal-append.queue_time_us":122669}
I20260709 12:57:32.710750  3496 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:32.699522  2312 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:32.748540  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53199.1us
W20260709 12:57:32.818480  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 119069us
I20260709 12:57:32.740165  3390 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:32.781862  3307 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:32.787580  3266 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.797420  1644 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:32.806291  1721 raft_consensus.cc:2368] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:32.816355  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:32.834903  1714 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:32.806598  1647 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:32.837919  1570 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:57:32.800113  1470 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 3 to 6, term changed from 3 to 4, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to <none>, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 4 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:32.821223  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:32.821897  3461 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:32.822458  3162 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.841881  1612 leader_election.cc:400] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:32.864138  1612 leader_election.cc:403] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:32.827788  3429 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:32.829689  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:32.819078  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:32.875537  1470 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 3, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:32.839154  1720 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
W20260709 12:57:32.877082  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 58108.9us
I20260709 12:57:32.874393  3420 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:32.817075  3414 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:32.839012  3342 consensus_meta.cc:287] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.598s	user 0.014s	sys 0.000s
I20260709 12:57:32.884599  1470 catalog_manager.cc:5697] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 3, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:32.783077  3345 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.888278  1470 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:32.890450  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:32.892141  1470 catalog_manager.cc:5697] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 2 to 3, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:32.841653  3461 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.798900  3326 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.793780  3417 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.882131  3147 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:32.893501  1640 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:32.942193  1721 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:57:32.907968  3461 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.863432  3307 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:32.883142  3162 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:32.925767  3502 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:32.947832  3254 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.021s	sys 0.041s
I20260709 12:57:32.943958  3147 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.908321  3429 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:32.964228  3428 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:32.985946  1538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.011s	sys 0.029s
I20260709 12:57:32.893747  3414 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:32.998198  1538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.012s	sys 0.030s
I20260709 12:57:32.997495  1720 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:57:32.988790  3254 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.021s	sys 0.042s
I20260709 12:57:32.892727  3453 consensus_queue.cc:1059] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 12:57:32.992224  3464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.075s	sys 0.131s
I20260709 12:57:32.894622  3342 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:32.976884  1563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.009s	sys 0.030s
I20260709 12:57:32.987015  3147 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:33.014397  3266 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:33.014806  3326 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:33.016676  3307 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:33.018086  3345 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:32.998404  3502 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:33.042156  3199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.018s	sys 0.047s
I20260709 12:57:33.024928  3453 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:33.027504  3162 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:33.027824  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 194984us
I20260709 12:57:32.983932  1714 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:33.029922  3417 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:33.031164  3390 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:33.032367  3414 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:33.034186  3483 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.005442  3428 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.085695  3500 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.086337  3500 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.087719  3428 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:33.074867  3199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.019s	sys 0.047s
I20260709 12:57:33.037362  3498 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:32.991345  3429 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:33.009188  3464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.075s	sys 0.132s
W20260709 12:57:33.049383  1563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.009s	sys 0.030s
I20260709 12:57:33.056900  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:33.099967  1564 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:33.084444  1567 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:33.072258  3441 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.010s	sys 0.025s
W20260709 12:57:33.129463  3441 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.011s	sys 0.025s
I20260709 12:57:33.129921  3387 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:57:33.061494  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.015s	sys 0.043s
I20260709 12:57:33.113962  3162 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.110766  3428 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.116784  3502 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:33.088900  3483 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.098482  3498 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.089432  3390 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:33.096637  3429 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:33.130771  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.015s	sys 0.043s
W20260709 12:57:33.149976  1642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.072s	sys 0.139s
W20260709 12:57:33.183656  1642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.072s	sys 0.139s
I20260709 12:57:33.187292  3038 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:57:33.131634  3085 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.016s	sys 0.051s
W20260709 12:57:33.222589  1719 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.000s	sys 0.024s
W20260709 12:57:33.223044  1719 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.000s	sys 0.024s
W20260709 12:57:33.192201  3085 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.016s	sys 0.051s
I20260709 12:57:33.191306  3500 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:33.178795  3162 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:33.182642  3428 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:33.264961  1645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.014s	sys 0.033s
W20260709 12:57:33.267096  1645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.014s	sys 0.033s
W20260709 12:57:33.236199  3347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.010s	sys 0.014s
I20260709 12:57:33.149087  3387 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:33.223095  3342 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:33.308903  1643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.004s	sys 0.021s
W20260709 12:57:33.270030  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.022s	sys 0.044s
W20260709 12:57:33.309401  1643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.004s	sys 0.021s
W20260709 12:57:33.309629  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.022s	sys 0.044s
W20260709 12:57:33.306324  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.001s	sys 0.022s
W20260709 12:57:33.314198  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.001s	sys 0.022s
W20260709 12:57:33.314968  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 966980us
W20260709 12:57:33.320259  1572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.160s	user 0.020s	sys 0.050s
W20260709 12:57:33.320787  1572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.020s	sys 0.050s
I20260709 12:57:33.325279  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:33.326241  1641 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:33.330034  1647 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:33.331749  1647 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:57:33.269860  3347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.010s	sys 0.014s
I20260709 12:57:33.341249  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:33.342157  1684 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:33.342792  1641 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:33.347640  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:33.348301  1639 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.352883  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:33.426159  1537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.009s	sys 0.017s
W20260709 12:57:33.426924  1537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.009s	sys 0.017s
W20260709 12:57:33.427441  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 1.01286e+06us
I20260709 12:57:33.436305  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:33.347137  3502 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.459317  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:33.459462  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:33.460595  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:33.460805  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 118728us
I20260709 12:57:33.461201  1647 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:33.462149  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:33.462401  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:33.463001  1647 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:33.362046  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:33.419859  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.010s	sys 0.030s
W20260709 12:57:33.478899  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.010s	sys 0.030s
I20260709 12:57:33.425711  3414 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:57:33.487409  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 58856.1us
I20260709 12:57:33.494202  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:33.488158  1647 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:33.495270  2348 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:33.494927  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:33.499186  1639 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:33.489301  1641 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:33.445173  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:33.507048  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:33.508601  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:33.509457  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 146) took 1433 ms. Trace:
I20260709 12:57:33.509616  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 145) took 1436 ms. Trace:
I20260709 12:57:33.461588  3266 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:33.493189  1638 raft_consensus.cc:1813] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Handling vote request from an unknown peer 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:57:33.488338  1712 consensus_meta.cc:287] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.967s	user 0.008s	sys 0.013s
I20260709 12:57:33.515792  1572 rpcz_store.cc:276] 0709 12:57:32.075636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.075809 (+   173us) service_pool.cc:224] Handling call
0709 12:57:32.076113 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.076456 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:32.133583 (+ 57127us) log.cc:844] Serialized 14 byte log entry
0709 12:57:33.434962 (+1301379us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:33.494077 (+ 59115us) log.cc:844] Serialized 26 byte log entry
0709 12:57:33.498295 (+  4218us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:33.498351 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.498438 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:33.509191 (+ 10753us) raft_consensus.cc:1685] finished
0709 12:57:33.509219 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.509368 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12024,"prepare.queue_time_us":60009,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5567,"raft.queue_time_us":125800,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":31454,"thread_start_us":1160759,"threads_started":1,"wal-append.queue_time_us":1339993}
I20260709 12:57:33.493003  3501 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:33.492820  3347 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:33.493347  3390 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:33.509843  3483 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:33.469298  3502 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.519042  3500 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.521966  3503 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.548986  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:33.523247  3345 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:33.503203  3414 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:33.557013  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:33.538719  3289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.022s	sys 0.044s
W20260709 12:57:33.556218  3460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.268s	user 0.019s	sys 0.031s
I20260709 12:57:33.538115  3359 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:33.559952  1714 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:33.524835  3254 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 12:57:33.555881  3461 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.581s	user 0.000s	sys 0.016s
I20260709 12:57:33.547003  3390 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.554461  1638 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:33.540207  1712 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:33.539095  3478 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:57:33.548496  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:33.560043  1684 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:33.557571  3420 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.004s
W20260709 12:57:33.558990  3289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.023s	sys 0.044s
I20260709 12:57:33.525303  3266 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:33.570695  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:33.555298  3345 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:33.565425  3460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.019s	sys 0.031s
I20260709 12:57:33.576275  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:33.557278  3503 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:33.569326  3422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.009s	sys 0.040s
I20260709 12:57:33.555464  3500 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.798867  1568 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:33.721899  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.020s	sys 0.067s
W20260709 12:57:33.805615  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.020s	sys 0.076s
W20260709 12:57:33.574934  3368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.075s	user 0.011s	sys 0.033s
I20260709 12:57:33.593442  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:33.593696  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:33.743469  1566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.404s	user 0.012s	sys 0.017s
I20260709 12:57:33.566655  3505 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.156s
W20260709 12:57:33.808532  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 929399us
W20260709 12:57:33.799873  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 239882us
I20260709 12:57:33.571506  3498 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:33.817288  1570 raft_consensus.cc:2410] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:33.817657  1564 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
W20260709 12:57:33.730058  3257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.197s	user 0.031s	sys 0.066s
W20260709 12:57:33.817166  1566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.478s	user 0.012s	sys 0.020s
I20260709 12:57:33.820578  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:33.839107  1714 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:33.568331  3359 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.715961  3483 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.825011  3347 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:33.825521  3506 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 12:57:33.825054  3518 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.802129  3345 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:33.819149  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:33.819607  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:33.826510  3510 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:57:33.865115  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:33.575440  3390 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.832327  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1252) took 1542 ms. Trace:
I20260709 12:57:33.867340  1645 rpcz_store.cc:276] 0709 12:57:32.290230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.290563 (+   333us) service_pool.cc:224] Handling call
0709 12:57:32.290913 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.291339 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.291375 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:32.291830 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:57:33.267584 (+975754us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:33.267641 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.267730 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:33.832121 (+564391us) raft_consensus.cc:1685] finished
0709 12:57:33.832139 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.832267 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1035,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":4292,"thread_start_us":930489,"threads_started":1,"wal-append.queue_time_us":1501836}
I20260709 12:57:33.869791  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:33.870579  1564 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:33.804920  3422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.010s	sys 0.040s
I20260709 12:57:33.573616  3428 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:33.716003  3085 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:33.585431  3389 consensus_meta.cc:287] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.969s	user 0.005s	sys 0.013s
I20260709 12:57:33.717223  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1691) took 1200 ms. Trace:
W20260709 12:57:33.816279  3368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.011s	sys 0.033s
W20260709 12:57:33.838083  3257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.031s	sys 0.075s
I20260709 12:57:33.808323  3420 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3.
I20260709 12:57:33.850422  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:33.851051  1718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.013s	sys 0.022s
W20260709 12:57:33.894236  1718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.013s	sys 0.022s
W20260709 12:57:33.851511  1719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.014s	sys 0.028s
W20260709 12:57:33.895291  1719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.014s	sys 0.029s
I20260709 12:57:33.896461  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1252) took 1536 ms. Trace:
W20260709 12:57:33.872262  1713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.008s	sys 0.035s
I20260709 12:57:33.872498  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:33.898708  1714 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.574954  3461 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:33.877274  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 57746.1us
I20260709 12:57:33.908087  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:33.909324  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.025s	sys 0.031s
W20260709 12:57:33.909709  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.025s	sys 0.031s
W20260709 12:57:33.900170  1713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.009s	sys 0.035s
W20260709 12:57:33.911285  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 945074us
I20260709 12:57:33.916431  1684 leader_election.cc:400] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
I20260709 12:57:33.916884  1564 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:33.917148  1684 leader_election.cc:403] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:33.918637  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:33.897040  1719 rpcz_store.cc:276] 0709 12:57:32.360032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.364759 (+  4727us) service_pool.cc:224] Handling call
0709 12:57:32.365070 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:32.365278 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:33.223636 (+858358us) log.cc:844] Serialized 14 byte log entry
0709 12:57:33.896002 (+672366us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:33.896077 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:33.896147 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.896236 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.896389 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6367,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":1504331,"threads_started":2}
I20260709 12:57:33.846159  3483 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:33.885267  3273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.272s	user 0.031s	sys 0.079s
I20260709 12:57:33.888718  1712 rpcz_store.cc:276] 0709 12:57:32.392146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.492321 (+100175us) service_pool.cc:224] Handling call
0709 12:57:33.592501 (+1100180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:33.938333  3520 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:33.932839  3422 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:33.949589  3520 consensus_queue.cc:1059] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:33.892752  3416 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.950615  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 136) took 1254 ms. Trace:
I20260709 12:57:33.950960  3416 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.881639  3511 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:33.849983  3518 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.930080  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:33.921365  3368 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:33.934015  1716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.009s	sys 0.037s
I20260709 12:57:33.935549  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1250) took 1671 ms. Trace:
I20260709 12:57:33.913058  3389 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.916319  3501 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:33.921582  3502 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:33.926723  3498 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:57:33.915094  3460 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:33.949452  3422 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:33.924175  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:33.930135  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:33.889102  3085 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.022997  1568 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:33.952726   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:57:34.253878  1565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.172s	user 0.014s	sys 0.049s
I20260709 12:57:34.007982  1714 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:33.951112  1646 rpcz_store.cc:276] 0709 12:57:32.696059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.696244 (+   185us) service_pool.cc:224] Handling call
0709 12:57:32.720062 (+ 23818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:32.954020 (+233958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.954071 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:32.954135 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:32.954181 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.950283 (+996102us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000f8cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:33.950346 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.950511 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537408768}
W20260709 12:57:34.297791  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 367758us
I20260709 12:57:33.515502  1563 rpcz_store.cc:276] 0709 12:57:32.073301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.088575 (+ 15274us) service_pool.cc:224] Handling call
0709 12:57:32.152203 (+ 63628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.193427 (+ 41224us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:32.207449 (+ 14022us) log.cc:844] Serialized 14 byte log entry
0709 12:57:33.128842 (+921393us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:33.129531 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 12:57:33.129722 (+   191us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:33.129768 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.149591 (+ 19823us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:33.509381 (+359790us) raft_consensus.cc:1685] finished
0709 12:57:33.509406 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.509550 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2433,"prepare.queue_time_us":15205,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":78,"raft.queue_time_us":119785,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":7682,"thread_start_us":887079,"threads_started":1,"wal-append.queue_time_us":1121494}
I20260709 12:57:34.320307  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:34.275085  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.286s	user 0.024s	sys 0.038s
I20260709 12:57:34.320900  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:34.321336  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.024s	sys 0.039s
W20260709 12:57:34.249993  1715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.304s	user 0.013s	sys 0.041s
W20260709 12:57:34.322888  1715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.377s	user 0.013s	sys 0.041s
W20260709 12:57:33.930939  3455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.011s	sys 0.032s
I20260709 12:57:33.922730  3497 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3.
I20260709 12:57:34.318312  1564 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
W20260709 12:57:33.959393  1571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.215s	user 0.050s	sys 0.034s
W20260709 12:57:34.318427  1565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.014s	sys 0.052s
I20260709 12:57:34.292297  3511 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:34.318501  1716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.368s	user 0.012s	sys 0.052s
W20260709 12:57:34.349624  1571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.605s	user 0.050s	sys 0.052s
W20260709 12:57:34.136915  3393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.538s	user 0.025s	sys 0.026s
W20260709 12:57:34.249923  3506 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:57:33.929523  3420 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:34.224020  3513 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
I20260709 12:57:33.933255  1567 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:57:33.940982  3273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.031s	sys 0.079s
I20260709 12:57:34.342504  3475 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:34.342700  3517 raft_consensus.cc:3055] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:57:33.935956  3172 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.015s	sys 0.031s
I20260709 12:57:34.342634  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:33.939412  3347 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:34.345198  1570 raft_consensus.cc:2410] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:33.946029  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:34.318830  1642 rpcz_store.cc:276] 0709 12:57:32.264070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.264237 (+   167us) service_pool.cc:224] Handling call
0709 12:57:32.267943 (+  3706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.268380 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.268425 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:32.268936 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:57:33.184247 (+915311us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:33.184306 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.184399 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:33.935299 (+750900us) raft_consensus.cc:1685] finished
0709 12:57:33.935331 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.935482 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":698,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":110,"spinlock_wait_cycles":5504,"thread_start_us":914826,"threads_started":1,"wal-append.queue_time_us":1300184}
I20260709 12:57:34.280819  3390 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.034747  3414 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:34.325026  3455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.385s	user 0.015s	sys 0.039s
I20260709 12:57:34.336984  3389 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.292013  3503 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:33.946893  3461 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.368842  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 152) took 1315 ms. Trace:
W20260709 12:57:34.484089  3172 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.577s	user 0.022s	sys 0.042s
W20260709 12:57:34.341096  3147 consensus_meta.cc:287] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.287s	user 0.013s	sys 0.000s
I20260709 12:57:34.325672  3500 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.504820  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 128) took 2385 ms. Trace:
I20260709 12:57:34.505530  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:34.325064  3257 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:34.337920  3441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.207s	user 0.014s	sys 0.038s
I20260709 12:57:34.505290  1717 rpcz_store.cc:276] 0709 12:57:32.119221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.185103 (+ 65882us) service_pool.cc:224] Handling call
0709 12:57:32.185482 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:32.193501 (+  8019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.193533 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:32.202798 (+  9265us) log.cc:844] Serialized 52 byte log entry
0709 12:57:33.183131 (+980333us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:33.191343 (+  8212us) log.cc:844] Serialized 14 byte log entry
0709 12:57:33.191546 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.191629 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.504544 (+1312915us) raft_consensus.cc:1685] finished
0709 12:57:34.504565 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.504730 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":643510,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":113158,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":28238,"thread_start_us":943553,"threads_started":1,"wal-append.queue_time_us":1293942}
I20260709 12:57:34.338378  3359 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:33.952164  3478 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.416s
I20260709 12:57:33.952600  3464 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.417s
I20260709 12:57:34.338164  3368 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.467013  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:34.486498  3347 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.254371  3428 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:57:34.488937  2312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.410s	user 0.036s	sys 0.060s
I20260709 12:57:34.369445  3511 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.397161  3460 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:34.367930  3393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.848s	user 0.035s	sys 0.035s
I20260709 12:57:34.496444  1565 rpcz_store.cc:276] 0709 12:57:33.053373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.053499 (+   126us) service_pool.cc:224] Handling call
0709 12:57:33.053866 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:33.054135 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:33.081491 (+ 27356us) log.cc:844] Serialized 14 byte log entry
0709 12:57:34.368309 (+1286818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:34.368380 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:34.368450 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.368575 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.368761 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":492571,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":1854,"thread_start_us":1264096,"threads_started":1}
I20260709 12:57:34.494973  3390 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:34.507234  3441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.377s	user 0.014s	sys 0.041s
I20260709 12:57:34.466039  3517 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:34.511793  1564 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:34.495325  3199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.406s	user 0.020s	sys 0.062s
I20260709 12:57:34.379491  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:34.516149  2312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.438s	user 0.036s	sys 0.060s
I20260709 12:57:34.494765  1712 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.514240  3414 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.504361  3147 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.466161  3420 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.517788  3347 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:34.519738  1720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.343s	user 0.034s	sys 0.023s
I20260709 12:57:34.496390  3273 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:34.512272  3289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.003s	sys 0.011s
I20260709 12:57:34.529377  1565 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:34.530102  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.019s	sys 0.014s
I20260709 12:57:34.512738  3483 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.515659  3534 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:34.526738  3199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.438s	user 0.021s	sys 0.062s
W20260709 12:57:34.543128  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.017s	sys 0.041s
W20260709 12:57:34.546643  1720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.370s	user 0.034s	sys 0.023s
W20260709 12:57:34.526425  3268 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.036s	sys 0.020s
I20260709 12:57:34.558105  1565 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:34.565122  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1702) took 1760 ms. Trace:
W20260709 12:57:34.553370  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.019s	sys 0.014s
W20260709 12:57:34.566716  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.018s	sys 0.042s
W20260709 12:57:34.566658  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 1.01815e+06us
W20260709 12:57:34.546466  3529 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.483s	user 0.000s	sys 0.001s
I20260709 12:57:34.540298  1563 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:34.561138  1537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.015s	sys 0.025s
I20260709 12:57:34.565557  1720 rpcz_store.cc:276] 0709 12:57:32.804452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.968829 (+164377us) service_pool.cc:224] Handling call
0709 12:57:32.993562 (+ 24733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:32.997339 (+  3777us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:33.139967 (+142628us) log.cc:844] Serialized 14 byte log entry
0709 12:57:34.564796 (+1424829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:34.564846 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:34.564904 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.564962 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.565067 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":9461,"thread_start_us":1387528,"threads_started":1}
W20260709 12:57:34.569687  1537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.015s	sys 0.025s
W20260709 12:57:34.569947  1569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.017s	sys 0.008s
W20260709 12:57:34.554829  3289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.004s	sys 0.011s
I20260709 12:57:34.561636  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1249) took 2297 ms. Trace:
W20260709 12:57:34.527105  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 1.44868e+06us
W20260709 12:57:34.570349  1569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.017s	sys 0.008s
W20260709 12:57:34.568281  1572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.010s	sys 0.029s
W20260709 12:57:34.599431  1572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.010s	sys 0.029s
I20260709 12:57:34.523705  3428 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.524190  3460 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.611820  1535 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:34.567606  3268 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.036s	sys 0.020s
I20260709 12:57:34.531169  3390 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:34.607774  3342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.075s	user 0.018s	sys 0.039s
I20260709 12:57:34.573851  1643 rpcz_store.cc:276] 0709 12:57:32.258047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.258176 (+   129us) service_pool.cc:224] Handling call
0709 12:57:32.268003 (+  9827us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:32.268420 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.268497 (+    77us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:32.277241 (+  8744us) log.cc:844] Serialized 52 byte log entry
0709 12:57:33.309928 (+1032687us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:33.310029 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.310115 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.555376 (+1245261us) raft_consensus.cc:1685] finished
0709 12:57:34.555417 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.555592 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":872,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":73728,"thread_start_us":1001462,"threads_started":1,"wal-append.queue_time_us":1595176}
I20260709 12:57:34.542016  3414 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.638687  3422 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.563122  3483 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:34.569164  3461 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:34.571799  3257 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.640044  3257 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.640508  3414 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.557866  3541 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:34.626874  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1319) took 1092 ms. Trace:
W20260709 12:57:34.631601  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.010s	sys 0.018s
I20260709 12:57:34.632400  1564 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:34.610647  3359 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:34.570037  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 878698us
I20260709 12:57:34.689123  3289 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:34.641636  1572 rpcz_store.cc:276] 0709 12:57:33.534499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.571363 (+ 36864us) service_pool.cc:224] Handling call
0709 12:57:33.571747 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:33.572049 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:33.597098 (+ 25049us) log.cc:844] Serialized 14 byte log entry
0709 12:57:34.626302 (+1029204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:34.626388 (+    86us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:34.626501 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.626603 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.626798 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15856,"prepare.queue_time_us":57099,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":440,"thread_start_us":1002465,"threads_started":1}
W20260709 12:57:34.688058  3429 consensus_meta.cc:287] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.499s	user 0.011s	sys 0.000s
W20260709 12:57:34.636677  3342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.018s	sys 0.039s
I20260709 12:57:34.608081  3393 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:57:34.557806  3273 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:34.568457  3534 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.694795  3368 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:34.695638  3526 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:57:34.571511  3517 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.650722  3518 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:34.697170  3525 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 12:57:34.698029  3531 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:57:34.696450  3524 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 12:57:34.723992  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.011s	sys 0.018s
I20260709 12:57:34.755326  3541 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:34.743101  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1325) took 1111 ms. Trace:
W20260709 12:57:34.714726  1538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.013s	sys 0.043s
I20260709 12:57:34.745186  3461 raft_consensus.cc:697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:34.704874  3199 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.764183  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:34.841271  1564 rpcz_store.cc:276] 0709 12:57:33.632099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.370648 (+738549us) service_pool.cc:224] Handling call
0709 12:57:34.712549 (+341901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:34.848709  1572 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:34.849423  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:34.753343  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 153700us
W20260709 12:57:34.755278  3519 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
I20260709 12:57:34.713276  3483 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.744697  3414 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:34.750670  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:34.755554  3500 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:34.862914  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:34.863489  1646 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:34.836344  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.024s
I20260709 12:57:34.756003  3289 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:57:34.839699  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 989300us
W20260709 12:57:34.865620  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.005s	sys 0.024s
W20260709 12:57:34.867558  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 547289us
I20260709 12:57:34.642448  3085 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:34.843964  1538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.047s
I20260709 12:57:34.851389  3517 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.821877  3368 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:57:34.758687  3359 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.846753  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1686) took 2479 ms. Trace:
I20260709 12:57:34.850026  1564 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.852738  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:34.850579  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:34.855113  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:34.845360  3546 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:34.855154  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:34.758173  3429 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.914727  1572 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:34.862324  3518 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:34.860308  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:34.860942  1643 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:34.868503  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:34.846357  3162 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:34.870908  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:34.935667  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:34.652685  3522 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.327s	user 0.000s	sys 0.003s
W20260709 12:57:34.868072  2314 connection.cc:256] RPC call timeout handler was delayed by -1.244406334999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 12:57:34.873214  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:34.944693  3393 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.844688  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:34.945176  3393 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.946054  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:34.947105  3393 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.947242  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:34.947618  3393 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:34.947789  1720 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:34.948050  3393 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.887207  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1254) took 2520 ms. Trace:
I20260709 12:57:34.856774  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:34.859635  3147 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.877589  3420 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.949363  3420 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.948786  1718 rpcz_store.cc:276] 0709 12:57:32.366822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.563452 (+196630us) service_pool.cc:224] Handling call
0709 12:57:32.563903 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.818146 (+254243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.818188 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:32.835027 (+ 16839us) log.cc:844] Serialized 26 byte log entry
0709 12:57:33.894801 (+1059774us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:33.894875 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.894971 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.886968 (+991997us) raft_consensus.cc:1685] finished
0709 12:57:34.887009 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.887141 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253788,"raft.queue_time_us":259303,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":107,"thread_start_us":987071,"threads_started":1,"wal-append.queue_time_us":1687346}
I20260709 12:57:34.950021  3420 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.951160  1718 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:34.952018  3420 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.952144  3428 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:34.952582  3420 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:34.948609  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:34.953619  3273 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.954114  3429 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.954808  3257 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.955482  3461 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:34.956496  3535 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:57:34.958081  3390 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:34.959965  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 147) took 2867 ms. Trace:
I20260709 12:57:34.959558  3541 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.963595  3518 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.965690  3534 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:34.966166  3518 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:34.967682  3359 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:34.967828  3556 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.968577  3556 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.922888  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:34.970333  1640 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.971133  3556 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:34.855947  3199 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.973953  3199 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:34.862126  3414 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:34.862509  3500 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.871757  1563 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:34.859808  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:34.916597  1717 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:34.920951  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:34.924510  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 73993us
I20260709 12:57:34.983354  1572 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:34.983433  2314 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:34.921499  3546 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:34.937347  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 68956.1us
I20260709 12:57:34.939023  3342 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:34.941331  3542 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:57:34.942221  3544 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:57:34.942523  2313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.013s
I20260709 12:57:34.942862  3511 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:34.887024  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:34.960484  1566 rpcz_store.cc:276] 0709 12:57:32.092995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.093198 (+   203us) service_pool.cc:224] Handling call
0709 12:57:32.093566 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.093931 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.093969 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:32.104240 (+ 10271us) log.cc:844] Serialized 26 byte log entry
0709 12:57:32.338995 (+234755us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b18001ac920. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1 00007f6a426efa0f
0709 12:57:33.838454 (+1499459us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:33.838499 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.838586 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.959608 (+1121022us) raft_consensus.cc:1685] finished
0709 12:57:34.959637 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.959872 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5019,"raft.queue_time_us":11941,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":21157,"spinlock_wait_cycles":2644608,"thread_start_us":1499180,"threads_started":1,"wal-append.queue_time_us":2207307}
I20260709 12:57:34.976684  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1697) took 2173 ms. Trace:
I20260709 12:57:34.859045  3483 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:35.093183  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:35.096498  1717 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.928604  1564 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:35.018877  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:35.053248  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.094758  1716 rpcz_store.cc:276] 0709 12:57:32.803017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.806591 (+  3574us) service_pool.cc:224] Handling call
0709 12:57:32.806961 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:32.831989 (+ 25028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.832033 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:32.883845 (+ 51812us) log.cc:844] Serialized 52 byte log entry
0709 12:57:34.349313 (+1465468us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:34.349368 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.349444 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.976343 (+626899us) raft_consensus.cc:1685] finished
0709 12:57:34.976384 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.976582 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24570,"raft.queue_time_us":24683,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":6416,"thread_start_us":1398299,"threads_started":1,"wal-append.queue_time_us":1712970}
I20260709 12:57:34.967701  3460 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:35.049501  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.069612  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:35.069834  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 86470.2us
I20260709 12:57:35.099874  1647 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:35.048207  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.100870  1641 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:35.048633  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.073633  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:34.892705  1715 rpcz_store.cc:276] 0709 12:57:32.367626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.615269 (+247643us) service_pool.cc:224] Handling call
0709 12:57:32.615685 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.813110 (+197425us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:57:32.813163 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:32.944851 (+131688us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b2c000f13c8. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4102da11 00007f6a4103d372 00007f6a4276fa01 00007f6a4273443a 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2
0709 12:57:32.945274 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:57:34.323966 (+1378692us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:34.324008 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.339129 (+ 15121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.839696 (+500567us) raft_consensus.cc:1685] finished
0709 12:57:34.839728 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.846683 (+  6955us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182675,"raft.queue_time_us":183081,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":134,"spinlock_wait_cycles":4786048,"thread_start_us":1378288,"threads_started":1,"wal-append.queue_time_us":1698680}
I20260709 12:57:35.074117  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:35.101820  1643 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:34.983750  3500 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:35.094270  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:35.052441  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:35.104373  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:35.105558  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:34.980252  3199 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:35.098311  1639 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:35.049090  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:35.073028  2313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.008s	sys 0.014s
I20260709 12:57:35.112528  1642 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
W20260709 12:57:35.047236  3547 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:57:35.098932  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:35.075592  3455 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:35.093519  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:35.117441  1718 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:35.117393  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:35.117957  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:35.049715  3414 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:34.975752  3289 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:35.120344  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:35.121908  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:35.103883  1566 raft_consensus.cc:2410] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:34.980020  1646 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:57:35.142513  1537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.626s (SENT) [suppressed 16 similar messages]
I20260709 12:57:35.073045  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:35.114656  1716 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:35.146236  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.146596  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:35.146806  1647 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:35.102329  1714 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.115888  1715 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:35.118714  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:34.997596  3162 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.116344  3556 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:35.152200  3556 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:35.152606  1716 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:35.152740  3556 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:35.153903  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:35.154371  1716 raft_consensus.cc:606] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:35.099951  1638 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:35.103540  1645 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:35.097900  3548 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.098179  3550 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.157414  3548 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:35.143564  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.158414  1646 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:35.123751  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1334) took 1433 ms. Trace:
I20260709 12:57:35.104833  3555 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:35.120361  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:35.145010  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.163465  1642 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:35.120364  3289 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.145306  1535 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:35.148399  1715 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:35.149242  2344 raft_consensus.cc:2368] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:35.149588  3414 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.150573  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:35.151360  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:35.095659  3359 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:35.103271  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:35.172782  3359 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:35.173321  3511 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:35.175691  3359 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:35.158918  1565 rpcz_store.cc:276] 0709 12:57:33.690247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.565411 (+875164us) service_pool.cc:224] Handling call
0709 12:57:34.565719 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.565955 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:34.846077 (+280122us) log.cc:844] Serialized 14 byte log entry
0709 12:57:35.123004 (+276927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:35.123125 (+   121us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:35.123239 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:35.123374 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:35.123628 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28645,"prepare.queue_time_us":485603,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":70115,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":483352,"threads_started":3,"wal-append.queue_time_us":253461}
I20260709 12:57:35.177078  3483 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:35.177222  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:35.177729  3345 consensus_meta.cc:287] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.300s	user 0.011s	sys 0.000s
I20260709 12:57:35.178350  3546 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:35.178187  3345 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:35.178673  1565 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:35.179270  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1335) took 1488 ms. Trace:
I20260709 12:57:35.179330  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:35.179615  1565 rpcz_store.cc:276] 0709 12:57:33.690657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.178089 (+1487432us) service_pool.cc:224] Handling call
0709 12:57:35.178366 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:35.179040 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:35.179221 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:35.180490  1720 raft_consensus.cc:2410] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:35.160828  1572 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.157549  3550 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:35.165095  1715 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:35.192817  1715 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.116947  3199 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:35.167148  1714 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:35.119308  1563 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:35.168298  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:35.181221  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:35.182909  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:35.183964  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:35.184377  1712 consensus_meta.cc:287] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.639s	user 0.003s	sys 0.007s
I20260709 12:57:35.203365  1712 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:35.203931  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1262) took 1665 ms. Trace:
I20260709 12:57:35.204355  1712 rpcz_store.cc:276] 0709 12:57:33.538348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.945764 (+407416us) service_pool.cc:224] Handling call
0709 12:57:35.203863 (+1258099us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:35.185555  3347 consensus_meta.cc:287] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.000s
I20260709 12:57:35.205668  3347 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:35.206712  3568 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:35.185686  3387 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:35.170735  3565 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:35.233783  3565 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:35.234519  3565 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:35.188890  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.235541  1647 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:35.236512  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.237617  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.238543  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.239035  1647 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:35.239738  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.240461  1647 raft_consensus.cc:2410] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:35.176297  1640 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:35.204217  1563 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:57:35.159809  3569 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:57:35.241470  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.242058  1640 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:35.194703  3483 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:35.207229  3568 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:35.242636  3483 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:35.243067  3483 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.243309  1640 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:35.184386  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:35.202590  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:35.217181  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:35.233873  3347 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:35.161872  3162 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:35.166663  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:35.248088  3162 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:35.245672  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:35.251331  2343 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:35.190917  3345 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:35.252413  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:35.254093  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:35.258966  1717 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:35.261660  3550 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:35.263236  3414 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.263252  3500 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:35.267030  3500 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:35.267868  2346 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:35.271538  1719 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:35.271849  1715 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:57:35.272804  1715 pending_rounds.cc:85] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 5
I20260709 12:57:35.273280  1715 pending_rounds.cc:107] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:57:35.273691  1715 raft_consensus.cc:2889] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:35.291198  3557 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:35.293021  3557 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:35.293762  3557 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:36.102260  3557 consensus_meta.cc:287] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.805s	user 0.004s	sys 0.008s
I20260709 12:57:36.103179  3557 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:36.107934  3557 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:36.296557  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800035100 after lost signal to thread 434
W20260709 12:57:36.404539  3556 consensus_meta.cc:287] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.251s	user 0.010s	sys 0.001s
I20260709 12:57:36.405323  3556 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:36.408034  3556 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:36.212497  3565 consensus_meta.cc:287] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.977s	user 0.010s	sys 0.001s
I20260709 12:57:36.452602  3565 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:36.455260  3565 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:37.723057  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1303) took 2674 ms (client timeout 3218 ms). Trace:
W20260709 12:57:37.723572  1647 rpcz_store.cc:269] 0709 12:57:35.048988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.239530 (+190542us) service_pool.cc:224] Handling call
0709 12:57:37.722925 (+2483395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.734050  1647 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:37.734717  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1313) took 2590 ms. Trace:
W20260709 12:57:37.735188  3528 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 3.100s	user 0.036s	sys 0.061s
I20260709 12:57:37.735031  1647 rpcz_store.cc:276] 0709 12:57:35.144806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.724408 (+2579602us) service_pool.cc:224] Handling call
0709 12:57:37.726400 (+  1992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.734432 (+  8032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.734661 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.739187  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1320) took 4170 ms. Trace:
I20260709 12:57:37.739675  1567 rpcz_store.cc:276] 0709 12:57:33.568853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.569179 (+   326us) service_pool.cc:224] Handling call
0709 12:57:33.692808 (+123629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.474539 (+781731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.738912 (+3264373us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002bfcd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:37.739115 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375651712}
I20260709 12:57:37.743098  3199 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:37.761474  1684 connection.cc:256] RPC call timeout handler was delayed by -3.063752631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 12:57:37.762053  1684 connection.cc:256] RPC call timeout handler was delayed by -2.7577526310000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260709 12:57:37.762601  1684 connection.cc:256] RPC call timeout handler was delayed by -2.6713526309999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 12:57:37.762965  1684 connection.cc:256] RPC call timeout handler was delayed by -2.6281526309999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 12:57:37.763302  1684 connection.cc:256] RPC call timeout handler was delayed by -2.6119526310000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 12:57:37.763754  1684 connection.cc:256] RPC call timeout handler was delayed by -2.5354526309999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:57:37.764166  1684 connection.cc:256] RPC call timeout handler was delayed by -2.4859526309999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 12:57:37.764544  1684 connection.cc:256] RPC call timeout handler was delayed by -1.9387526309999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2775s for a response
W20260709 12:57:37.764912  1684 connection.cc:256] RPC call timeout handler was delayed by -1.8188987099999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 12:57:37.765252  1684 connection.cc:256] RPC call timeout handler was delayed by -1.7272526309999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.301s for a response
W20260709 12:57:37.765563  1684 connection.cc:256] RPC call timeout handler was delayed by -1.5047987099999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2574s for a response
I20260709 12:57:37.767984  3162 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.768723  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:37.768535  3162 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:37.770578  3162 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:37.770483  3085 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.770915  3579 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:37.771255  3085 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.771471  3579 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:37.773766  3085 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:37.774210  3579 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:37.774740  3579 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:37.775204  3579 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.777529  3579 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:37.778060  3085 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.778132  3579 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.778739  3085 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.779706  3347 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.780035  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.780500  3347 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.778713  3162 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:37.781507  3085 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:37.782665  3085 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:37.782411  3162 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:37.783012  3347 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:37.783245  3085 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:37.784773  3162 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:37.785071  3498 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:37.785852  3498 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:37.785305  3162 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:37.787052  3162 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.787523  3162 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:37.789626  3085 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:37.790135  1717 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1278) took 2572 ms (client timeout 2002 ms). Trace:
W20260709 12:57:37.792030  1717 rpcz_store.cc:269] 0709 12:57:35.217769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.789939 (+2572170us) service_pool.cc:211] Skipping call since client already timed out
0709 12:57:37.790055 (+   116us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:57:37.791222  1684 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.793376  1684 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.794612  1684 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:37.785283  3579 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:37.799252  3085 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:37.801641  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:37.802172  3579 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:37.802280  1647 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:37.803601  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:37.806234  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.806998  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:37.812904  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:37.813441  1641 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:37.814147  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:37.814445  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1270) took 2929 ms (client timeout 3218 ms). Trace:
I20260709 12:57:37.814610  1641 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:37.814819  1720 rpcz_store.cc:269] 0709 12:57:34.885021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.948384 (+ 63363us) service_pool.cc:224] Handling call
0709 12:57:37.814235 (+2865851us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54000d20d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:37.814367 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520952704}
I20260709 12:57:35.242264  1563 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:37.819463  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1593) took 3174 ms. Trace:
I20260709 12:57:37.819861  1563 rpcz_store.cc:276] 0709 12:57:34.645223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.241585 (+596362us) service_pool.cc:224] Handling call
0709 12:57:35.241916 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.819152 (+2577236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.819393 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.795895  3347 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:37.823271  3475 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:37.823776  3475 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:37.824529  3581 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:37.828477  3521 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 3.485s	user 0.008s	sys 0.036s
I20260709 12:57:37.808223  3162 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.838485  3580 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.839447  1647 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:37.841933  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:37.839203  3580 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.841952  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 129) took 5041 ms. Trace:
I20260709 12:57:37.846755  3347 raft_consensus.cc:697] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:37.847080  1641 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:37.848219  3347 consensus_queue.cc:237] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.849007  3162 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:37.843716  1647 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:37.849961  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:37.850571  1645 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:37.851003  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:37.851953  1647 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:37.852913  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:37.853929  1647 raft_consensus.cc:2410] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:57:37.854929   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000fe40 after lost signal to thread 2314
I20260709 12:57:37.844453  1713 rpcz_store.cc:276] 0709 12:57:32.801042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.801380 (+   338us) service_pool.cc:224] Handling call
0709 12:57:32.801943 (+   563us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:32.802381 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.802423 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:32.803074 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 12:57:33.910737 (+1107663us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:33.937186 (+ 26449us) log.cc:844] Serialized 14 byte log entry
0709 12:57:37.809499 (+3872313us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b180011b780. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287 00007f6a4274f208
0709 12:57:37.841535 (+ 32036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.841623 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:37.841664 (+    41us) raft_consensus.cc:1685] finished
0709 12:57:37.841758 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.841873 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15488,"prepare.queue_time_us":26155,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":14755,"raft.queue_time_us":405891,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":13262,"spinlock_wait_cycles":14729600,"thread_start_us":1138971,"threads_started":2,"wal-append.queue_time_us":1117825,"wal-append.run_cpu_time_us":4118,"wal-append.run_wall_time_us":1832008}
W20260709 12:57:37.855446   436 kernel_stack_watchdog.cc:198] Thread 2314 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 1751ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:57:37.857978  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:37.860256  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:37.861681  1645 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:37.862295  1641 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:37.857600  3475 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.863302  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:37.863926  3085 raft_consensus.cc:697] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:37.864235  1641 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:37.864403  3538 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 3.015s	user 0.015s	sys 0.021s
I20260709 12:57:37.863453  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:37.865240  3475 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:37.861873  3038 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:37.865943  3038 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:37.861518  3582 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:37.865389  1645 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:37.867892  1647 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:37.868480  3579 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.866482  3085 consensus_queue.cc:237] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.869117  3579 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:37.871770  3579 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:37.865145  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:37.874006  1641 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:37.880295  1645 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:37.867074  3582 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.885074  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1307) took 2787 ms. Trace:
I20260709 12:57:37.885653  1640 rpcz_store.cc:276] 0709 12:57:35.097222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.244221 (+146999us) service_pool.cc:224] Handling call
0709 12:57:37.802453 (+2558232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:37.802784 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:37.802814 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:37.803328 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:57:37.862707 (+ 59379us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:37.884505 (+ 21798us) log.cc:844] Serialized 14 byte log entry
0709 12:57:37.884752 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.884830 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:37.884870 (+    40us) raft_consensus.cc:1685] finished
0709 12:57:37.884885 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.885014 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45051,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":77623,"threads_started":2,"wal-append.queue_time_us":65267}
I20260709 12:57:37.893560  1640 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 12:57:37.895109  1572 consensus_meta.cc:287] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 2.714s	user 0.014s	sys 0.019s
I20260709 12:57:37.895346  3581 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:37.895483  1572 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:37.896859  3580 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:37.899605  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 93453.3us
I20260709 12:57:37.902916  1684 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.904101  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.905419  3588 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:37.905891  3588 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:37.906275  3588 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:37.910601  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1314) took 5548 ms. Trace:
I20260709 12:57:37.888597  3582 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:37.913084  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.914042  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:37.914354  2346 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 301) took 2803 ms (client timeout 2210 ms). Trace:
I20260709 12:57:37.914784  3581 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:37.914845  2346 rpcz_store.cc:269] 0709 12:57:35.110570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.194129 (+ 83559us) service_pool.cc:224] Handling call
0709 12:57:37.914093 (+2719964us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b54004cac54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:37.914196 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51007360}
I20260709 12:57:37.915594  3581 raft_consensus.cc:697] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:37.917026  3581 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.918217  3585 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:37.918952  2346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 304) took 2756 ms. Trace:
W20260709 12:57:37.920203  3540 log.cc:927] Time spent T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 3.967s	user 0.005s	sys 0.035s
I20260709 12:57:37.921350  1642 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 3: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:57:37.918386  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08000357e0 after lost signal to thread 1504
I20260709 12:57:37.911056  1571 rpcz_store.cc:276] 0709 12:57:32.362269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.645066 (+282797us) service_pool.cc:224] Handling call
0709 12:57:32.645828 (+   762us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:32.646540 (+   712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.646585 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:32.743872 (+ 97287us) log.cc:844] Serialized 532 byte log entry
0709 12:57:34.350671 (+1606799us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:34.350724 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.350806 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:37.734455 (+3383649us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:37.910142 (+175687us) raft_consensus.cc:1685] finished
0709 12:57:37.910165 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.910491 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9140,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":157,"spinlock_wait_cycles":29203840,"thread_start_us":1606231,"threads_started":1,"wal-append.queue_time_us":1811641}
I20260709 12:57:37.922447  2346 rpcz_store.cc:276] 0709 12:57:35.162157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.916245 (+2754088us) service_pool.cc:224] Handling call
0709 12:57:37.918867 (+  2622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.922959  1684 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:37.924177  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1305) took 2874 ms (client timeout 2011 ms). Trace:
W20260709 12:57:37.929890  1642 rpcz_store.cc:269] 0709 12:57:35.049562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.164481 (+114919us) service_pool.cc:224] Handling call
0709 12:57:37.924063 (+2759582us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17664}
I20260709 12:57:37.928864  3347 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:37.931380  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:37.931484  3347 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.932209  3347 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:37.932466  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.933430  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.936044  3586 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:37.936555  3586 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.937157  3586 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:37.937433  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:37.938189  1642 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:37.939968  3584 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:37.940728  3584 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.941259  3584 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:37.941453  3038 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.919011  3585 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:37.950495  3038 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:37.944689  3585 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:37.953312  2345 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 1 LEARNER]: Advancing to term 3
I20260709 12:57:37.971390  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1273) took 2868 ms. Trace:
I20260709 12:57:37.971920  1715 rpcz_store.cc:276] 0709 12:57:35.103738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.115567 (+ 11829us) service_pool.cc:224] Handling call
0709 12:57:35.115801 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.971048 (+2855247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.971320 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.982172  1642 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:37.983455  2348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 440) took 3577 ms. Trace:
I20260709 12:57:37.986826  3581 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:37.988888  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:37.989750  3581 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:37.990252  3581 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:37.983896  2348 rpcz_store.cc:276] 0709 12:57:34.402483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.512851 (+110368us) service_pool.cc:224] Handling call
0709 12:57:34.513279 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.513729 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:34.853750 (+340021us) log.cc:844] Serialized 14 byte log entry
0709 12:57:37.979447 (+3125697us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b1800339b20. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a3f649a40 00007f6a3f6444e4 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287 00007f6a4274f208
0709 12:57:37.979604 (+   157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:37.979664 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:37.979737 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.979832 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.979987 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78662,"prepare.queue_time_us":464445,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":101509,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":4668,"spinlock_wait_cycles":28301568,"thread_start_us":449329,"threads_started":2,"wal-append.queue_time_us":260673,"wal-append.run_cpu_time_us":1414,"wal-append.run_wall_time_us":1116790}
I20260709 12:57:37.994189  3085 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:38.007807  3085 raft_consensus.cc:697] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:37.962935  3588 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.023665  3085 consensus_queue.cc:237] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.024861  1644 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:38.025800  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:38.026623  1644 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:38.011184  3587 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:38.062374  1642 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:57:38.067344  3347 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.069511  3389 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:38.071650  3586 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:37.999588  3581 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.062045  3582 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.084280  3581 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:38.073493  3548 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:38.086959  1686 connection.cc:256] RPC call timeout handler was delayed by -4.4773222529999543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260709 12:57:38.113886  1642 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:38.117091  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 83198.4us
I20260709 12:57:38.122083  3582 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:38.122332  3584 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.124918  3586 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:38.128897  2347 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
W20260709 12:57:38.129725  2347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 301) took 3054 ms (client timeout 1770 ms). Trace:
I20260709 12:57:38.134680  1642 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:38.130301  2347 rpcz_store.cc:269] 0709 12:57:35.075701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.075939 (+   238us) service_pool.cc:224] Handling call
0709 12:57:38.025653 (+2949714us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b58001b4b98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:38.129629 (+103976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8774400}
I20260709 12:57:38.125861  3586 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:38.126487  3393 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:38.154794  3347 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:38.155654  3347 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.149034  3587 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:57:38.158389  3603 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:57:38.142298  3586 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:38.159574  1570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1331) took 4525 ms (client timeout 1961 ms). Trace:
I20260709 12:57:38.160125  3587 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:38.160998  3597 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:57:38.167011  1570 rpcz_store.cc:269] 0709 12:57:33.634091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.843361 (+209270us) service_pool.cc:224] Handling call
0709 12:57:38.159262 (+4315901us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400094054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:38.159424 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101593472}
I20260709 12:57:38.162221  3586 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:38.153203  3085 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:38.163069  3569 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:38.163151  3606 consensus_queue.cc:1059] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:38.161758  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 2.99324e+06us
I20260709 12:57:38.170531  3085 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:38.170089  3569 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.177297  3569 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:38.172104  3588 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:38.151778  3584 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:38.181629  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1324) took 4609 ms. Trace:
I20260709 12:57:38.171336  1535 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:38.156317  3347 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:38.187489  2349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 445) took 3091 ms. Trace:
I20260709 12:57:38.191644  3266 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:38.182339  1569 rpcz_store.cc:276] 0709 12:57:33.572552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.631572 (+ 59020us) service_pool.cc:224] Handling call
0709 12:57:33.730566 (+ 98994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:34.599379 (+868813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:34.599407 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:34.599937 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:57:34.852625 (+252688us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:34.852676 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:38.181047 (+3328371us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400043654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:38.181121 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:38.181185 (+    64us) raft_consensus.cc:1685] finished
0709 12:57:38.181203 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:38.181535 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":191208,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":104190,"spinlock_wait_cycles":255953152,"thread_start_us":1009272,"threads_started":2,"wal-append.queue_time_us":382063,"wal-append.run_cpu_time_us":1958,"wal-append.run_wall_time_us":1140179}
W20260709 12:57:38.199743  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 49096.1us
I20260709 12:57:38.201750  3606 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:38.203102  3606 raft_consensus.cc:3055] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:38.203584  3606 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.204880  3606 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.206329  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:38.206961  1644 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:35.288379  3483 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:38.207579  3606 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:38.208817  3483 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:38.210713  3563 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 3.242s	user 0.007s	sys 0.024s
I20260709 12:57:38.206120  3460 consensus_queue.cc:1059] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:38.195519  2349 rpcz_store.cc:276] 0709 12:57:35.096061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.096911 (+   850us) service_pool.cc:224] Handling call
0709 12:57:38.186568 (+3089657us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b58001b4b98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a4770dfc0 00007f6a476f8929 00007f6a476f83d2 00007f6a40c6fbd4
0709 12:57:38.186839 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:38.187079 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:38.187116 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:38.187172 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:38.187220 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:38.187289 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:38.187411 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2446208}
I20260709 12:57:38.176313  3085 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:38.215679  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:38.204420  3273 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:38.216473  3345 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:38.243153  3273 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:38.243672  3345 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.211781  3347 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:38.237485  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:38.230728  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:38.245215  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:38.245658  1646 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:38.233336  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:38.247313  1643 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:38.245604  3162 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.216912  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:38.250403  1642 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.228798  3501 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:38.216445  1639 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:57:38.254683  1644 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:38.255894  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:38.250747  3162 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:38.253453  3501 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:38.259513  1646 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:38.261834  3162 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:38.262084  3568 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:38.258335  1686 connection.cc:256] RPC call timeout handler was delayed by -3.7490586299999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260709 12:57:38.265476  1686 connection.cc:256] RPC call timeout handler was delayed by -3.6757624789999568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 12:57:38.265811  1686 connection.cc:256] RPC call timeout handler was delayed by -3.2602580949999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 12:57:38.266142  1686 connection.cc:256] RPC call timeout handler was delayed by -3.1425945829999478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 12:57:38.266469  1686 connection.cc:256] RPC call timeout handler was delayed by -2.9300586299999622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2775s for a response
I20260709 12:57:38.244837  3345 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:38.270147  1572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 158) took 3333 ms (client timeout 1910 ms). Trace:
I20260709 12:57:38.270900  1643 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
W20260709 12:57:38.270581  1572 rpcz_store.cc:269] 0709 12:57:34.936942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.116185 (+179243us) service_pool.cc:224] Handling call
0709 12:57:38.269918 (+3153733us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b54001847d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:38.270045 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95125888}
W20260709 12:57:38.276397  2342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.106s	user 0.017s	sys 0.036s
W20260709 12:57:38.281487  2342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.114s	user 0.018s	sys 0.036s
I20260709 12:57:38.282177  3345 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:38.282909  1639 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:38.277392  1642 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:38.287928  1565 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:38.289826  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1336) took 4598 ms. Trace:
I20260709 12:57:38.278136  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:38.266768  1686 connection.cc:256] RPC call timeout handler was delayed by -2.9210586299999477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2785s for a response
W20260709 12:57:38.293745  1686 connection.cc:256] RPC call timeout handler was delayed by -2.7185586299999613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.301s for a response
W20260709 12:57:38.294129  1686 connection.cc:256] RPC call timeout handler was delayed by -1.8028034159999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.43010000000000004s for a response
I20260709 12:57:38.295135  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:38.291752  3569 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.295887  3162 consensus_queue.cc:1059] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:38.296757  3616 consensus_queue.cc:1059] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:38.290216  1565 rpcz_store.cc:276] 0709 12:57:33.690961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.180347 (+1489386us) service_pool.cc:224] Handling call
0709 12:57:35.180594 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:38.288370 (+3107776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:38.289582 (+  1212us) spinlock_profiling.cc:243] Waited 3.11 s on lock 0x7b5400093b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:38.289762 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7145652096}
I20260709 12:57:38.305521  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:38.306353  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:38.306737  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:38.322672  1713 raft_consensus.cc:2368] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5.
I20260709 12:57:38.307229  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:38.307507  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:38.307639  3416 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:38.311709  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:38.302868  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08000358a0 after lost signal to thread 1518
I20260709 12:57:38.331488  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:38.341589  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:38.290426  3501 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.376494  1686 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:38.386430  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 45322.5us
I20260709 12:57:38.375778  3607 raft_consensus.cc:3055] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:38.392159  3616 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:38.347632  3587 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:38.369130  3347 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:38.395510  3616 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:38.344525  3498 consensus_queue.cc:1059] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:57:38.396495  3085 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:38.390107  1684 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:38.338037  3615 raft_consensus.cc:3055] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:38.398053  3616 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:38.432389  1684 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:38.434796  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:38.391953  3607 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.435010  3587 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:38.384614  3162 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:38.432633  3085 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.438997  3584 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:38.349702  3606 consensus_queue.cc:1059] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:57:38.448242  3611 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:38.419396  3615 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.400261  3347 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.462886  1644 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:38.491822  3347 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.451531  3569 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:38.495352  3501 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:38.533488  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 69169.5us
I20260709 12:57:38.567946  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:38.514138  3162 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.489900  3615 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.542554  3611 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.538254  3587 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.577548  3162 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.576399  3615 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:38.528189  3584 raft_consensus.cc:697] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.553092  3085 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.588182  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1590) took 3953 ms. Trace:
W20260709 12:57:38.605594  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 3.42223e+06us
I20260709 12:57:38.648836  1644 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:38.825214  1564 rpcz_store.cc:276] 0709 12:57:34.644245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.205994 (+561749us) service_pool.cc:224] Handling call
0709 12:57:35.206339 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:38.304149 (+3097810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:38.304185 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:38.304696 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:57:38.415003 (+110307us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:38.415418 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:38.415869 (+   451us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:38.587108 (+171239us) raft_consensus.cc:1685] finished
0709 12:57:38.587129 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:38.587903 (+   774us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3097381,"raft.queue_time_us":3101555,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":108167,"threads_started":1,"wal-append.queue_time_us":232382}
W20260709 12:57:38.591488  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1263) took 5043 ms (client timeout 3638 ms). Trace:
W20260709 12:57:38.835270  1719 rpcz_store.cc:269] 0709 12:57:33.548189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.320634 (+772445us) service_pool.cc:224] Handling call
0709 12:57:38.590696 (+4270062us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54001063d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:38.591222 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037303680}
I20260709 12:57:38.832258  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:38.838613  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:38.843071  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:38.851758  3038 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.639851  3289 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:38.853066  3038 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.854012  3289 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:38.866544  3423 raft_consensus.cc:2764] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:57:38.675197  3584 consensus_queue.cc:237] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:38.856828   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000fe60 after lost signal to thread 2314
I20260709 12:57:38.635915  3587 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.875734  3628 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:38.604440  3501 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.274s
W20260709 12:57:38.878726   436 kernel_stack_watchdog.cc:198] Thread 2314 stuck at /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:249 for 1751ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:57:38.881150  3483 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:38.882895  3289 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:38.884105  3108 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.902750  3108 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:38.903705  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:38.884785  3038 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:38.904386  3483 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:38.904912  3038 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:38.906581  3038 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:38.906975  3615 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:38.908229  3615 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:38.912209  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800357fe0 after lost signal to thread 1596
W20260709 12:57:38.649624  3461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.690s	user 0.021s	sys 0.028s
W20260709 12:57:38.912940  3461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.954s	user 0.022s	sys 0.028s
I20260709 12:57:38.913489  3475 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:38.914330  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800300e60 after lost signal to thread 1671
I20260709 12:57:38.914992  3108 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:38.713557  3616 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.907195  3038 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:38.643944  3611 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.897176  1642 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:38.914522  3475 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:38.916832  1501 debug-util.cc:398] Leaking SignalData structure 0x7b080038d040 after lost signal to thread 1745
I20260709 12:57:38.906635  3483 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:38.919574  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:38.925009  2341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 443) took 3839 ms. Trace:
I20260709 12:57:38.927726  3607 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:38.939316  2341 rpcz_store.cc:276] 0709 12:57:35.085318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.093485 (+  8167us) service_pool.cc:224] Handling call
0709 12:57:38.867275 (+3773790us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b58001b4b98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a4770dfc0 00007f6a476f8929 00007f6a476f83d2 00007f6a40c6fbd4
0709 12:57:38.867830 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:38.868364 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:38.868428 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:38.868537 (+   109us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:38.868610 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:38.868775 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:38.924673 (+ 55898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8640384}
I20260709 12:57:38.940861  3607 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:38.949110  1501 debug-util.cc:398] Leaking SignalData structure 0x7b080039eb60 after lost signal to thread 1746
I20260709 12:57:38.956517  3108 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:38.960536  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:38.962670  3254 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:38.976706  3085 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:38.978453  3414 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:38.978549  3254 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:38.979187  3085 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:38.980268  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "523c299f124340818ee040d8a887dba6"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:38.981209  1719 raft_consensus.cc:606] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:38.981760  1643 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:38.981959  3085 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:38.979178  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 91739.4us
I20260709 12:57:38.987753  1638 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:38.988296  3475 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:38.983180  3615 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:38.990718  1644 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:38.993685  3523 log.cc:927] Time spent T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 4.596s	user 0.015s	sys 0.051s
I20260709 12:57:38.993727  1647 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:57:38.986735  1537 connection.cc:256] RPC call timeout handler was delayed by -3.5048474049999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 12:57:38.980104  3038 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.001722  3038 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:38.981474  3616 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:38.985790  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800378ba0 after lost signal to thread 2314
I20260709 12:57:39.008571  1643 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:39.009950  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
W20260709 12:57:39.013506  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53124.6us
I20260709 12:57:39.015756  3342 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:39.015949  1612 leader_election.cc:400] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5.
W20260709 12:57:39.017830  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:39.021253  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 3.92016e+06us
W20260709 12:57:39.022600  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.024756  3498 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:39.049220  3584 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:39.037822  3616 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:57:39.047385  1719 raft_consensus.cc:606] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:39.064989  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08003caac0 after lost signal to thread 2373
W20260709 12:57:39.065377  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd0a0 after lost signal to thread 2374
W20260709 12:57:39.066030  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba960 after lost signal to thread 3354
W20260709 12:57:39.066870  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08003169a0 after lost signal to thread 3441
W20260709 12:57:39.067340  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd3e0 after lost signal to thread 3455
W20260709 12:57:39.067718  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800300d00 after lost signal to thread 3468
W20260709 12:57:39.068068  1501 debug-util.cc:398] Leaking SignalData structure 0x7b080037fa20 after lost signal to thread 3473
W20260709 12:57:39.069043  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53363.7us
I20260709 12:57:39.076795  3582 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:57:39.078591  1467 catalog_manager.cc:5697] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 3, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
W20260709 12:57:39.082017  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 910607us
I20260709 12:57:39.089944  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:39.090618  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.091856  3387 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.092829  3387 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:39.096063  3387 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.096629  3390 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:39.097112  3390 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:39.097497  3390 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:39.100025  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.100809  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.102489  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.091979  3266 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.103462  3266 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.103497  1717 raft_consensus.cc:2410] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:39.121419  3453 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:39.125411  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.122164  3453 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.128829  3460 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:57:39.129017  3584 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:39.129985  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.168217  2349 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:39.131669  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.103603  3342 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.152172  3254 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.133214  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:39.137333  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.174999  1717 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:39.137506  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800352040 after lost signal to thread 3520
W20260709 12:57:39.139612  1537 connection.cc:256] RPC call timeout handler was delayed by -3.4616474050000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 12:57:39.140677  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50216.1us
W20260709 12:57:39.176889  1537 connection.cc:256] RPC call timeout handler was delayed by -3.2240474049999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24380000000000002s for a response
I20260709 12:57:39.140911  3387 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:39.141677  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.142181  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.142800  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.143181  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.143786  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.145529  1719 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:57:39.146996  1684 consensus_peers.cc:597] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 598f1b27b4ab45cfac5cc13489b2e687. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:39.150992  3631 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:57:39.143271  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.154227  3273 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:39.155139  1612 connection.cc:256] RPC call timeout handler was delayed by -3.5148071610000216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 12:57:39.157545  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:39.158373  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:39.158813  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:39.160148  1644 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:39.144171  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.173270  3254 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:39.177628  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 154965us
W20260709 12:57:39.183063  1612 connection.cc:256] RPC call timeout handler was delayed by -2.590507161000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2857s for a response
W20260709 12:57:39.184466  1612 connection.cc:256] RPC call timeout handler was delayed by -2.4726071609999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2988s for a response
W20260709 12:57:39.177978  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 151173us
I20260709 12:57:39.184911  2345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 436) took 4859 ms. Trace:
I20260709 12:57:39.185500  2345 rpcz_store.cc:276] 0709 12:57:34.324883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.337061 (+ 12178us) service_pool.cc:224] Handling call
0709 12:57:37.952846 (+3615785us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b58001b4b98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60feee 0000000000375939 00007f6a476831e0 00007f6a4774c0c4 00007f6a4774c131 00007f6a4770dfc0 00007f6a476f8929 00007f6a476f83d2 00007f6a40c6fbd4
0709 12:57:37.953074 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:39.116418 (+1163344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:39.116467 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:39.117714 (+  1247us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:39.176989 (+ 59275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:39.181370 (+  4381us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:39.184625 (+  3255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1045811,"raft.queue_time_us":1149746,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"spinlock_wait_cycles":22842752,"thread_start_us":78319,"threads_started":1}
I20260709 12:57:39.187755  3532 consensus_queue.cc:1059] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:39.189014  3532 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:39.189356  3532 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:39.189872  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.179944  3387 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:39.210376  1537 connection.cc:256] RPC call timeout handler was delayed by -2.6822474049999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30400000000000005s for a response
W20260709 12:57:39.211372  1537 connection.cc:256] RPC call timeout handler was delayed by -2.6545118979999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 12:57:39.210994  1716 raft_consensus.cc:2410] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:57:39.211742  1537 connection.cc:256] RPC call timeout handler was delayed by -2.6347118979999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:57:39.212080  1537 connection.cc:256] RPC call timeout handler was delayed by -2.2408370639999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260709 12:57:39.212185  1718 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
W20260709 12:57:39.212425  1537 connection.cc:256] RPC call timeout handler was delayed by -2.2252118979999409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260709 12:57:39.212545  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:39.212778  1537 connection.cc:256] RPC call timeout handler was delayed by -2.1440474049999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3638s for a response
W20260709 12:57:39.213090  1537 connection.cc:256] RPC call timeout handler was delayed by -2.0837546219999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 12:57:39.213212  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.213750  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.214120  1718 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:39.215008  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.215734  3453 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.217253  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.218555  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.219725  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:39.213397  1537 connection.cc:256] RPC call timeout handler was delayed by -1.9726370639999686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 12:57:39.220810  1537 connection.cc:256] RPC call timeout handler was delayed by -1.8790370639999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:57:39.220502  3532 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.221158  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:39.221446  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.221964  2346 raft_consensus.cc:2376] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5. Re-sending same reply.
W20260709 12:57:39.221194  1537 connection.cc:256] RPC call timeout handler was delayed by -1.8525822119999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 12:57:39.222839  1537 connection.cc:256] RPC call timeout handler was delayed by -1.48631189799994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2898s for a response
W20260709 12:57:39.223256  1537 connection.cc:256] RPC call timeout handler was delayed by -1.198311897999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32180000000000003s for a response
W20260709 12:57:39.223543  1537 connection.cc:256] RPC call timeout handler was delayed by -1.1812118979999582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32370000000000004s for a response
I20260709 12:57:39.222774  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.214003  3273 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:39.230875  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.210908  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:39.223527  3387 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:39.221979  3532 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:39.237363  3500 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.237926  1712 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:39.238297  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.241963  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:39.243783  1715 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:39.247359  1647 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:57:39.248463  3530 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:39.249109  3530 raft_consensus.cc:697] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:39.249419  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:39.250356  3530 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.251266  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.232653  3460 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.253113  3460 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.253990  3536 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:39.254657  3536 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.255513  3460 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:39.256088  3520 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:39.258127  1720 raft_consensus.cc:2410] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:39.259413  1643 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:39.261503  1713 raft_consensus.cc:2410] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:57:39.264604  2314 connection.cc:256] RPC call timeout handler was delayed by -2.6637122780000482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 12:57:39.265309  2314 connection.cc:256] RPC call timeout handler was delayed by -2.4612122780000618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 12:57:39.265851  2314 connection.cc:256] RPC call timeout handler was delayed by -1.5234122780000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31770000000000004s for a response
I20260709 12:57:39.268352  1714 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:39.243319  3568 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:39.256582  3520 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.243319  3569 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:39.275000  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.247856  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:57:39.260877  3627 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.275s	user 0.002s	sys 0.003s
I20260709 12:57:39.284541  2346 raft_consensus.cc:2368] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:39.233196  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.278167  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.260818  3455 raft_consensus.cc:697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:39.286922  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1302) took 1054 ms. Trace:
I20260709 12:57:39.287030  1647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:57:39.289985  1647 raft_consensus.cc:606] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:39.290410  1647 raft_consensus.cc:614] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:39.272221  1467 catalog_manager.cc:5697] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:39.313740  1720 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:39.273885  3520 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:39.315819  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.303948  3634 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:39.324721  3634 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.327785  3634 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.294765  3582 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.329209  1720 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:57:39.278915  3607 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 12:57:39.314400  1684 leader_election.cc:336] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Timed out: RequestConsensusVote RPC to 127.0.107.196:43269 timed out after 1.505s (SENT)
I20260709 12:57:39.288079  1712 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:39.331663  1715 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:39.336777  1564 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:39.285542  3568 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:57:39.338227  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 65311.8us
I20260709 12:57:39.329142  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.314810  2342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 300) took 4455 ms. Trace:
W20260709 12:57:39.370154  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.288334  1646 rpcz_store.cc:276] 0709 12:57:38.246087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:38.277099 (+ 31012us) service_pool.cc:224] Handling call
0709 12:57:38.277634 (+   535us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:38.669307 (+391673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:38.669348 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:38.812616 (+143268us) log.cc:844] Serialized 532 byte log entry
0709 12:57:38.919870 (+107254us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b4800112758. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
0709 12:57:38.953090 (+ 33220us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:38.953141 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:38.953302 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:39.148232 (+194930us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:39.286566 (+138334us) raft_consensus.cc:1685] finished
0709 12:57:39.286592 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:39.286735 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387591,"raft.queue_time_us":389170,"raft.run_cpu_time_us":3129,"raft.run_wall_time_us":251065,"spinlock_wait_cycles":43706368,"thread_start_us":115578,"threads_started":1,"wal-append.queue_time_us":144333}
I20260709 12:57:39.372320  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:39.340699  1713 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:39.286934  3565 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:39.273622  3500 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.346163  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:39.344780  2341 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:39.405433  1644 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:57:39.341039  2343 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:39.405994  1644 pending_rounds.cc:85] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 1
I20260709 12:57:39.340893  3517 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:39.345722  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.315021  3569 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.410646  3342 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:57:39.429910  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 65880.7us
I20260709 12:57:39.411140  1644 pending_rounds.cc:107] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:57:39.431072  1644 raft_consensus.cc:2889] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:39.391928  3565 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:39.404910  3498 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.437995  1716 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:39.392788  3390 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.443013  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.413893  3517 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:39.440997  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.443934  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.424846  3266 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.434753  3565 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:39.414287  3582 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.424692  3199 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:39.448736  3517 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:39.463266  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:39.453465  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:39.464044  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50277us
I20260709 12:57:39.470116  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:39.467377  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 198497us
I20260709 12:57:39.469866  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.482424  3390 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.483332  3266 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:57:39.483760  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.483959  3266 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.481738  1467 catalog_manager.cc:5697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 2 to 3, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:39.484529  3266 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:39.485021  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.485826  1720 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:39.486965  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.489311  3455 consensus_queue.cc:237] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.491052  3569 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.486124  1467 catalog_manager.cc:5697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 4, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:39.475037  3498 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.494719  3498 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:39.463687  3199 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:39.493216  1467 catalog_manager.cc:5697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:39.496503  3199 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:39.499245  1716 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:39.496294  3582 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:39.520210  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:39.520802  3568 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.521993  1467 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 4, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:39.524006  1467 catalog_manager.cc:5697] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 2 to 5, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:39.526403  3500 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.526206  1467 catalog_manager.cc:5697] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:39.526954  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:39.475687  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.524879  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.552349  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.539297  1612 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:39.554925  3634 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:39.527669  1467 catalog_manager.cc:5697] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 2 to 3, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:39.527356  3108 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:39.538914  3483 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:57:39.556602  1467 catalog_manager.cc:5697] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 3, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:39.387405  2342 rpcz_store.cc:276] 0709 12:57:34.815934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.817683 (+  1749us) service_pool.cc:224] Handling call
0709 12:57:34.869721 (+ 52038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.948751 (+ 79030us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:35.107865 (+159114us) log.cc:844] Serialized 14 byte log entry
0709 12:57:39.182686 (+4074821us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:39.226012 (+ 43326us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:39.233856 (+  7844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:39.247010 (+ 13154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:39.269514 (+ 22504us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":809684,"prepare.queue_time_us":145415,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":858857,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":4529,"thread_start_us":3325224,"threads_started":3,"wal-append.queue_time_us":314521,"wal-append.run_cpu_time_us":1722,"wal-append.run_wall_time_us":1001755}
W20260709 12:57:39.585327  2344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 304) took 4420 ms (client timeout 3287 ms). Trace:
W20260709 12:57:39.585826  2344 rpcz_store.cc:269] 0709 12:57:35.165037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.183683 (+ 18646us) service_pool.cc:224] Handling call
0709 12:57:39.584924 (+4401241us) spinlock_profiling.cc:243] Waited 4.15 s on lock 0x7b54006df954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:39.585108 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9534755072}
I20260709 12:57:39.547991  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.557242  3108 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.530282  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46898 (request call id 131) took 11008 ms. Trace:
I20260709 12:57:39.587492  3108 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:39.538923  2345 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:39.546267  2343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 303) took 4402 ms. Trace:
I20260709 12:57:39.592929  2343 rpcz_store.cc:276] 0709 12:57:35.144296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.255219 (+110923us) service_pool.cc:224] Handling call
0709 12:57:39.279883 (+4024664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:39.429184 (+149301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:39.545998 (+116814us) spinlock_profiling.cc:243] Waited 4.01 s on lock 0x7b54005c4250. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:39.546194 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9212861184}
I20260709 12:57:39.544124  3536 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.594063  3266 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.587497  1712 raft_consensus.cc:2410] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:57:39.559900  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.560317  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:39.597837  3498 consensus_queue.cc:1059] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:39.599341  3498 raft_consensus.cc:3055] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:39.599833  3498 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:39.600482  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.558348  1467 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:39.600899  3498 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.602139  3498 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:39.601898  1467 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 3, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:39.602996  1712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:39.603925  1712 raft_consensus.cc:606] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Received request to transfer leadership to TS c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:39.567595  1645 pending_rounds.cc:85] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 5
I20260709 12:57:39.605355  1645 pending_rounds.cc:107] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:57:39.605118  3423 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:39.605561  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet acc3fcdecc7546fe92075e15e904c331 with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46146
I20260709 12:57:39.606174  3423 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:39.569175  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:39.568023  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.570158  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.570773  3460 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:39.572866  3582 raft_consensus.cc:993] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:57:39.574774  3517 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:57:39.575291  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 260951us
I20260709 12:57:39.575842  3387 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.576682  3199 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.528375  2314 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:39.583988  3500 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:39.530005  3639 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:39.592358  1718 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:39.565385  1535 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.605726  1645 raft_consensus.cc:2889] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:39.569070  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:39.603678  1467 catalog_manager.cc:5697] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 3, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:39.569876  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:39.610606  3634 raft_consensus.cc:3055] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:39.623152  2349 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:39.611822  1719 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:39.606915  1712 raft_consensus.cc:614] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:57:39.622205  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 93928.3us
I20260709 12:57:39.610749  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.633625  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:39.608330  3266 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:39.647185  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 81998.9us
I20260709 12:57:39.647363  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.648201  1716 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:39.615536  3500 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.653963  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:39.654580  3453 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:39.655448  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.656095  1718 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:39.632293  3582 raft_consensus.cc:1081] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Signalling peer 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:57:39.587581  1470 rpcz_store.cc:276] 0709 12:57:28.503226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.504505 (+  1279us) service_pool.cc:224] Handling call
0709 12:57:37.724250 (+9219745us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b540038a0a8. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4609e161 00007f6a461283af 00007f6a46129b11 00007f6a4862a2d1 00007f6a4862ab2f 00007f6a484e9d4b 00007f6a485f1c3e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc
0709 12:57:39.498275 (+1774025us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:37.740075 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:37.740631 (+   556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:37.740718 (+    87us) write_op.cc:435] Acquired schema lock
0709 12:57:37.740754 (+    36us) tablet.cc:662] Decoding operations
0709 12:57:37.741674 (+   920us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:37.741736 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:37.741763 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:57:37.742449 (+   686us) tablet.cc:701] Row locks acquired
0709 12:57:37.742471 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:57:37.742624 (+   153us) write_op.cc:270] Start()
0709 12:57:37.742737 (+   113us) write_op.cc:276] Timestamp: P: 1783601857742573 usec, L: 0
0709 12:57:37.742760 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:57:37.743474 (+   714us) log.cc:844] Serialized 2481 byte log entry
0709 12:57:37.750809 (+  7335us) op_driver.cc:464] REPLICATION: finished
0709 12:57:37.753094 (+  2285us) write_op.cc:301] APPLY: starting
0709 12:57:37.753182 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:37.753361 (+   179us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:37.753522 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:37.754807 (+  1285us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:37.755219 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:57:37.755297 (+    78us) write_op.cc:312] APPLY: finished
0709 12:57:37.755696 (+   399us) log.cc:844] Serialized 53 byte log entry
0709 12:57:37.756813 (+  1117us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:37.756957 (+   144us) write_op.cc:454] Released schema lock
0709 12:57:37.757012 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:37.762368 (+  5356us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:37.762420 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"spinlock_wait_cycles":4408576,"child_traces":[["op",{"apply.queue_time_us":1963,"apply.run_cpu_time_us":3522,"apply.run_wall_time_us":9202,"num_ops":6,"prepare.queue_time_us":14992,"prepare.run_cpu_time_us":5496,"prepare.run_wall_time_us":5962,"raft.queue_time_us":1118,"raft.run_cpu_time_us":2404,"raft.run_wall_time_us":2428,"replication_time_us":7834,"spinlock_wait_cycles":43392,"thread_start_us":19922,"threads_started":4,"wal-append.queue_time_us":2442,"wal-append.run_cpu_time_us":5430,"wal-append.run_wall_time_us":1121667}]]}
I20260709 12:57:39.656543  1467 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:39.630832  3634 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:39.643935  3342 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:39.638417  3639 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:39.677481  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.687539  1716 raft_consensus.cc:2410] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:39.678404  1467 catalog_manager.cc:5697] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:39.681419  1713 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:39.657819  3500 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:39.683993  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.684319  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.694497  1718 raft_consensus.cc:2410] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:39.692976  1639 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:39.729575  1646 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:39.656283  1638 raft_consensus.cc:2376] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4. Re-sending same reply.
I20260709 12:57:39.686550  3569 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:39.745544  3639 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.748409  1467 catalog_manager.cc:5697] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 4, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:39.750214  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.683665  3266 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:57:39.701560  3273 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:39.764282  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.766680  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:39.773591  3387 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.773208  3539 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:57:39.703908  3390 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:57:39.792707  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.739897  3569 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.779805  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:39.787361  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.779690  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:39.730461  3638 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:57:39.774680  1712 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:39.793787  1720 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:39.801097  3517 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:39.801756  3147 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:39.789852  3532 consensus_meta.cc:287] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 12:57:39.806727  1646 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:39.816947  1642 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:39.785019  3607 raft_consensus.cc:2955] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:39.824805   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:57:39.829632  3659 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:57:39.809129  3147 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:39.831522  3147 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.833211  2341 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:57:39.835729  3520 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.817239  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.804333  3569 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.828573   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:57:39.878648  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.702993  3108 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.771855  3634 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:39.833250  3199 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:39.903797  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 47969.6us
I20260709 12:57:39.858717  3254 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.871897  3273 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:57:39.961637  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:39.968593  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 315837us
I20260709 12:57:39.861940  3565 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:39.971544  1641 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:39.973263  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.944008  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:39.964320  3634 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:39.921252  3254 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.001804  1570 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:57:40.002200  1570 pending_rounds.cc:85] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 5
I20260709 12:57:40.002446  1570 pending_rounds.cc:107] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:57:40.002475  3108 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:40.002765  1570 raft_consensus.cc:2889] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:40.004694  3420 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:39.991443  3423 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:40.006479  3420 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:40.007063  3420 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:40.007162  3423 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.013767  3520 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:40.021709  1566 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:40.021229  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:40.024299  1684 leader_election.cc:400] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:40.024869  1684 leader_election.cc:403] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:57:40.025744  3498 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:40.026854  3498 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:40.028296  3498 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:39.995409  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 339467us
I20260709 12:57:39.988075  1712 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:40.007308  3669 tablet_replica.cc:333] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:57:40.053829  3611 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:40.069027  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:40.073398  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:40.075161  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:40.075637  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:40.088912  3460 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.088359  3273 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.089581  3460 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.092411  3460 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:40.100944  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 224353us
I20260709 12:57:40.103168  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:40.093006  3582 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:40.117280  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 498704us
I20260709 12:57:40.129869  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:40.132329  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 56902.6us
I20260709 12:57:40.115118  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:40.134724  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:40.115815  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:40.135710  3582 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:40.136139  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:40.136309  1645 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:40.137270  3634 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:40.137826  3634 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:40.138844  3520 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.139020  1641 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:40.139515  3520 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.140198  3634 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:40.140957  3682 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:40.141616  3682 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.142542  3520 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:40.110272  3254 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:40.143090  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:57:40.143253  1535 connection.cc:256] RPC call timeout handler was delayed by -3.3281632819999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260709 12:57:40.140970  3568 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:40.144105  1535 connection.cc:256] RPC call timeout handler was delayed by -3.2201632819999304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 12:57:40.144527  1535 connection.cc:256] RPC call timeout handler was delayed by -2.9690632819999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:57:40.093312  3539 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:40.144912  1535 connection.cc:256] RPC call timeout handler was delayed by -1.9997632819999467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3287s for a response
I20260709 12:57:40.149055  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:40.145915  1537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.757s (SENT) [suppressed 21 similar messages]
I20260709 12:57:40.104228  3147 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:40.143937  3520 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.115490  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:40.170217  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:40.157325  3565 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:40.144585  3568 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.150507  3539 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:40.172736  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.145378  3682 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:40.176473  1565 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:40.180015  1564 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:40.172726  3520 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.178923  3147 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:40.157400  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:40.153506  3254 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:40.174232  1684 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:40.104363  3500 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.167613  1719 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:40.192818  3460 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:40.193040  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.186034  3539 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:40.199064  1714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.007s	sys 0.002s
W20260709 12:57:40.203029  1714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.007s	sys 0.002s
I20260709 12:57:40.172789  3582 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 12:57:40.206110  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 256924us
I20260709 12:57:40.201700  3675 raft_consensus.cc:1064] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:57:40.195570  3460 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:40.239902  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.243383  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:40.246532  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.247200  1564 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:40.229729  3038 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.251192  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:40.251298  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:40.251991  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.252117  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.252863  3483 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:40.255031  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:40.257426  1645 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:40.258086  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.294571  1642 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:40.260025  3387 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:40.261018  3266 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:40.261056  3520 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:40.263438  3565 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:40.264592  1537 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:40.265858  3568 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:40.266000  3500 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:40.268787  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:40.309538  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.269284  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.252142  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:40.280966  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.281500  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.281906  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:40.282984  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.283875  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.285108  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:40.286003  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:40.239256  3460 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.295421  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:40.303141  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:40.341777  1721 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:40.241442  3254 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:57:40.330875  1571 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:40.331352  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:40.329808  1569 raft_consensus.cc:2410] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:40.335829  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.338632  1565 raft_consensus.cc:2393] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:40.340904  1568 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:57:40.341089  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 76726.9us
I20260709 12:57:40.290416  3483 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:40.306653  1638 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:40.351540  1570 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:40.293607  3038 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.340794  3683 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.388383  3634 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:57:40.330004  3455 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:57:40.438112  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.407737  1563 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:40.381657  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:40.442991  1565 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:40.443073  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.443909  1563 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:40.444499  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:40.401736  2340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 303) took 5241 ms (client timeout 1931 ms). Trace:
W20260709 12:57:40.425580  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44583.3us
I20260709 12:57:40.394124  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:40.363343  3461 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:57:40.357470  3483 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:40.389351  3500 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:40.352095  3530 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:57:40.445545  1565 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
W20260709 12:57:40.445116  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:40.460233  3420 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:40.461721  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.452504  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.465983  1570 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:40.386307  1567 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
W20260709 12:57:40.447000  2340 rpcz_store.cc:269] 0709 12:57:35.160241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.179061 (+ 18820us) service_pool.cc:224] Handling call
0709 12:57:40.401369 (+5222308us) spinlock_profiling.cc:243] Waited 4.79 s on lock 0x7b540007e9d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:40.401572 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11019388160}
I20260709 12:57:40.447715  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:40.408871  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:40.476575  1644 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:40.466275  1568 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:40.453243  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.455623  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.449236  3616 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.455757  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.449014  3607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48844 (request call id 8) took 15205 ms. Trace:
W20260709 12:57:40.480754  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 275055us
I20260709 12:57:40.483537  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:40.485894  1569 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:40.491396  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.492133  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:40.424234  3638 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:57:40.476044  3420 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:40.498520  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:40.496807  1572 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:40.501258  1644 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:40.454643  3683 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:40.493453  3038 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:40.529913  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 168594us
I20260709 12:57:40.530169  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.493175  1563 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:40.499817  3387 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.497891  3530 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:57:40.515107  3569 consensus_meta.cc:287] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.607s	user 0.016s	sys 0.000s
I20260709 12:57:40.535717  3530 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:40.541021  3541 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:40.493104  3539 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:40.542479  1642 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:57:40.601917  3696 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:57:40.604166  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.603667  1535 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:40.611436  1643 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:40.588726  1572 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:57:40.584358  1721 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:40.613965  1640 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:40.615365  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.616047  1569 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
W20260709 12:57:40.546620  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 54163.5us
I20260709 12:57:40.616668  3675 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:40.621147  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 147741us
I20260709 12:57:40.621920  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:40.622748  1537 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:40.622956  3273 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:40.623426  3273 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:40.623858  3273 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:40.617353  3697 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:57:40.624181  1537 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:40.625954  3683 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:40.600221  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 293910us
I20260709 12:57:40.629870  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 137) took 1365 ms. Trace:
I20260709 12:57:40.534929  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.650745  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:40.656733  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.658792  1644 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:40.623754  3387 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:40.626418  3199 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:40.565003  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.618036  3541 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:40.546847  3569 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:40.684897  3569 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:40.685691  1564 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:57:40.670532  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46431.9us
I20260709 12:57:40.687548  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:40.689381  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:40.691952  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.695255  3539 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:40.631599  3565 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:40.700354  1572 raft_consensus.cc:1240] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:40.677407  1638 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:40.678180  3541 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:40.487933  3607 rpcz_store.cc:276] 0709 12:57:25.261023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.347848 (+ 86825us) service_pool.cc:224] Handling call
0709 12:57:26.031225 (+683377us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000161a0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426b1520 00007f6a4273ab42 00007f6a42739800 00007f6a476fad29 00007f6a40c791d4 00007f6a40c79162 00007f6a40c79091 00007f6a40c7900c 00007f6a40c782c2 00007f6a40a6f48c
0709 12:57:26.089331 (+ 58106us) log.cc:844] Serialized 506 byte log entry
0709 12:57:27.233003 (+1143672us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b180011aca0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:57:27.786594 (+553591us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b180011aca0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:57:40.424013 (+12637419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4556,"raft.queue_time_us":5183,"raft.run_cpu_time_us":899,"raft.run_wall_time_us":140562,"spinlock_wait_cycles":314358912,"thread_start_us":299477,"threads_started":1,"wal-append.queue_time_us":522492,"wal-append.run_cpu_time_us":1914,"wal-append.run_wall_time_us":1002977}
I20260709 12:57:40.680111  3441 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 12:57:40.680460  2343 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: []
W20260709 12:57:40.681285  3695 log.cc:927] Time spent T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:57:40.681908  3483 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.682765  1640 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:57:40.682991  1563 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:40.686820  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.630224  1714 rpcz_store.cc:276] 0709 12:57:39.255132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:39.287557 (+ 32425us) service_pool.cc:224] Handling call
0709 12:57:39.328834 (+ 41277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:39.329370 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:39.452635 (+123265us) log.cc:844] Serialized 14 byte log entry
0709 12:57:40.500126 (+1047491us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:40.508761 (+  8635us) log.cc:844] Serialized 26 byte log entry
0709 12:57:40.509043 (+   282us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:40.509483 (+   440us) log.cc:844] Serialized 14 byte log entry
0709 12:57:40.612191 (+102708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:40.612624 (+   433us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:40.612701 (+    77us) raft_consensus.cc:1685] finished
0709 12:57:40.618649 (+  5948us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:40.620878 (+  2229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25308,"prepare.queue_time_us":204586,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":2885,"raft.queue_time_us":1206,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":4874,"thread_start_us":1214055,"threads_started":4,"wal-append.queue_time_us":842544}
I20260709 12:57:40.670163  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:40.728353  1646 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:40.709648  1568 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:40.651784  3638 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.721396  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:40.725003  1572 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:40.664307  3199 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:57:40.727022  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 76342.3us
I20260709 12:57:40.703497  1643 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:40.733719  1719 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:40.705391  3520 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:40.668738  1567 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:40.732402  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:40.705638  3565 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:40.707417  3532 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:57:40.742408  1716 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:40.749634  1639 raft_consensus.cc:2368] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5.
W20260709 12:57:40.750458  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 62988.9us
I20260709 12:57:40.751192  1537 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:40.753296  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:40.734735  3541 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:40.729055  3387 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:40.759944  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 141533us
I20260709 12:57:40.761379  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1338) took 1069 ms. Trace:
I20260709 12:57:40.728597  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:40.734369  3199 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.748142  3565 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.723964  3685 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:57:40.708467  3460 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:40.746879  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:40.768240  1647 rpcz_store.cc:276] 0709 12:57:39.685016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:39.685169 (+   153us) service_pool.cc:224] Handling call
0709 12:57:39.701285 (+ 16116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:39.996732 (+295447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:39.996774 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:40.038418 (+ 41644us) log.cc:844] Serialized 26 byte log entry
0709 12:57:40.239970 (+201552us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:40.240008 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:40.240069 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:40.754107 (+514038us) raft_consensus.cc:1685] finished
0709 12:57:40.754133 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:40.754313 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":282038,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":416615,"threads_started":2,"wal-append.queue_time_us":447545}
I20260709 12:57:40.900974  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:40.747238  3539 consensus_queue.cc:1059] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 12:57:40.901702  1714 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
W20260709 12:57:40.899379  1686 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.961s (SENT)
I20260709 12:57:40.745898  3638 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:40.867753  3682 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:40.857805  3643 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:57:40.895782  3675 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:40.910214  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 159083us
I20260709 12:57:40.860054  3679 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:40.903254  3673 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:40.917846  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:40.917851  3707 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.169s
W20260709 12:57:40.946110  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 61459.1us
I20260709 12:57:40.913553  1712 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:57:40.906179  3634 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:40.923723  3539 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.958631  1644 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:57:40.966734  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 234660us
I20260709 12:57:40.967514  1535 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:40.977456  1537 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:40.980281   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:40.980453  3685 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.981278  3685 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.984434  3685 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:41.000327  3704 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 12:57:41.004309  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:41.005100  1638 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 2.
I20260709 12:57:41.006400  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:41.011591  1643 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:57:41.022333  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:41.032294  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:41.033435  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 56094.2us
I20260709 12:57:41.034370  1537 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:41.035379  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:40.944936  3673 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.939663  3675 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:41.019616  3682 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:40.967029  3634 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:40.969772  3539 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:41.051388  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:40.966747  3679 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:41.061774  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 293392us
I20260709 12:57:41.061935  3675 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:41.062387  3460 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:41.062999  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:41.063820  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:41.063946  1712 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:41.065372  3700 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:41.065747  3700 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:41.066138  3700 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:41.065882  3616 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:41.068008  3616 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:41.068609  3616 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.039494  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:41.064107  3568 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:41.071574  1535 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:41.077831  1565 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:41.079185  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.080188  1565 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:41.048092  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:41.046994  3483 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:41.044876  3520 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:41.085844  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:41.086095  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:41.076833  3266 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:41.041276  3569 consensus_queue.cc:1059] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:57:41.088708  3266 raft_consensus.cc:697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:41.089814  3266 consensus_queue.cc:237] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:41.063722  3673 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:41.097297  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:41.095971  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.063763  3460 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:57:41.119758  1565 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:41.120855  3453 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:41.122454  1645 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:41.123709  1645 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:41.124406  1639 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 12:57:41.125005  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:41.125597  1643 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:41.127211  3638 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:41.127457  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:41.127544  3700 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:41.128080  1647 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:41.097141  3682 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:41.068404  3273 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:41.136219  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.138607  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.139544  1565 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:41.100600  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.134677  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:41.111948  3643 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:41.117105  3387 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:41.143569  3710 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:57:41.137351  1640 raft_consensus.cc:2410] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:41.145151  3700 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:41.145394  3565 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:41.140962  3712 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:57:41.147559  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:41.148144  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:41.158988  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 50104.6us
I20260709 12:57:41.162645  3715 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:57:41.164016  3273 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:41.140851  3679 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:41.099702  3728 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:57:41.164088  3715 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:41.177640  1565 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:41.178793  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.343845  1569 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:41.343757  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1618) took 1060 ms. Trace:
W20260709 12:57:41.419381  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 196381us
W20260709 12:57:41.211241  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 114001us
I20260709 12:57:41.420666  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:41.420917  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.421442  3273 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:41.421851  1535 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:41.422664  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.422947  3273 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:41.423378  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:41.314260  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.315268  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:41.383204  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 309833us
I20260709 12:57:41.419781  1564 rpcz_store.cc:276] 0709 12:57:40.283629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.433112 (+149483us) service_pool.cc:224] Handling call
0709 12:57:41.343434 (+910322us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400093154. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:41.343650 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559413504}
W20260709 12:57:41.428790  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 199703us
I20260709 12:57:41.311443  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.423380  1565 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.176667  1563 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:41.230823  3667 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 1.094s	user 0.002s	sys 0.013s
I20260709 12:57:41.162660  3716 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:41.270030  3701 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.724s	user 0.003s	sys 0.006s
I20260709 12:57:41.439465  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.181000  3715 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:41.450551  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:41.451520  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:41.231520  3539 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:41.424835  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.204478  3634 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:41.460408  3715 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.470757  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.472718  1567 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:41.473829  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.474401  1567 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:41.204704  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:41.194687  3679 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:41.447302  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.499739  1571 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:41.448401  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.449291  3085 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:41.451570  2349 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:41.181257  3565 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:41.213727  3616 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:41.453670  3703 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:41.454907  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.457468  2344 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:57:41.459452  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:41.434196  3712 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:41.461278  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:41.443122  3273 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:41.466831  3729 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:41.452354  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:41.446077  3716 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:41.203363  3199 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:41.300295  3461 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:41.212154  3530 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:41.500967  3085 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:41.548635  3085 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:41.453028  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:41.487556  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.509048  2347 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:57:41.506625  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.509812  1638 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:41.519347  3607 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.560943  1564 raft_consensus.cc:2410] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:41.519868  3703 raft_consensus.cc:3055] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:41.519771  3679 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:41.521692  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 60513.1us
I20260709 12:57:41.523274  3565 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:41.544085  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.527132  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:41.549607  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:41.555097  3616 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:41.517768  3712 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:41.579761  1571 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:41.545311  3716 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:41.611748  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:41.580498  3254 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.549242  3461 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:41.605638  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.580899  3703 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:41.667821  1645 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:41.623227  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:41.656595  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:41.834914  1713 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:41.835399  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 154) took 1120 ms. Trace:
I20260709 12:57:41.835772  1713 rpcz_store.cc:276] 0709 12:57:40.714681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.748093 (+ 33412us) service_pool.cc:224] Handling call
0709 12:57:41.656444 (+908351us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b5800150f98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:41.835322 (+178878us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8060288}
I20260709 12:57:41.828981  3712 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:41.831881  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:41.594628  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:41.837330  1571 raft_consensus.cc:2368] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5.
I20260709 12:57:41.805150  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.839430  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:41.622644  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:41.658493  1565 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:41.837265  3712 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.624173  3500 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:41.656178  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 169) took 1027 ms. Trace:
I20260709 12:57:41.840770  3500 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.841538  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.840090  1568 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:41.843257  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.843483  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.839682  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.844480  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.844674  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.845767  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.846598  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.846765  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:41.844777  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.651283  1570 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:41.840847  1569 rpcz_store.cc:276] 0709 12:57:40.628674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.628839 (+   165us) service_pool.cc:224] Handling call
0709 12:57:41.343603 (+714764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:41.425070 (+ 81467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:41.655962 (+230892us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400093150. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:41.656098 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568556288}
I20260709 12:57:41.847915  1571 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:41.848883  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.849980  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.851732  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.582894  3607 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:41.853145  1565 raft_consensus.cc:2368] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5.
I20260709 12:57:41.850708  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.852813  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.854470  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:41.856052  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 306494us
I20260709 12:57:41.856671  1715 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:41.855484  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:41.857573  1713 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.856727  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:41.849267  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.855739  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:41.859614  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.859802  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.855883  3707 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:41.854792  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.855715  1569 raft_consensus.cc:2376] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5. Re-sending same reply.
I20260709 12:57:41.854159  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.861951  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.863432  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.865105  1717 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:41.865350  3565 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:41.855085  3607 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:41.865901  3565 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:41.866657  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.867235  1717 raft_consensus.cc:2376] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4. Re-sending same reply.
I20260709 12:57:41.868325  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.869551  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.869799  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.650883  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:41.869431  1713 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:57:41.871294  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 220492us
I20260709 12:57:41.872148  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:41.872788  1568 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:57:41.871876  1686 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.616s (SENT)
I20260709 12:57:41.874017  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:41.875208  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:41.819566  3743 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:57:41.819643  3669 raft_consensus.cc:2243] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:41.877013  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.876611  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:41.878257  3732 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:41.614498  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:41.879715  1713 raft_consensus.cc:2376] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5. Re-sending same reply.
I20260709 12:57:41.826112  3199 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:41.875196  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.805455  3710 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:41.882776  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 355721us
I20260709 12:57:41.881579  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.884864  1568 raft_consensus.cc:2410] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:41.885377  3085 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:41.885746  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.886530  1713 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:41.874425  3273 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:41.888077  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.888535  1571 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.875936  3682 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:41.891367  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:41.892482  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:41.894374  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 177) took 1188 ms. Trace:
I20260709 12:57:41.894855  1563 rpcz_store.cc:276] 0709 12:57:40.705683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.752410 (+ 46727us) service_pool.cc:224] Handling call
0709 12:57:40.752786 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:41.445553 (+692767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:41.894054 (+448501us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54001ff254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:41.894266 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932694272}
I20260709 12:57:41.897210  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:41.880700  3699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.340s	user 0.006s	sys 0.020s
I20260709 12:57:41.873028  3254 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:41.905400  3568 raft_consensus.cc:3055] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:41.905829  3568 raft_consensus.cc:740] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:41.889395  3710 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:41.906790  1645 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:41.906692  3568 consensus_queue.cc:260] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:41.889971  3273 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:41.907825  3273 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.907861  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:41.908269  3710 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:41.910240  1645 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:41.911456  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:41.907176  3254 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:41.896333  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:41.890720  3728 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:41.915261  1717 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:41.907989  3568 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:41.906359  3199 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:41.913607  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:41.913476  1686 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:41.905094  3699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.007s	sys 0.020s
I20260709 12:57:41.882344  3455 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:41.930256  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:41.940805  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 64278.5us
I20260709 12:57:41.899121  3709 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:41.942061  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:41.942252  1686 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:41.943370  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:41.945591  1719 raft_consensus.cc:2368] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6.
I20260709 12:57:41.906087  3669 raft_consensus.cc:2272] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:41.941344  3455 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:41.931840  3639 consensus_queue.cc:1059] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:57:41.950176  1535 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:41.941102  3582 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:41.964409  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.944337  3539 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:41.932904  3453 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:57:41.966322  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:41.882166  3461 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:41.971633  1537 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:41.942890  3729 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:57:41.953387  3757 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:41.961938  3749 ts_tablet_manager.cc:933] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:41.960593  3199 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:41.955526  3682 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:57:41.977166  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:41.979207  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:41.981655  1645 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:41.981720  1719 raft_consensus.cc:2376] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4. Re-sending same reply.
I20260709 12:57:41.983758  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:41.972927  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:41.967348  3679 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:41.917749  3703 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:41.993713  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:41.993938  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:41.995921  1686 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:42.000005  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:41.980288  3760 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:42.002465  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.006966  1714 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:57:42.004966  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.007987  1684 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:42.008705  3460 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:41.999858  3582 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:41.993976  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:42.015002  3565 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.009199  3460 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:42.016275  3460 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:41.993902  3461 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.001483  1567 raft_consensus.cc:2410] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:41.993445  3732 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:41.998615  3642 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:42.037039  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 70794.7us
I20260709 12:57:42.002933  3712 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.046113  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.006596  3760 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:42.048070  1686 leader_election.cc:400] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5.
I20260709 12:57:42.049973  1686 leader_election.cc:403] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:57:42.024106  3455 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:42.055533  3702 raft_consensus.cc:3055] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:42.055965  3702 raft_consensus.cc:740] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:42.057029  3669 ts_tablet_manager.cc:1916] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:42.056896  3702 consensus_queue.cc:260] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.058065  3702 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:42.058283  3756 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.225s	user 0.003s	sys 0.000s
I20260709 12:57:42.059463  1720 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:57:42.060024  3748 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 12:57:42.060813  3755 log.cc:927] Time spent T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.230s	user 0.002s	sys 0.001s
I20260709 12:57:42.061275  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.082121  1571 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:42.061745  3423 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:42.051517  3760 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:42.080717  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 236695us
I20260709 12:57:42.041551  3199 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:42.027344  3759 consensus_queue.cc:1059] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:57:42.083040  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.084349  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:42.120718  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:42.126186  1535 leader_election.cc:400] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5.
I20260709 12:57:42.126965  1535 leader_election.cc:403] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:57:42.077826  3715 consensus_meta.cc:287] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.005s
W20260709 12:57:42.129230  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44960.6us
I20260709 12:57:42.130055  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:42.131526  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.133898  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:42.136404  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.137355  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:42.072580  3767 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.090068  3700 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5.
I20260709 12:57:42.141070  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:42.142588  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:42.144456  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 54001.1us
I20260709 12:57:42.146896  3763 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.094466  3565 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:42.097606  3642 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:42.148808  3642 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.148758  3685 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:42.142635  3038 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.150516  3038 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:42.150853  3038 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:42.151188  3038 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.148773  3761 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:42.153301  3761 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:42.154346  3761 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.155319  3763 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5.
I20260709 12:57:42.155655  3761 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.156266  3759 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:42.156849  3759 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.140305  3682 raft_consensus.cc:3055] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:42.157912  3682 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:42.135769  3712 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.158085  3732 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.159886  3763 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:42.160435  3763 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.161273  3582 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:42.161836  3582 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:42.162312  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.162983  1567 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:42.162766  3460 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.164108  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.137956  3699 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.166529  3683 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.168121  2340 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:42.170288  3500 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.177414  3038 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:42.179050  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 47668.4us
I20260709 12:57:42.179728  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1352) took 1056 ms. Trace:
I20260709 12:57:42.173338  3273 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:42.144156  1638 consensus_meta.cc:287] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 12:57:42.089432  3765 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:42.143213  3420 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:42.185016  1641 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:42.185490  3038 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:42.186757  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:42.199699  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 55204.6us
I20260709 12:57:42.108394  3423 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.203617  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1631) took 1600 ms. Trace:
I20260709 12:57:42.204509  1571 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:42.172842  3199 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:42.211956  3460 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:42.186836  1638 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:42.213686  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1356) took 1045 ms. Trace:
I20260709 12:57:42.214111  3273 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:42.214040  1638 rpcz_store.cc:276] 0709 12:57:41.168246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.204419 (+ 36173us) service_pool.cc:224] Handling call
0709 12:57:42.213623 (+1009204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:42.215474  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:42.207039  3420 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:42.215590  1715 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:42.139484  3715 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.217379  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.224156  1719 raft_consensus.cc:1217] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 12:57:42.224457  1537 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.222977  1713 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:57:42.224813  1719 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:42.229314  1537 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.231781  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:42.233281  3750 log.cc:927] Time spent T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.364s	user 0.006s	sys 0.004s
I20260709 12:57:42.212157  3423 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:42.209771  3728 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.237946  1714 raft_consensus.cc:1217] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-6.4]   Dedup: 4.3->[6.4-6.4]
I20260709 12:57:42.244439  1714 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:57:42.236953  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:42.247007  3642 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.248454  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.249069  1564 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:42.249902  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.250032  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.250449  1564 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:42.250983  1565 raft_consensus.cc:2368] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5.
I20260709 12:57:42.251260  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.251830  1564 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:42.251941  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:42.253580  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 172) took 1597 ms. Trace:
I20260709 12:57:42.253472  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.254015  1570 rpcz_store.cc:276] 0709 12:57:40.655818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.661087 (+  5269us) service_pool.cc:224] Handling call
0709 12:57:40.661445 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:41.847769 (+1186324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.253357 (+405588us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54001644d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:42.253528 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121930496}
I20260709 12:57:42.255196  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.255749  1570 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
W20260709 12:57:42.256683  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 54725.6us
I20260709 12:57:42.257956  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.258142  3715 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:42.238894  3767 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.259209  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.259413  3699 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.260357  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.261099  1567 raft_consensus.cc:2393] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:42.261811  1686 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.262344  3420 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.263993  3742 raft_consensus.cc:3055] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:42.264400  3742 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:42.264555  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:42.215626  3582 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.265303  3742 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.268260  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:42.265322  1638 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:42.261783  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.269966  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:42.270481  1567 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:42.254231  1565 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
W20260709 12:57:42.238953  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2736343469999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 12:57:42.203985  1566 rpcz_store.cc:276] 0709 12:57:40.602752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.602867 (+   115us) service_pool.cc:224] Handling call
0709 12:57:40.603275 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:40.603803 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:40.603847 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:40.615395 (+ 11548us) log.cc:844] Serialized 52 byte log entry
0709 12:57:40.704026 (+ 88631us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:40.727841 (+ 23815us) log.cc:844] Serialized 14 byte log entry
0709 12:57:41.483573 (+755732us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18001f1f20. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:57:42.201749 (+718176us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b18001f1f20. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a3f649a40 00007f6a3f6444e4 00007f6a3f644455 00007f6a4612c3c7 00007f6a4273e9a7 00007f6a4274e0bf 00007f6a4274e038
0709 12:57:42.203103 (+  1354us) log.cc:844] Serialized 14 byte log entry
0709 12:57:42.203316 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.203391 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:42.203439 (+    48us) raft_consensus.cc:1685] finished
0709 12:57:42.203450 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.203566 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1352148,"prepare.queue_time_us":1506759,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":10758,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":14131,"spinlock_wait_cycles":12071040,"thread_start_us":88220,"threads_started":1,"wal-append.queue_time_us":243007}
I20260709 12:57:42.240837  3700 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.241791  3460 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:42.180763  3716 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.243620  1716 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:42.272778  1612 connection.cc:256] RPC call timeout handler was delayed by -1.270034346999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
I20260709 12:57:42.271505  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:42.277967  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.288877  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.280972  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:42.293382  1718 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:42.293473  1638 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.293797  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.294546  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.292220  1567 raft_consensus.cc:2410] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:42.296828  1567 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:42.282120  1537 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.298198  1567 raft_consensus.cc:1240] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:57:42.299953  1537 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:42.275982  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:42.285187  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:42.301656  1713 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.290640  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:42.304129  1640 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.305244  3767 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.286408  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.308070  1537 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.308769  3767 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.312104  3767 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.269204  3273 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.314990  3460 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.316773  1537 leader_election.cc:400] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6.
I20260709 12:57:42.317234  3460 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:42.258177  3634 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:42.318737  3634 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:42.319497  3634 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.287760  3699 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:42.321143  3699 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:42.323268  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:42.323947  1570 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:42.322077  1566 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:42.323738  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:42.289954  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:42.327363  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:42.328125  1564 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:42.326876  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.332834  1713 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:42.279157  3742 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.334936  1566 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:42.336879  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.338095  1717 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:42.337086  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:42.340696  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.333818  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.238586  3749 tablet_copy_client.cc:323] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
W20260709 12:57:42.345515  3758 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.480s	user 0.003s	sys 0.000s
I20260709 12:57:42.334228  3712 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:42.346781  3712 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:42.347779  3712 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.349928  1567 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:42.236829  3765 consensus_queue.cc:1059] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
W20260709 12:57:42.339504  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2529343469999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 12:57:42.355875  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2313343469999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 12:57:42.351315  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1359) took 1174 ms. Trace:
I20260709 12:57:42.341351  1638 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:42.355865  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:42.357961  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2178343469999504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 12:57:42.353610  1564 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:42.368405  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1360) took 1163 ms. Trace:
I20260709 12:57:42.368963  1566 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:57:42.370961  1566 pending_rounds.cc:85] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 1
I20260709 12:57:42.371225  1566 pending_rounds.cc:107] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:42.371501  1566 raft_consensus.cc:2889] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:42.355423  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.356587  1639 rpcz_store.cc:276] 0709 12:57:41.176790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.384410 (+207620us) service_pool.cc:224] Handling call
0709 12:57:41.418808 (+ 34398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:42.067472 (+648664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:42.067502 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:42.073778 (+  6276us) log.cc:844] Serialized 26 byte log entry
0709 12:57:42.181842 (+108064us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:42.181896 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.182891 (+   995us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:42.351162 (+168271us) raft_consensus.cc:1685] finished
0709 12:57:42.351176 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.351271 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":669238,"raft.queue_time_us":646345,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":8836,"thread_start_us":107675,"threads_started":1,"wal-append.queue_time_us":270025}
I20260709 12:57:42.373804  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:42.374454  1718 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.374622  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.288441  3700 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.355594  3728 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.322077  3699 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.368942  1568 rpcz_store.cc:276] 0709 12:57:41.204623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.945363 (+740740us) service_pool.cc:224] Handling call
0709 12:57:41.945640 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:41.945796 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:41.945810 (+    14us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:41.953372 (+  7562us) log.cc:844] Serialized 26 byte log entry
0709 12:57:42.002026 (+ 48654us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:42.352955 (+350929us) log.cc:844] Serialized 14 byte log entry
0709 12:57:42.368027 (+ 15072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.368125 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:42.368178 (+    53us) raft_consensus.cc:1685] finished
0709 12:57:42.368195 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.368334 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214494,"prepare.queue_time_us":200480,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"thread_start_us":174301,"threads_started":2,"wal-append.queue_time_us":171917}
I20260709 12:57:42.400370  1568 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 5. Ops: []
I20260709 12:57:42.401043  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.373910  3568 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:42.403512  1564 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:42.370121  3266 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:42.433372  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 74929.1us
I20260709 12:57:42.436396  3710 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.442194  1640 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
W20260709 12:57:42.442745  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1638343469999768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
I20260709 12:57:42.398722  3765 consensus_queue.cc:1243] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 6.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:42.416625  3761 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.447000  3716 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:42.447099  2344 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:42.416349  3642 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:42.445976  1564 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:57:42.449618  1564 pending_rounds.cc:85] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 1
I20260709 12:57:42.449864  1564 pending_rounds.cc:107] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:42.450151  1564 raft_consensus.cc:2889] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:42.451078  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 76512.1us
I20260709 12:57:42.452359  1537 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.403091  3728 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.460970  1564 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:42.462932  1564 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:42.463301  1564 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:42.464120  1564 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.445214  3568 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:42.466671  1564 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.469259  1718 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
W20260709 12:57:42.474299  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1206343469999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 12:57:42.475255  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1206343469999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 12:57:42.475667  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0234343469999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2335s for a response
I20260709 12:57:42.510669  3530 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.450008  3710 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:42.553838  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 76886.8us
I20260709 12:57:42.472867  3761 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:42.668017  3147 raft_consensus.cc:3055] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:42.669726  3147 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:42.670774  3763 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:42.670701  3147 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.671772  3147 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:42.570780  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.655995  3423 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:42.662719  3760 consensus_meta.cc:287] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.008s
I20260709 12:57:42.672938  3682 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.673688  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1358) took 1469 ms. Trace:
I20260709 12:57:42.674422  3682 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.675069  3710 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:42.674124  1563 rpcz_store.cc:276] 0709 12:57:41.204085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.917018 (+712933us) service_pool.cc:224] Handling call
0709 12:57:41.932807 (+ 15789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:41.955644 (+ 22837us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:57:42.374518 (+418874us) log.cc:844] Serialized 14 byte log entry
0709 12:57:42.673286 (+298768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:42.673348 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:42.673412 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.673490 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.673624 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238252,"prepare.queue_time_us":239028,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":1605,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":363738,"threads_started":2}
I20260709 12:57:42.676898  3539 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:42.677096  1564 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 12:57:42.677412  3539 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:42.677547  1564 pending_rounds.cc:85] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 1
I20260709 12:57:42.678069  1564 pending_rounds.cc:107] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:42.673198  3760 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.679103  1566 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:42.678654  3539 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.680037  3539 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.645795  1570 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:42.653689  3771 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.212s	user 0.001s	sys 0.017s
I20260709 12:57:42.670928  1537 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.684185  1537 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.681459  1566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:45038
I20260709 12:57:42.685334  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.686012  1569 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
W20260709 12:57:42.663594  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 186075us
I20260709 12:57:42.509145  3568 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.692072  3768 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.665939  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.180050  1647 rpcz_store.cc:276] 0709 12:57:41.122801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.128722 (+  5921us) service_pool.cc:224] Handling call
0709 12:57:41.128999 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:41.129182 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:41.269910 (+140728us) log.cc:844] Serialized 14 byte log entry
0709 12:57:42.177077 (+907167us) log.cc:844] Serialized 14 byte log entry
0709 12:57:42.179406 (+  2329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:42.179454 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:42.179495 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.179565 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.179670 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":589694,"prepare.queue_time_us":91244,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":590625,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":2976,"thread_start_us":457157,"threads_started":3,"wal-append.queue_time_us":284661}
I20260709 12:57:42.673097  3423 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.678370  1564 raft_consensus.cc:2889] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:42.694711  2342 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:57:42.652565  3782 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.211s	user 0.012s	sys 0.005s
I20260709 12:57:42.687464  1566 raft_consensus.cc:476] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Not starting forced leader election -- already a leader
I20260709 12:57:42.696444  3423 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:42.696943  3759 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:42.697160  1566 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:42.697520  1570 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:57:42.698915  1570 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:42.685563  3763 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.700718  3760 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:42.681737  3785 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.236s	user 0.002s	sys 0.005s
I20260709 12:57:42.689926  1569 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:42.692998  1572 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:42.694813  1564 pending_rounds.cc:107] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:57:42.708539  1564 raft_consensus.cc:2889] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:42.711354  1566 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:42.677594  1563 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:42.474848  3582 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:42.688269  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:42.713238  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.714254  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:42.733716  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:42.734915  1716 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:42.739193  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:42.739866  1564 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.743528  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:42.752260  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:42.751281  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:42.743060  3700 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:42.757009  1537 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.723944  3423 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:57:42.727154  3582 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.753968  3728 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:42.769783  1564 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:42.754601  3768 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.754451  3266 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 12:57:42.783273  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 089ef23951ac45c3a80b53b6e8127c61: Illegal state: Replica 2af567a273d44ca89d2b3b0f7c815bd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:42.767273  3765 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.783780  3420 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.752067  3759 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:57:42.787212  1537 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:42.788458  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 66948.2us
W20260709 12:57:42.790598  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 102431us
I20260709 12:57:42.791992  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:42.795912  2347 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:42.795889  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:42.792897  3760 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:42.807163  3420 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:42.807757  3420 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:42.808267  3420 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.810123  2343 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:57:42.804665  3781 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:57:42.805392  3765 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.817010  3669 ts_tablet_manager.cc:1929] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:57:42.818035  3669 log.cc:1199] T acc3fcdecc7546fe92075e15e904c331 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/acc3fcdecc7546fe92075e15e904c331
I20260709 12:57:42.805662  3760 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:42.791170  3768 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 12:57:42.821118  3783 log.cc:927] Time spent T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:57:42.820277  3669 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46146 (request call id 82) took 3215 ms. Trace:
W20260709 12:57:42.818694  3784 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:57:42.830148  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:42.841701  1640 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:42.842231  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 46422.6us
I20260709 12:57:42.842854  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:42.843390  3794 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.843793  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:42.844520  3792 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:42.845661  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:42.846989  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:42.830427  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:42.831336  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:42.831601  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.832190  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:42.833910  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.850641  1641 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:42.851089  1645 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:42.851027  1720 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 1.
I20260709 12:57:42.834231  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:42.834595  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.835394  1638 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:42.836526  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:42.853040  1718 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:42.837569  1644 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:42.853514  1640 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:57:42.854164  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.854852  3792 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:42.854581  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:42.857820  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:42.857936  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.818420  3685 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.860394  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet 598f1b27b4ab45cfac5cc13489b2e687 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:57:42.861063  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet 598f1b27b4ab45cfac5cc13489b2e687 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-598f1b27b4ab45cfac5cc13489b2e687
I20260709 12:57:42.865397  3423 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:42.872925  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 180) took 1451 ms. Trace:
I20260709 12:57:42.873284  1565 rpcz_store.cc:276] 0709 12:57:41.421108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:42.296041 (+874933us) service_pool.cc:224] Handling call
0709 12:57:42.296544 (+   503us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:42.297402 (+   858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:42.297466 (+    64us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:42.298383 (+   917us) log.cc:844] Serialized 52 byte log entry
0709 12:57:42.399940 (+101557us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:42.421785 (+ 21845us) log.cc:844] Serialized 14 byte log entry
0709 12:57:42.429734 (+  7949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.429817 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:42.872704 (+442887us) raft_consensus.cc:1685] finished
0709 12:57:42.872730 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.872870 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7655,"prepare.queue_time_us":33166,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":201,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":3248,"thread_start_us":100880,"threads_started":1,"wal-append.queue_time_us":161058}
I20260709 12:57:42.874920  2314 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:42.875170  3582 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:42.876075  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:42.855400  3147 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:42.859207  3742 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.890893  1535 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:42.893945  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:42.894763  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.895615  1563 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:42.897085  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.897396  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.897881  1564 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:42.888265  3461 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:42.903338  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.898380  1563 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:42.911065  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.888142  3441 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:42.905588  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:42.912037  1569 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:42.912165  1570 raft_consensus.cc:2393] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:42.890640  3423 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:42.920486  1565 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:42.902626  3273 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:42.889513  3642 consensus_queue.cc:1059] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:57:42.927343  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 48053us
I20260709 12:57:42.927968  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:42.929191  1564 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.890406  3568 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:57:42.930676  1730 tablet_copy_source_session.cc:215] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:42.911345  3461 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:42.827402  3669 rpcz_store.cc:276] 0709 12:57:39.604791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:39.605178 (+   387us) service_pool.cc:224] Handling call
0709 12:57:39.972245 (+367067us) ts_tablet_manager.cc:1151] Deleting tablet acc3fcdecc7546fe92075e15e904c331
0709 12:57:39.983387 (+ 11142us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:57:42.318839 (+2335452us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:42.816854 (+498015us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:42.820200 (+  3346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1750417,"tablet-delete.queue_time_us":325018,"thread_start_us":154656,"threads_started":1}
I20260709 12:57:42.912945  3441 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:42.932245  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 85338.5us
I20260709 12:57:42.900496  3147 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.935045  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:42.889012  3760 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.902355  3742 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.937320  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:42.937929  1564 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:42.938795  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:42.935699  3441 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.929443  3273 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:42.941685  3797 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.940876  3768 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:42.942027  3273 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:42.950742  3703 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.934890  3461 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.930034  3423 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:42.940569  3791 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:42.963835  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 159) took 1521 ms. Trace:
W20260709 12:57:42.964947  3751 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 1.131s	user 0.004s	sys 0.011s
I20260709 12:57:42.967594  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1358) took 1798 ms. Trace:
I20260709 12:57:42.968123  3749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598f1b27b4ab45cfac5cc13489b2e687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:42.968794  3760 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.969019  3683 raft_consensus.cc:2764] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:57:42.969460  3794 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.972440  3797 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.967921  1643 rpcz_store.cc:276] 0709 12:57:41.168911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.260259 (+ 91348us) service_pool.cc:224] Handling call
0709 12:57:41.261628 (+  1369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:41.267887 (+  6259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:41.267947 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:41.419542 (+151595us) log.cc:844] Serialized 52 byte log entry
0709 12:57:41.513817 (+ 94275us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:41.513869 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:41.513954 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:42.964289 (+1450335us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:42.967330 (+  3041us) raft_consensus.cc:1685] finished
0709 12:57:42.967348 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.967539 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5564,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":91630976,"thread_start_us":46310,"threads_started":1,"wal-append.queue_time_us":388054}
I20260709 12:57:42.983310  1568 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:57:42.983824  1568 pending_rounds.cc:85] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 2
I20260709 12:57:42.984154  1568 pending_rounds.cc:107] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:42.984462  1568 raft_consensus.cc:2889] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:42.984874  1568 pending_rounds.cc:107] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:57:42.985184  1568 raft_consensus.cc:2889] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:42.963306  3791 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:42.964236  1712 rpcz_store.cc:276] 0709 12:57:41.441970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.448296 (+  6326us) service_pool.cc:224] Handling call
0709 12:57:41.458189 (+  9893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:41.547996 (+ 89807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:41.548045 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:41.548105 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:41.548146 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.957628 (+1409482us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b54002dee54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:42.959523 (+  1895us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.963770 (+  4247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206022400}
I20260709 12:57:42.997251  3423 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:42.993758  3791 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.982172  3420 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:43.009920  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 71198us
I20260709 12:57:43.014218  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:43.012305  3147 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.012392  3266 raft_consensus.cc:3055] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:43.016400  3266 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:43.017370  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:43.018056  1719 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:43.017964  3266 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.019371  3266 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.019338  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:43.019835  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1375) took 1185 ms. Trace:
I20260709 12:57:43.020226  1568 rpcz_store.cc:276] 0709 12:57:41.834736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:42.442115 (+607379us) service_pool.cc:224] Handling call
0709 12:57:42.442444 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:42.988731 (+546287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:43.019626 (+ 30895us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400134054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:43.019781 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239023872}
I20260709 12:57:43.017555  3742 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.022135  3423 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:43.017370  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:43.028661  3423 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:43.029148  3423 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.025041  3500 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.032583  3800 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:43.033025  3800 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:43.033872  3800 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.035039  3800 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:43.035983  3791 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.040048  3791 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.041602  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:43.023836  3147 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:43.048751  3147 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:43.037883  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1634) took 1073 ms. Trace:
I20260709 12:57:43.044987  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:43.049208  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:43.049340  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:43.050143  3797 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:43.050215  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:43.050894  3797 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.051344  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:43.051858  1646 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.049156  1566 rpcz_store.cc:276] 0709 12:57:41.964380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:42.698846 (+734466us) service_pool.cc:224] Handling call
0709 12:57:42.710672 (+ 11826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:42.712001 (+  1329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:43.037690 (+325689us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5400311fd0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:43.037824 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26444032}
I20260709 12:57:43.055043  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:43.055631  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:43.056877  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:43.058204  3794 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:43.058324  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:43.058614  3794 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:43.058754  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:43.063397  1646 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:43.065546  1684 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.049135  3147 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:43.111493  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:43.080569  3420 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.080760  3804 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:43.060364  3461 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.156425  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:43.091172  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:43.197556  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 106480us
I20260709 12:57:43.198912  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:43.039844  3441 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.059044  3794 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.205783  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:43.112092  3703 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.196671  3712 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:57:43.226476  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 78514.5us
I20260709 12:57:43.208961  3797 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:43.205482  3710 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:43.231403  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 172701us
I20260709 12:57:43.232823  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:43.238049  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:43.239297  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:43.222556  3715 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:43.224433  3791 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:43.242100  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:43.256539  3797 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.221778  3703 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.263814  3710 raft_consensus.cc:697] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:43.245010  3683 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:43.258131  2345 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:43.247992  3712 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:43.271509  3683 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:43.281337  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.282040  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.282177  1566 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:43.284036  2312 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.285965  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:43.257844  3808 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:43.290894  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:43.291669  1719 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.294113  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:43.294880  1568 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
W20260709 12:57:43.296705  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 45070.5us
I20260709 12:57:43.267813  3807 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:43.297804  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.269917  3742 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.301208  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.286864  3683 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.288456  3460 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:43.303098  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:43.303785  3710 consensus_queue.cc:237] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.299176  3802 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:43.307745  3461 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.302368  3804 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:43.321581  2343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 312) took 1875 ms (client timeout 2143 ms). Trace:
W20260709 12:57:43.322052  2343 rpcz_store.cc:269] 0709 12:57:41.446370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.452740 (+  6370us) service_pool.cc:224] Handling call
0709 12:57:43.321361 (+1868621us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54004b9454. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:43.321488 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634726144}
I20260709 12:57:43.323172  3712 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.315966  3460 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:57:43.319403  3767 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:57:43.325133  3460 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.318620  3804 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:43.337119  3804 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:43.341547  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:43.343462  1719 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:43.332505  3147 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.345810  3775 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:43.346204  3775 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:43.346556  3775 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:43.297909  3813 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:57:43.336412  3808 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:43.350220  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:43.302348  3742 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.365401  1642 raft_consensus.cc:2410] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:57:43.371454  3797 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:43.374203  3804 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.375851  3794 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.378515  3794 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.381250  3804 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.385352  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:43.386623  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:43.388010  1643 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:43.399859  3441 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.400895  3742 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:43.414970  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:43.407243  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 106070us
I20260709 12:57:43.419305  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.421341  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.426362  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.432241  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1361) took 1993 ms. Trace:
I20260709 12:57:43.433961  1567 rpcz_store.cc:276] 0709 12:57:41.438700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:42.306061 (+867361us) service_pool.cc:224] Handling call
0709 12:57:42.306394 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:42.350888 (+ 44494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:43.431996 (+1081108us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b54003b0954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:43.432178 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76688256}
I20260709 12:57:43.430303  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.424130  2341 raft_consensus.cc:2368] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7.
I20260709 12:57:43.342944  3683 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.429853  3703 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:43.429577  3804 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:43.458814  3767 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:43.459219  3423 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.462754  3749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59826 (request call id 324) took 2023 ms. Trace:
I20260709 12:57:43.469940  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.435403  3797 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:43.476740  1566 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
W20260709 12:57:43.500048  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 199770us
I20260709 12:57:43.506609  1641 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:43.507290  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 77054.9us
I20260709 12:57:43.430660  3794 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:43.525065  2314 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:43.525946  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.508543  1643 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
W20260709 12:57:43.527312  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 57471.6us
I20260709 12:57:43.528855  1535 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.530752  1639 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:43.507054  3765 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:43.508103  3804 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:43.535009  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:43.536777  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.542198  1719 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:43.536059  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:43.545145  1718 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:57:43.545849  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:43.536748  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:43.509569  3483 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:43.541359  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.506193  3147 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.526224  3797 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:43.548770  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:43.555169  1719 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:43.548455  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:43.533926  3768 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:57:43.556100  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 134132us
I20260709 12:57:43.557693  1718 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:57:43.537067  3199 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:43.556488  2314 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.540025  3803 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:43.561070  1643 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:43.561857  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.562027  1641 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:43.539534  3441 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:43.560737  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.538667  3794 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:43.538504  3765 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:43.547873  3804 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.565291  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.580276  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.581262  1570 raft_consensus.cc:2368] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5.
I20260709 12:57:43.568231  1686 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.550148  3266 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:43.533372  3813 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:57:43.539448  3500 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:57:43.562718  3673 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:43.559521  3797 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.543514  3767 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.558812  3814 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:43.589995  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:43.591775  1568 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:43.566262  3803 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:43.580097  3147 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:43.600555  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.582279  3441 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:43.605455  1565 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:43.585309  3820 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:43.619829  1643 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:43.637642  1645 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:42.876792   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:43.593132  3616 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:43.607242  1686 leader_election.cc:400] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5.
I20260709 12:57:43.658443  1686 leader_election.cc:403] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:43.597231  3803 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.591583  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:43.649607  1645 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:43.652591  1567 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:57:43.652454  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:43.599520  3814 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:43.632691  3147 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:43.651862  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.681504  1572 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:43.658864  1644 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.663805  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:43.683144  1571 raft_consensus.cc:2393] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:43.667201  1565 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:43.683617  3824 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:43.671669  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 105996us
I20260709 12:57:43.656064  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.684791  1569 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.686185  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:43.649991  3616 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:43.689458  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:43.609808  3808 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:57:43.693503  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.696121  1565 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.694773  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:43.694195  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:43.697104  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 90004us
I20260709 12:57:43.698096  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.654208  3820 raft_consensus.cc:697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:43.669397  3483 raft_consensus.cc:697] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:43.696524  3827 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.710063  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:43.519011  3749 rpcz_store.cc:276] 0709 12:57:41.443404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.445377 (+  1973us) service_pool.cc:224] Handling call
0709 12:57:41.984477 (+539100us) ts_tablet_manager.cc:934] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
0709 12:57:42.966800 (+982323us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:43.333737 (+366937us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:43.333852 (+   115us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:43.461698 (+127846us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:43.462117 (+   419us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:43.462555 (+   438us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:43.462647 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":54029,"tablet-copy.queue_time_us":430743,"thread_start_us":216752,"threads_started":2}
I20260709 12:57:43.682641  3710 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:43.695990  3616 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.690538  3810 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.733845  1565 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:43.740837  1644 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:43.695369  3266 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:43.748762  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.691824  1563 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
W20260709 12:57:43.745288  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:43.713937  3683 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.712560  3483 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.724264  2342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 330) took 1705 ms. Trace:
I20260709 12:57:43.741473  3716 raft_consensus.cc:2764] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:57:43.682801  3816 consensus_queue.cc:1059] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:57:43.690089  3699 consensus_queue.cc:1059] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:57:43.764983  1644 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.745749  1469 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 4, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:43.733803  3423 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:43.754390  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44395.1us
I20260709 12:57:43.753831  3792 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:57:43.759282  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 70149.4us
I20260709 12:57:43.748445  3749 tablet_copy_client.cc:806] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:43.713310  3794 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.690254  3712 consensus_queue.cc:1059] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:57:43.763015  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.775086  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:43.736356  3441 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.778439  2346 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:57:43.779078  3819 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:57:43.779379  3749 tablet_copy_client.cc:670] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:43.777331  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:43.761070  3812 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:43.764580  3825 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:43.786723  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:43.790081  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 403250us
I20260709 12:57:43.792207  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:43.792821  1639 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:43.794103  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:43.794636  1644 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:43.794778  1639 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:43.758368  3768 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:57:43.798660  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:43.801059  1569 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:43.785359  3683 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:57:43.805047  1535 consensus_peers.cc:597] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:43.808506  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.610860  3500 raft_consensus.cc:2955] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:43.788868  3832 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:43.797043  3767 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:43.802443  3732 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.758248  2342 rpcz_store.cc:276] 0709 12:57:42.005225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:42.006025 (+   800us) service_pool.cc:224] Handling call
0709 12:57:42.694419 (+688394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:42.695279 (+   860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:43.686226 (+990947us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54004cac50. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:43.710887 (+ 24661us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471909760}
I20260709 12:57:43.804591  3710 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:43.818136  3812 consensus_queue.cc:1059] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:57:43.819684  3817 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:57:43.820590  3818 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:57:43.782642  3820 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.771687  3147 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.821337  3828 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:43.846012  3828 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:43.846490  3828 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.846596  3838 consensus_queue.cc:1059] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:43.804844  3199 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:43.802737  3460 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:43.806049  3683 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:57:43.830318  3821 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:57:43.800220  3266 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.827800  3710 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:43.758958  3814 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.830905  1712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:43.881438  1712 raft_consensus.cc:606] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:43.883769  1719 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:43.885298  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:43.887209  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 88ae4cb056ac43519786f1fb62431bc4: Illegal state: Replica 2af567a273d44ca89d2b3b0f7c815bd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:43.860483  1612 leader_election.cc:400] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5.
I20260709 12:57:43.888316  1612 leader_election.cc:403] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:57:43.889788  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:43.891086  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.892002  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.863643  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:43.866217  2342 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:57:43.865272  1640 raft_consensus.cc:2955] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:43.851635  3767 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:43.913352  3767 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.913779  3803 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.873030  1639 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:43.889164  3765 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.915401  3767 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:43.915666  3765 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:43.897348  3634 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:43.817344  3832 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.874356  3710 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.901595  1719 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:57:43.851694  3768 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:43.827057  3732 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.854748  3460 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.903708  3827 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:43.906340  1714 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:43.907478  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:43.941171  3841 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:43.927953  1568 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:57:43.915932  3813 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5.
I20260709 12:57:43.907425  3810 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5.
I20260709 12:57:43.908869  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "508332d25a2b4288bc6411b566044758"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
W20260709 12:57:43.909447  3775 consensus_meta.cc:287] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.000s
I20260709 12:57:43.910609  1712 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:43.862414  1572 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:43.953430  1713 raft_consensus.cc:606] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:43.915722  3803 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:43.893580  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.924345  3831 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.923692  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.963521  1570 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.924136  3760 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.921576  3199 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.926425  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:43.927373  3832 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:43.941790  3841 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.872814  3699 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:43.928076  3836 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:43.930274  3673 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:43.967305  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 74648us
I20260709 12:57:43.965221  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:43.996305  1720 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:43.988790  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.931770  3824 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:57:44.001492  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:43.958617  1712 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:43.961942  3800 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:44.009919  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:44.013988  1570 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
W20260709 12:57:44.011317  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 208605us
I20260709 12:57:43.916316  3683 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:43.980346  3792 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:44.019452  2312 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:44.023802  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:43.986414  3699 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:43.937011  3829 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:57:44.065958  1564 raft_consensus.cc:2368] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4.
W20260709 12:57:44.094894  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 75687.5us
I20260709 12:57:44.101222  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:43.943665  3768 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.979514  3712 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:57:44.108325  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:44.109081  1572 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:44.114317  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 112920us
I20260709 12:57:43.962652  3767 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:57:44.115083  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:43.977731  3760 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.963719  3775 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:43.979956  3199 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.010087  3836 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:44.102262  3699 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:44.098222  3792 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:44.105262  3539 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:44.195076  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 68574.8us
I20260709 12:57:44.093390  3673 raft_consensus.cc:697] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:44.168467  3835 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:44.165762  3703 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:44.165897  3829 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.247674  1572 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
W20260709 12:57:44.196476  3804 consensus_meta.cc:287] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.003s
I20260709 12:57:44.028684  3800 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.189596  3827 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:44.166775  3683 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:44.264271  3834 consensus_queue.cc:1175] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" responder_term: 6 status { last_received { term: 4 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: [5.8-5.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:57:44.277077  3835 raft_consensus.cc:697] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:44.398206  3850 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:44.398959  3850 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.399319  3835 consensus_queue.cc:237] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.401721  3760 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:44.286168  3843 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:57:44.404372  3775 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:44.254021  3703 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:44.405717  3703 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:44.405870  3742 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.406807  3742 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.300496  3829 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:44.226728  3805 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 12:57:44.410854  3616 consensus_meta.cc:287] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.664s	user 0.010s	sys 0.001s
I20260709 12:57:44.199826  3807 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:44.411386  3616 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.412194  3807 raft_consensus.cc:697] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:44.413307  3807 consensus_queue.cc:237] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.221885  3792 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:44.259541  3804 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.374127  3824 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.258324  3803 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.376307  3199 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:44.377408  3732 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:44.377885  3800 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:44.378966  3768 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:44.168606  1712 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.380614  3841 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:44.383026  3673 consensus_queue.cc:237] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.384449  3460 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:44.278735  3836 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.226019  3812 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:44.430197  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:44.432065  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.033s	sys 0.042s
W20260709 12:57:44.486505  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.033s	sys 0.042s
W20260709 12:57:44.486820  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 609126us
I20260709 12:57:44.410739  3829 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:44.421298  3797 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.821s	user 0.008s	sys 0.004s
W20260709 12:57:44.445165  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.033s	sys 0.054s
W20260709 12:57:44.504072  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.033s	sys 0.054s
W20260709 12:57:44.451831  1718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.021s	sys 0.039s
W20260709 12:57:44.504575  1718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.021s	sys 0.039s
W20260709 12:57:44.483006  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 367965us
I20260709 12:57:44.492074  3800 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.492767  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:44.504462  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 698128us
I20260709 12:57:44.427222  3539 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.509147  1572 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:44.510203  1644 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:44.515769  1647 raft_consensus.cc:3055] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:44.516168  1647 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:57:44.492441  3838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.000s	sys 0.010s
I20260709 12:57:44.522073  2312 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:44.493468  3199 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.508843  1712 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:44.524565  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 301692us
I20260709 12:57:44.503584  3732 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.514515  3768 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:44.527570  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:44.527544  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:44.531112  1564 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:44.531672  1569 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:57:44.522398  1647 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:44.532570  1537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.011s	sys 0.009s
W20260709 12:57:44.532917  1537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.009s
I20260709 12:57:44.509200  3841 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:44.444823  3803 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.514424  3829 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:44.528465  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:44.523048  3838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.000s	sys 0.011s
I20260709 12:57:44.518568  3742 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:44.538250  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:44.542625  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 427705us
I20260709 12:57:44.542932  1566 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
W20260709 12:57:44.536891  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 611202us
I20260709 12:57:44.543699  1570 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:44.540952  1647 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:44.546533  1612 leader_election.cc:400] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4.
I20260709 12:57:44.547084  1612 leader_election.cc:403] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:57:44.547868  1537 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:44.433002  3824 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.545008  2314 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:44.554793  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:44.517526  3800 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.559819  1564 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:44.513835  3797 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.526074  3810 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:57:44.569219  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:44.509716  3812 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:44.574198  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:44.576508  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:44.535934  3732 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.578459  3851 consensus_queue.cc:1059] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:57:44.578819  3858 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:44.579326  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:44.529385  3199 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.580510  1641 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:44.549894  3829 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.589906  3824 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:44.580243  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:44.590723  1645 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:44.562744  3835 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4.
I20260709 12:57:44.583261  3811 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:44.615774  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:44.584415  3857 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.584992  3483 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:44.584843  3853 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:57:44.618393  3857 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.585583  3851 raft_consensus.cc:3055] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:44.619733  3851 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:44.577139  1642 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:44.621289  3857 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:44.547597  3841 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.623910  3841 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:44.622444  3858 raft_consensus.cc:697] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:44.610344  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:44.584065  3833 raft_consensus.cc:3055] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:44.540324  3768 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.626298  1564 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:44.626679  3833 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:44.628065  3833 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.629531  3833 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:44.574548  3850 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:44.644935  1642 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:44.590092  3829 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:44.576808  3616 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:44.650210  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 95462.3us
I20260709 12:57:44.647619  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:44.673799  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 136966us
W20260709 12:57:44.677192  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:44.642387  3811 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:44.575244  3791 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:57:44.670977  1642 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:57:44.733160  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 81294.1us
I20260709 12:57:44.637164  3858 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.593775  3147 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 12:57:42.942058  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet acc3fcdecc7546fe92075e15e904c331 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:57:45.050624  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:45.050756  1456 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 2.10862e+06us
I20260709 12:57:44.800014  1647 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:57:44.825261  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:45.052932  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 505117us
W20260709 12:57:44.807242  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:45.054872  1642 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:44.645346  3483 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:45.188184  3829 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.056084  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:44.820675  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:44.750190  3539 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:44.813010  1469 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 5, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:44.833997  1643 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:45.057206  1639 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:45.227592  1569 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:45.055810  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:45.063253  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:45.123296  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 69406.3us
W20260709 12:57:45.061299  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:45.126502  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:45.132081  2315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.011s
I20260709 12:57:45.232968  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:45.119475  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.011s
I20260709 12:57:45.125335  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:45.233814  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.001s	sys 0.015s
W20260709 12:57:44.801172  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 253615us
I20260709 12:57:45.074542  1564 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:45.237545  1647 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:45.236804  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:45.057984  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:45.232697  1570 raft_consensus.cc:2410] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:57:45.233357  2315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.000s	sys 0.015s
W20260709 12:57:45.149602  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:45.070487  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:44.872751  3866 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:57:44.666253  3634 consensus_meta.cc:287] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
W20260709 12:57:44.906657  3699 consensus_meta.cc:287] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.000s
W20260709 12:57:44.892933  3864 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
W20260709 12:57:45.176067  3710 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.221s	user 0.012s	sys 0.000s
W20260709 12:57:45.120263  3828 consensus_meta.cc:287] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.273s	user 0.011s	sys 0.001s
I20260709 12:57:44.807695  3860 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.750986  3827 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:44.741701  3742 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:44.872217  3861 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:45.251125  3836 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:45.048627  3834 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:57:44.901213  3837 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:57:44.874009  3859 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:44.855187  3855 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:57:45.237116  2341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 336) took 2135 ms (client timeout 2831 ms). Trace:
W20260709 12:57:45.253542  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:45.235805  1642 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:44.814898  3716 raft_consensus.cc:3055] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:44.808949  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:44.873651  3854 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.703s
W20260709 12:57:45.262140  1568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.013s	sys 0.017s
I20260709 12:57:45.132393  3835 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.120942  3807 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:44.857542  3732 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:44.902001  3803 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:44.901783  3768 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:45.173784  3857 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:44.734297  3804 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:45.227375  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:44.877296  3199 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:45.056898  3811 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:45.187855  3872 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:44.834808  3853 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.462s
I20260709 12:57:45.253305  1646 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
W20260709 12:57:45.252450  3831 consensus_meta.cc:287] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.272s	user 0.012s	sys 0.000s
I20260709 12:57:45.242539  1566 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:45.273736  1642 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:45.187696  3500 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.076s
W20260709 12:57:45.272881  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:45.263928  3634 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.189854  3829 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:44.759084  3850 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.507s
I20260709 12:57:45.182610  3863 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.758908  3616 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.508s
I20260709 12:57:45.248162  3841 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:57:45.264703  3810 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:57:45.263422  3710 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:45.373512  3884 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.798491  3835 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:45.799021  3884 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:45.487406  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:45.263816  3742 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:45.800860  3831 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:45.725692  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:45.735648  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1337) took 1854 ms. Trace:
W20260709 12:57:45.839891  1568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.022s	sys 0.022s
I20260709 12:57:44.814347  3800 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:45.516882  3864 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:57:45.857602  1640 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:45.796193  3882 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.877137  1640 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
W20260709 12:57:45.271502  3792 consensus_meta.cc:287] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.003s
W20260709 12:57:45.824915  2312 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 2.806s (SENT) [suppressed 39 similar messages]
W20260709 12:57:45.630084  3703 consensus_meta.cc:287] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.224s	user 0.013s	sys 0.000s
W20260709 12:57:45.736411  3837 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.318s	user 0.000s	sys 0.000s
I20260709 12:57:45.542629  3539 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.516251  3861 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.252491  3699 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:45.863106  3634 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:45.275363  3716 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:45.884825  3872 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:45.626775  3765 consensus_meta.cc:287] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.710s	user 0.013s	sys 0.000s
I20260709 12:57:45.273648  3834 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:45.322253  3797 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:45.890551  3732 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.838696  3742 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:45.586715  3147 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:45.264086  3828 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:45.891803  3716 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:45.800901  3807 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:45.270558  3836 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:45.885658  3873 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 12:57:45.857879  3803 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:45.865198  3804 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:45.374563  3877 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.858103  3880 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:45.904322  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.014s	sys 0.049s
I20260709 12:57:45.868367  3831 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:45.892429  3699 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:45.873600  3857 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:45.854630  1718 rpcz_store.cc:276] 0709 12:57:43.881066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.882322 (+  1256us) service_pool.cc:224] Handling call
0709 12:57:43.882722 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:43.927017 (+ 44295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:43.927048 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:43.927460 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:57:44.505146 (+577686us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:44.505202 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:44.822663 (+317461us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b54001054d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:44.822708 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:45.637129 (+814421us) raft_consensus.cc:1685] finished
0709 12:57:45.637159 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:45.735539 (+ 98380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101256064,"thread_start_us":577307,"threads_started":1,"wal-append.queue_time_us":655366}
W20260709 12:57:45.966684  1644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.014s	sys 0.012s
W20260709 12:57:45.967029  1644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.014s	sys 0.012s
I20260709 12:57:45.363060  3876 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:45.290613  3869 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.633s
W20260709 12:57:45.273126  2341 rpcz_store.cc:269] 0709 12:57:43.055231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.055376 (+   145us) service_pool.cc:224] Handling call
0709 12:57:45.121095 (+2065719us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54002ec7d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:45.190338 (+ 69243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672478080}
I20260709 12:57:45.893090  3199 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:45.940814  2314 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:45.361972  3483 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:45.962530  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.014s	sys 0.050s
I20260709 12:57:45.273518  3860 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:45.867065  3863 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:45.983630  1643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.006s	sys 0.007s
W20260709 12:57:45.984982  1643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.007s	sys 0.007s
W20260709 12:57:45.971058  1537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.005s	sys 0.023s
W20260709 12:57:45.958487  1712 consensus_meta.cc:287] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.425s	user 0.014s	sys 0.001s
I20260709 12:57:45.275105  3859 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:45.975096  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 150218us
I20260709 12:57:45.893723  3792 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:45.903697  2345 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:45.902159  3539 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:45.900879  3703 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:45.985461  1537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.006s	sys 0.023s
I20260709 12:57:45.906888  3732 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:45.965617  3868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.007s	sys 0.012s
I20260709 12:57:45.970295  3853 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:46.097819  1639 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
W20260709 12:57:46.032136  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.000s	sys 0.015s
W20260709 12:57:46.098415  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.000s	sys 0.015s
W20260709 12:57:46.008744  3848 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 1.491s	user 0.013s	sys 0.007s
I20260709 12:57:46.101723  1712 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:57:45.971855  3876 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:45.965332  3804 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:45.984398  3500 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.910843  3147 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.002063  1647 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:45.902423  3882 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:46.031909  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:46.120162  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:46.120594  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:46.098809  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 844724us
I20260709 12:57:46.010521  3810 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.975704  3831 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.003425  3870 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.007735  3634 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:45.926666  3716 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:45.979974  3877 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:46.102492  3873 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:57:46.106572  1712 pending_rounds.cc:85] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 6
I20260709 12:57:45.967085  3803 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.097445  3853 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:45.969476  3880 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.100018  2344 raft_consensus.cc:2376] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5. Re-sending same reply.
I20260709 12:57:45.981496  3765 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.130475  3810 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.143621  3710 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:46.152819  1712 pending_rounds.cc:107] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:57:46.109668  3876 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:45.982895  3850 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.154388  3800 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:46.119585  3868 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.986544  3199 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:46.145103  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 106496us
I20260709 12:57:45.901835  3861 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.151176  3634 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.198195  1642 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:57:46.149646  3829 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.120187  3500 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.153501  3768 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.158665  3811 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.228526  1642 pending_rounds.cc:85] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:57:46.210109  1712 raft_consensus.cc:2889] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:46.231901  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:46.232295  1642 pending_rounds.cc:107] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 12:57:46.237454  1642 raft_consensus.cc:2889] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:46.226802  3887 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.238898  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 198) took 1568 ms. Trace:
I20260709 12:57:46.218008  3800 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:46.246402  3800 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:46.245491  3804 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.245711  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1342) took 2341 ms. Trace:
I20260709 12:57:46.246451  3810 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:46.261116  3834 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.244789  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:46.262202  1566 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:46.241981  1642 rpcz_store.cc:276] 0709 12:57:44.670267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.670461 (+   194us) service_pool.cc:224] Handling call
0709 12:57:44.670854 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:46.238616 (+1567762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:46.238834 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:46.250116  3882 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.265672  3882 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.266115  1642 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:46.266280  3882 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.266848  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1419) took 1206 ms. Trace:
I20260709 12:57:46.251034  3879 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:46.251125  3832 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:46.267249  1642 rpcz_store.cc:276] 0709 12:57:45.060655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:46.265570 (+1204915us) service_pool.cc:224] Handling call
0709 12:57:46.265924 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:46.266593 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:46.266787 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:46.228210  3710 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:57:46.253329  3703 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:46.232271  3860 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.212455  3765 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:46.240631  3874 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.770s	user 0.001s	sys 0.005s
I20260709 12:57:46.222086  3850 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.208329  3870 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.236685  3828 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.273310  3859 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:46.241995  3857 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.281697  3831 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.282785  3856 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:57:46.238094  3768 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.256835  1712 rpcz_store.cc:276] 0709 12:57:43.904315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.909886 (+  5571us) service_pool.cc:224] Handling call
0709 12:57:43.910433 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:46.245258 (+2334825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:46.245577 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:46.285122  3147 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:46.296288  3773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.027s	sys 0.020s
I20260709 12:57:46.286685  3742 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.294203  3616 raft_consensus.cc:3055] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:46.254317  3829 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.294286  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1659) took 2361 ms. Trace:
I20260709 12:57:46.248549  3884 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.288897  3792 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.253691  3890 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.259282  3810 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 12:57:46.305027  2344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 320) took 2523 ms (client timeout 2143 ms). Trace:
I20260709 12:57:46.309930  3700 raft_consensus.cc:3055] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:46.296144  3885 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.268290  3832 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 12:57:46.292717  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:46.267607  3879 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.227743  3868 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.239290  3853 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.324148  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:46.231616  3634 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.275642  3887 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.311259  3539 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.321132  3710 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.301815  3836 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:46.437314  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 220663us
I20260709 12:57:46.461535  1566 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:46.423072  3892 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.351145  3882 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.394636  3880 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.392970  3877 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:46.469846  2315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.022s	sys 0.041s
W20260709 12:57:46.350312  3773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.028s	sys 0.021s
I20260709 12:57:46.323760  3807 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.415922  2343 raft_consensus.cc:2368] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:57:46.466960  3896 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:46.360338  3889 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:57:46.416944  3803 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.445182  3700 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:46.325213  3616 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:46.355079  3863 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.477662  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 199) took 1653 ms. Trace:
I20260709 12:57:46.517731  1643 rpcz_store.cc:276] 0709 12:57:44.824001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:45.239631 (+415630us) service_pool.cc:224] Handling call
0709 12:57:45.249836 (+ 10205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:45.267814 (+ 17978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:45.271892 (+  4078us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:45.274423 (+  2531us) log.cc:844] Serialized 26 byte log entry
0709 12:57:46.033188 (+758765us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:46.033231 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:46.033313 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:46.477452 (+444139us) raft_consensus.cc:1685] finished
0709 12:57:46.477472 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:46.477598 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":752142,"threads_started":1,"wal-append.queue_time_us":1047435}
I20260709 12:57:46.325577  3732 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:46.502898  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 178937us
I20260709 12:57:46.361480  3861 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.325552  1568 rpcz_store.cc:276] 0709 12:57:43.918185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.918331 (+   146us) service_pool.cc:224] Handling call
0709 12:57:43.918980 (+   649us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:43.927833 (+  8853us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:44.390203 (+462370us) log.cc:844] Serialized 14 byte log entry
0709 12:57:45.855037 (+1464834us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:45.863327 (+  8290us) log.cc:844] Serialized 590 byte log entry
0709 12:57:45.863543 (+   216us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:45.889201 (+ 25658us) log.cc:844] Serialized 14 byte log entry
0709 12:57:45.889440 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:45.889535 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:46.279495 (+389960us) raft_consensus.cc:1685] finished
0709 12:57:46.279526 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:46.279685 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66661,"prepare.queue_time_us":29924,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":35,"raft.queue_time_us":424183,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":90641,"thread_start_us":1443149,"threads_started":2,"wal-append.queue_time_us":1225912}
I20260709 12:57:46.470235  3885 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:46.506316  2315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.022s	sys 0.041s
W20260709 12:57:46.445034  2344 rpcz_store.cc:269] 0709 12:57:43.781343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.787041 (+  5698us) service_pool.cc:224] Handling call
0709 12:57:44.808831 (+1021790us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b58001b4b98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60feee 0000000000375939 00007f6a476831e0 00007f6a4774c0c4 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:57:46.304762 (+1495931us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54004b9454. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:46.304931 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567744128}
I20260709 12:57:46.486905  3853 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:46.459765  3900 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:46.473901  3710 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.465996  3829 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:46.530356  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 64899.6us
I20260709 12:57:46.533385  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:46.512171  3811 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:46.354589  3886 consensus_queue.cc:1059] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.373s
I20260709 12:57:46.534145  2346 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:46.540483  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:46.523101  3742 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.541142  2349 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
W20260709 12:57:46.530853  3891 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:57:46.523785  3835 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.529635  3850 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:46.555202  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:46.543648  1684 leader_election.cc:400] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7.
I20260709 12:57:46.545290  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:46.470695  3890 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.525022  3500 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.556903  1684 leader_election.cc:403] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:46.537643  3877 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.560603  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:46.549157  3700 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.525318  3896 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.563824  3700 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:46.567780  3832 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7.
I20260709 12:57:46.568332  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 209) took 1246 ms. Trace:
I20260709 12:57:46.568852  1570 rpcz_store.cc:276] 0709 12:57:45.322091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:45.322278 (+   187us) service_pool.cc:224] Handling call
0709 12:57:45.375653 (+ 53375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:45.419158 (+ 43505us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:57:45.590993 (+171835us) log.cc:844] Serialized 14 byte log entry
0709 12:57:46.145644 (+554651us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:46.150340 (+  4696us) log.cc:844] Serialized 52 byte log entry
0709 12:57:46.150685 (+   345us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:57:46.150717 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:46.150814 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:46.568060 (+417246us) raft_consensus.cc:1685] finished
0709 12:57:46.568081 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:46.568263 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103790,"prepare.queue_time_us":171780,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":559155,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":18106,"thread_start_us":227504,"threads_started":1,"wal-append.queue_time_us":610033}
I20260709 12:57:46.571102  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1362) took 1995 ms. Trace:
I20260709 12:57:46.574457  1610 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:46.541115  3732 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:46.554455  3765 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.571509  1644 rpcz_store.cc:276] 0709 12:57:44.575409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.575575 (+   166us) service_pool.cc:224] Handling call
0709 12:57:44.583907 (+  8332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:44.614186 (+ 30279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:44.614218 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:44.614636 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:57:45.967501 (+1352865us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:45.967573 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:45.967670 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:46.570866 (+603196us) raft_consensus.cc:1685] finished
0709 12:57:46.570889 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:46.571020 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17528,"raft.queue_time_us":9431,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":31239,"thread_start_us":914560,"threads_started":1,"wal-append.queue_time_us":1547391}
I20260709 12:57:46.583318  3835 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:46.583953  3835 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:46.583626  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:46.590729  1610 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:46.592921  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:46.593529  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:46.539173  3900 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.581801  3634 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.508697  3892 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.584491  3835 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:46.584810  3810 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.565912  3877 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.604905  3887 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.607265  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:46.597204  2344 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:46.609088  3768 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.609620  3710 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.598724  3825 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:46.615103  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:46.623082  3901 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.624141  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:46.560513  3616 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.585214  3732 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.585096  3870 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.639528  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:46.787038  1570 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
W20260709 12:57:46.787910  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 172922us
W20260709 12:57:46.790540  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:46.794076  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:46.799706  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:46.800868  1568 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:46.803498  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:46.807654  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:46.808522  1642 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:46.808760  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:46.809474  1643 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:46.809430  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:46.810701  1642 raft_consensus.cc:2410] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:57:46.821652  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:46.628324  3890 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:46.832495  1687 connection.cc:256] RPC call timeout handler was delayed by -1.3242262249999612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:57:46.834226  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.834446  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.835475  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.628413  3908 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:46.638840  3879 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.691381  3896 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.788717  3825 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:46.855499  3825 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:46.821163  3902 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.860100  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:46.860697  1644 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:46.836108  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:46.841136  1535 connection.cc:256] RPC call timeout handler was delayed by -1.3909529750000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 12:57:46.847656  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.848668  3732 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.849393  3877 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.849969  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.850137  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.779970  3892 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.803882  3768 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:46.854136  3890 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.641965  3800 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.869098  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.869648  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:46.861233  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:46.858917  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:46.870366  1570 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:46.744169  3846 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:46.870568  1572 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:46.633862  3810 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.867214  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:46.871505  3910 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.872416  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:46.872203  3910 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.874235  3894 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:46.875322  3765 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:46.875710  3765 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:46.821557  3811 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:46.869901  1714 raft_consensus.cc:2410] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:46.877424  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.810691  3870 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.856441  3880 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.847934  3900 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.883291  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.863739  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:46.878062  1714 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
W20260709 12:57:46.888406  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:46.837590  3710 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:46.890519  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 128649us
I20260709 12:57:46.894795  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.894868  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.864595  3616 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:46.870337  3732 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.868876  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.879205  3441 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:46.879431  3765 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:46.909024  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.916265  1714 raft_consensus.cc:2410] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:46.870155  3882 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:46.919860  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.924242  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1417) took 1865 ms. Trace:
I20260709 12:57:46.924790  1639 rpcz_store.cc:276] 0709 12:57:45.058887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:45.254336 (+195449us) service_pool.cc:224] Handling call
0709 12:57:45.262610 (+  8274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:46.101132 (+838522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:46.923943 (+822811us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54002a8fd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:46.924165 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920278912}
I20260709 12:57:46.929044  1719 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:46.907377  3880 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.930832  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:46.931542  1644 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:46.832017  3901 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.892825  3811 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:46.971582  1715 raft_consensus.cc:2410] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:46.957304  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.892442  3907 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:57:46.867988  3902 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.955591  3882 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.955703  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.030405  1644 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:47.031737  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.032042  1572 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:47.032840  1644 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:46.958060  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:46.977684  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.033167  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:47.045425  1639 raft_consensus.cc:2410] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:47.058565  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.037194  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.028204  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.060334  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.061833  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.062395  1644 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:47.063072  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.063493  1644 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:47.064064  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.059264  1639 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:47.066695  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:46.979545  1570 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:46.877975  3890 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:46.984124  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.985390  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:46.924629  3441 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:46.987916  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.070034  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.070987  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.071252  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.071775  1644 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:47.071997  1713 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:46.988741  3902 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.911250  3710 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:46.960160  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:46.924015  3899 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.150s
I20260709 12:57:46.928624  3732 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:46.956288  3876 consensus_meta.cc:287] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.735s	user 0.013s	sys 0.002s
I20260709 12:57:46.996052  3880 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:46.997148  3901 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:46.997864  3811 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:47.007048  2345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 339) took 1950 ms (client timeout 1953 ms). Trace:
W20260709 12:57:47.008989  2343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 338) took 2189 ms (client timeout 1952 ms). Trace:
W20260709 12:57:47.009902  1640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 195) took 2909 ms (client timeout 2058 ms). Trace:
I20260709 12:57:47.058928  3839 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:57:47.010679  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 188) took 3963 ms (client timeout 2806 ms). Trace:
I20260709 12:57:46.894083  3870 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.016167  3539 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:47.017719  3800 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:47.019236  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:47.117919  1565 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:47.021690  3810 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:47.022894  3910 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.020102  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1398) took 3741 ms. Trace:
I20260709 12:57:47.128386  1641 rpcz_store.cc:276] 0709 12:57:43.279017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.565771 (+286754us) service_pool.cc:224] Handling call
0709 12:57:43.569259 (+  3488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:44.594833 (+1025574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:47.019863 (+2425030us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001b58d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:47.020017 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2325158656}
I20260709 12:57:47.023507  3634 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:46.884840  3846 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.156190  3846 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.027377  3420 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.069559  2314 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:47.072813  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.076826  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.180666  1713 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:47.180869  3420 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.181732  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.182101  3530 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:47.182476  1713 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:47.182651  3530 raft_consensus.cc:697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:47.182932  3420 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.183660  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.078126  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.079159  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.184921  1714 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 3.
I20260709 12:57:47.059798  3905 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:57:47.081465  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 207762us
I20260709 12:57:47.184399  1713 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:47.087826  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.092939  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.189302  1719 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 2.
I20260709 12:57:47.074431  3441 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:47.059644  3853 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:57:47.095124  1640 rpcz_store.cc:269] 0709 12:57:44.100403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.100992 (+   589us) service_pool.cc:224] Handling call
0709 12:57:47.009695 (+2908703us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400335c54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:47.009787 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4037915904}
I20260709 12:57:47.088403  3894 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:47.060778  3900 consensus_queue.cc:1059] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:57:47.025508  3896 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.157428  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:47.096804  2345 rpcz_store.cc:269] 0709 12:57:45.056175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:45.121787 (+ 65612us) service_pool.cc:224] Handling call
0709 12:57:47.006852 (+1885065us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b54004cbdd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:47.006985 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218085760}
W20260709 12:57:47.096730  2343 rpcz_store.cc:269] 0709 12:57:44.819892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.820067 (+   175us) service_pool.cc:224] Handling call
0709 12:57:47.008685 (+2188618us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003f70d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:47.008881 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584090368}
I20260709 12:57:47.069149  3908 consensus_queue.cc:1059] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:57:47.165040  3634 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.167053  3765 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.169564  3870 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.170858  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.171314  3882 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.174165  3732 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.176666  1565 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
W20260709 12:57:47.179663  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 110234us
I20260709 12:57:47.184978  1639 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
W20260709 12:57:47.095824  1646 rpcz_store.cc:269] 0709 12:57:43.046881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.205517 (+158636us) service_pool.cc:224] Handling call
0709 12:57:47.010483 (+3804966us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400336b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:47.010597 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4707149056}
I20260709 12:57:47.166986  3890 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:47.175573  3848 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:57:47.094165  3876 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.199606  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.199820  3894 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.200695  3530 consensus_queue.cc:237] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.202898  3812 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:47.202996  3710 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:47.192600  3905 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:47.211768  3872 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.206990  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.212280  3908 raft_consensus.cc:3055] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:47.213140  3199 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.216253  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.305119  1716 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:47.208164  1570 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:47.222599  1535 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:47.203548  3835 consensus_meta.cc:287] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.003s
W20260709 12:57:47.223552  3820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.338s	user 0.031s	sys 0.040s
W20260709 12:57:47.309765  3820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.424s	user 0.032s	sys 0.040s
I20260709 12:57:47.205138  3850 raft_consensus.cc:3055] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:47.210037  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.282128  1714 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:47.206866  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.318679  2349 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:47.205250  3810 raft_consensus.cc:3055] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:47.207787  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.307287  2348 raft_consensus.cc:2368] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7.
I20260709 12:57:47.205659  1712 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:47.243662  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:47.310622  3850 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:47.322397  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:47.324246  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 101711us
I20260709 12:57:47.204792  3896 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.333901  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:47.340318  1716 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:57:47.341734  1643 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:47.341897  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.334329  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.338032  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:47.303814  3908 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:47.338594  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:47.346873  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.349835  1640 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:47.337044  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:47.345808  1641 raft_consensus.cc:2410] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:47.335035  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.353039  1713 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:47.259997  3851 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:47.333319  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 305075us
I20260709 12:57:47.354010  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.358618  2349 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:47.355149  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.323963  3810 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:47.365026  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.339859  2340 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:47.372928  3699 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:47.373355  3699 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:47.373629  3765 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.374202  3699 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.375223  3699 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:47.375339  2340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 476) took 3610 ms. Trace:
I20260709 12:57:47.364228  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:47.362862  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:47.377789  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.333408  3890 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:47.385092  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.375782  2340 rpcz_store.cc:276] 0709 12:57:43.764889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.770588 (+  5699us) service_pool.cc:224] Handling call
0709 12:57:44.820230 (+1049642us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b58001b4b98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a4770dfc0 00007f6a476f8929 00007f6a476f83d2 00007f6a40c6fbd4
0709 12:57:44.857766 (+ 37536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:47.372861 (+2515095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:47.375118 (+  2257us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54004d8ad4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:47.375280 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5600443008}
I20260709 12:57:47.400199  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:47.395242  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.322986  3835 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.376839  1717 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
W20260709 12:57:47.356762  3814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.445s	user 0.023s	sys 0.021s
I20260709 12:57:47.383009  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1416) took 2329 ms. Trace:
W20260709 12:57:47.424014  3814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.512s	user 0.023s	sys 0.021s
I20260709 12:57:47.339743  3922 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:47.388303  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.425035  3922 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:47.425364  2347 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:47.425719  3922 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:47.426007  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.426748  1719 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:47.427152  3835 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.427604  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:47.427877  3835 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.428779  3792 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.429111  3876 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.359344  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:47.410682  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.430496  2349 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:47.413692  1643 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:47.432335  3814 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:47.432812  3814 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.433322  3814 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:47.379277  3441 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.434458  3732 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:47.435047  3732 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.435516  3732 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:47.382129  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:47.437471  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.405103  3851 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:47.438814  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.440106  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:47.405247  3765 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:47.441478  3765 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:47.440912  3850 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.378229  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.417419  3810 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.418740  3905 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.406023  3749 tablet_copy_client.cc:538] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:47.382948  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.458513  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.459151  1642 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:47.420132  3890 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.422762  3634 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.382817  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.376442  3896 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.424118  1647 rpcz_store.cc:276] 0709 12:57:45.053924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:45.244104 (+190180us) service_pool.cc:224] Handling call
0709 12:57:45.254699 (+ 10595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:46.118467 (+863768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:47.382804 (+1264337us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54001e41d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:47.382943 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718244608}
I20260709 12:57:47.436487  3441 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:47.442045  3765 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:47.409502  1535 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:47.440869  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 81590.3us
I20260709 12:57:47.475790  2314 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:47.476004  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.454664  3685 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.476900  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:47.478040  2314 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:47.382438  3582 raft_consensus.cc:3055] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:47.453449  3850 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:47.453877  3420 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:47.455030  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:47.485322  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:47.485980  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:47.486470  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.487512  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.456329  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.488906  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.489627  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.490379  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.491282  1644 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:47.492146  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:47.493844  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.494810  1640 raft_consensus.cc:2410] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:47.497409  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:47.497676  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 88234.6us
W20260709 12:57:47.454470  3825 consensus_meta.cc:287] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.000s
I20260709 12:57:47.469863  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.500115  1642 raft_consensus.cc:2368] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:57:47.429311  3792 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.444842  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.415994  1716 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:47.479117  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:47.480015  3582 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:47.480090  3863 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:47.485234  3420 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.381624  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:47.466627  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.468837  3883 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:47.428584  3835 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.478909  3810 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:47.525506  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.529392  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:47.513185  1612 connection.cc:256] RPC call timeout handler was delayed by -2.3971834640000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 12:57:47.540325  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:47.523241  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.496994  3685 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.554165  1572 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:47.502213  3820 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:47.550300  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:47.523104  3882 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:47.564379  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.522444  3825 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.569864  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.570590  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.538846  3441 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:47.563948  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:47.577332  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 98289.3us
I20260709 12:57:47.579458  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.580224  1564 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:47.569974  1570 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:47.581887  1714 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:47.583246  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.557113  1647 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:47.502076  3858 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:47.530694  3863 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:47.586802  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.587426  1718 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:47.566424  3582 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.589162  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:47.572048  1612 connection.cc:256] RPC call timeout handler was delayed by -2.362983464000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 12:57:47.573691  1642 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:47.584939  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.591420  1572 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:47.578797  2314 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:47.595199  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.553082  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:47.594477  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.599977  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:47.571249  3882 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.572178  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:47.599210  1718 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:47.601783  1571 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:47.596999  1641 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:57:47.595954  1612 connection.cc:256] RPC call timeout handler was delayed by -2.2809174690000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 12:57:47.577625  3441 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.602609  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.573551  3820 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:47.589357  1563 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:47.607411  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.591296  3863 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:47.586911  3858 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:47.550084  3883 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.603459  3582 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:47.635690  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1339) took 3743 ms (client timeout 1681 ms). Trace:
I20260709 12:57:47.601158  3876 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:47.629667  1721 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:47.660140  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.603682  3882 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:47.681759  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.665733  1716 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:47.597791  3931 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:47.670379  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:47.708902  1714 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:57:47.656224  1567 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:47.709836  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.710443  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.710716  1718 raft_consensus.cc:2410] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:57:47.677982  1720 rpcz_store.cc:269] 0709 12:57:43.881806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.884977 (+  3171us) service_pool.cc:224] Handling call
0709 12:57:47.625379 (+3740402us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b54002df854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:47.625505 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215753472}
W20260709 12:57:47.662477  1612 connection.cc:256] RPC call timeout handler was delayed by -2.2747834639999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 12:57:47.712922  1612 connection.cc:256] RPC call timeout handler was delayed by -2.1982834639999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 12:57:47.714427  1612 connection.cc:256] RPC call timeout handler was delayed by -2.1450174690000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 12:57:47.715751  1612 connection.cc:256] RPC call timeout handler was delayed by -2.0794834640000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 12:57:47.717084  1612 connection.cc:256] RPC call timeout handler was delayed by -2.0092834640000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 12:57:47.718307  1612 connection.cc:256] RPC call timeout handler was delayed by -1.9543834639999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260709 12:57:47.719633  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0972443390000421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 12:57:47.721587  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0712110670000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
I20260709 12:57:47.723879  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:47.697949  1642 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:57:47.728561  3937 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:57:47.730001  3936 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:57:47.732266  3931 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.733659  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.734273  1645 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:57:47.734378  3931 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.735047  1643 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:47.735781  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:47.696528  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:47.736989  1716 raft_consensus.cc:606] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:47.737411  1716 raft_consensus.cc:614] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:47.737838  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.738842  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.610531  1570 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:47.748163  1714 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:57:47.750342  1641 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:47.750573  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:47.683104  3934 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:57:47.677392  3441 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:47.669710  3820 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:47.669872  3858 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:47.669350  3792 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.755713  3876 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:47.753470  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.755939  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:47.754558  3890 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:47.772670  3939 log.cc:927] Time spent T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:57:47.773049  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.791316  1645 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:47.773272  3420 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.755154  3931 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:47.685958  3835 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.776965  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:47.777354  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:47.772360  3885 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.780767  1642 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:47.781376  1716 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:47.787369  3832 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.782578  1714 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:47.789851  1571 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:57:47.791803  1566 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:47.792431  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.779744  3749 tablet_bootstrap.cc:492] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:57:47.783143  3883 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.799047  1567 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:47.817823  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 197721us
I20260709 12:57:47.819212  1716 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:47.822193  1715 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:47.823796  1566 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:47.819341  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:47.826251  1716 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 7. Ops: []
I20260709 12:57:47.827854  1714 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:47.829063  1716 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:57:47.829269  1714 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:47.831040  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:47.801285  3420 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:47.834187  1714 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:57:47.836053  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.822803  3634 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.841850  1715 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:47.821727  3836 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:57:47.832912  3825 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.822757  3832 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.867278  1567 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
W20260709 12:57:47.855186  3941 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:57:47.869526  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:47.870051  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.843427  3420 raft_consensus.cc:697] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:47.871850  1645 raft_consensus.cc:2376] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5. Re-sending same reply.
I20260709 12:57:47.854516  1642 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:47.883080  1719 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:47.852887  3634 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.847534  3876 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.903640  1647 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:57:47.910151  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:47.911007  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.912096  3634 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:47.913023  1641 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:47.914269  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:47.916177  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:47.916710  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.920090  3851 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.920631  3851 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.920827  3420 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.920518  1645 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:47.922904  3851 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:47.879334  3732 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.950407  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1357) took 1112 ms. Trace:
I20260709 12:57:47.933581  3900 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:57:47.957419  3900 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:47.957772  3900 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:47.958506  3900 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.923542  3814 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.961911  2345 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:47.966336  3908 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.969084  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1355) took 1132 ms. Trace:
I20260709 12:57:47.969468  1721 rpcz_store.cc:276] 0709 12:57:46.836768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:46.836885 (+   117us) service_pool.cc:224] Handling call
0709 12:57:47.625613 (+788728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:47.689629 (+ 64016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:47.968887 (+279258us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54002df850. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:47.969023 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813216000}
W20260709 12:57:47.971176  3944 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:57:47.974268  3922 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.009s
I20260709 12:57:47.974797  3922 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.977255  3765 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:47.978552  1572 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:47.991526  3882 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:47.993100  3829 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:47.950846  1720 rpcz_store.cc:276] 0709 12:57:46.837884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.711999 (+874115us) service_pool.cc:224] Handling call
0709 12:57:47.712395 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:47.737389 (+ 24994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:47.737424 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:47.755193 (+ 17769us) log.cc:844] Serialized 52 byte log entry
0709 12:57:47.901367 (+146174us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:47.901407 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:47.901478 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:47.950168 (+ 48690us) raft_consensus.cc:1685] finished
0709 12:57:47.950189 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:47.950344 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29407,"raft.queue_time_us":25067,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":5766,"thread_start_us":113409,"threads_started":1,"wal-append.queue_time_us":165531}
I20260709 12:57:47.994426  1564 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:57:47.994967  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44289.4us
W20260709 12:57:47.995276  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 168797us
I20260709 12:57:47.993764  3882 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.008201  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.008445  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.009351  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.010591  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.009658  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.014192  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.014120  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.993849  3732 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.016037  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.018399  1714 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:48.018507  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.025694  3441 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:48.028945  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.029211  2347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 475) took 4268 ms. Trace:
I20260709 12:57:48.029549  1715 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:48.029603  2347 rpcz_store.cc:276] 0709 12:57:43.761198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:43.761383 (+   185us) service_pool.cc:224] Handling call
0709 12:57:43.821069 (+ 59686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:47.425793 (+3604724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.028465 (+602672us) spinlock_profiling.cc:243] Waited 3.6 s on lock 0x7b54005e0e54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:48.029015 (+   550us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54005e0e50. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:48.029151 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8399437440}
I20260709 12:57:48.030730  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.031492  1715 raft_consensus.cc:2393] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:48.032437  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.036522  1641 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:48.037348  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.037995  1714 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:48.039170  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.040583  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:47.994861  3900 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.034036  1715 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:48.000953  3814 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.041608  1684 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:48.000380  3908 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.027856  3441 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.027446  3863 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:48.049708  1684 leader_election.cc:400] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:57:48.051254  1684 leader_election.cc:403] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:48.067904  1720 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:48.068940  3850 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:48.059721  3810 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.075830  3820 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:48.078635  3820 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.048615  3835 consensus_queue.cc:1059] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:57:48.081673  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1351) took 1246 ms. Trace:
I20260709 12:57:48.082180  1717 rpcz_store.cc:276] 0709 12:57:46.835064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:46.835187 (+   123us) service_pool.cc:224] Handling call
0709 12:57:48.081526 (+1246339us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54002c3dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:48.081617 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1243619712}
I20260709 12:57:48.083521  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.085307  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.086328  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.087213  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.087821  1712 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:48.088768  3634 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:48.091470  3863 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.084538  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.094343  1638 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:48.088267  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.095870  1713 raft_consensus.cc:2410] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:48.101208  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.058641  3922 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.104375  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:48.105109  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.106402  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.106758  3483 consensus_queue.cc:1059] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:48.106983  1567 raft_consensus.cc:2376] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5. Re-sending same reply.
I20260709 12:57:48.062223  3862 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.109052  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.110543  1713 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:48.110627  1567 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:48.111321  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.111780  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.112021  1566 raft_consensus.cc:2368] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:57:48.112934  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.113163  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.113258  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.114046  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.114303  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:48.114866  1566 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.115010  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.116058  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.116294  1570 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:48.117055  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.064913  3827 consensus_queue.cc:1059] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:57:48.118048  1565 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:48.118189  1570 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 12:57:48.119344  1565 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:57:48.119503  1570 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:48.119891  3868 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.112628  1567 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:48.121748  1469 catalog_manager.cc:5697] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:48.121644  1717 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:48.123608  1469 catalog_manager.cc:5697] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 3, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 3 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:48.130530  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:48.131712  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:48.132802  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.135126  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.136029  1571 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:57:48.136508  1571 pending_rounds.cc:85] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 2
I20260709 12:57:48.136754  1571 pending_rounds.cc:107] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:57:48.063422  3836 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:57:48.136899  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.103832  3765 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:48.143096  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.158877  1567 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:48.159394  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.159694  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.157801  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:48.143850  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:48.160794  1717 raft_consensus.cc:606] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:48.160959  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.161247  1717 raft_consensus.cc:614] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:57:48.151499  1746 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:43765 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:43765 timed out after 15.000s (SENT)
I20260709 12:57:48.142866  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:48.161465  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:48.161580  1572 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:48.161979  1565 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:48.111454  3862 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.152823  3807 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.154479  1570 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:57:48.154887  1537 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.157461  1571 raft_consensus.cc:2889] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:48.161046  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.163079  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:48.163107  1566 raft_consensus.cc:2410] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:48.164630  1717 raft_consensus.cc:3055] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:48.137079  3634 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.168699  1537 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:48.166780  1717 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:48.169752  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:48.170550  1537 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.171276  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.171919  1570 raft_consensus.cc:2368] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7.
I20260709 12:57:48.172858  1570 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:57:48.167032  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.166921  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.165966  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.177052  1572 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:48.179762  1566 raft_consensus.cc:2410] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:57:48.184193  1570 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:48.191367  1565 raft_consensus.cc:2410] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:57:48.195067  3952 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:57:48.169051  3634 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:48.205382  3634 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:48.210044  3953 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:57:48.163734  3483 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.211115  3483 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.211474  3483 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.164201  3862 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.164005  3807 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.220990  3807 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.165812  3679 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.224898  3679 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:48.225284  3679 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.183238  3765 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:48.180074  3825 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.231832  3825 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.232159  3825 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:48.245112  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 74626.7us
I20260709 12:57:48.245930  1537 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.248186  1570 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:57:48.251688  1565 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:48.256140  3922 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.256628  3922 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.239464  3792 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:48.262310  3861 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:48.265802  3922 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.279764  3813 raft_consensus.cc:3055] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:48.280283  3813 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:48.273373  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.260043  3868 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.282248  1537 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.285810  1537 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.288452  1537 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:48.261847  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 165255us
I20260709 12:57:48.293371  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.306152  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.324496  1537 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.336369  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.292752  3868 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.292888  3732 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:48.296157  3685 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:48.337620  3861 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:48.346223  3829 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.347674  3813 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.388525  1721 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:48.329049  3922 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:48.272249  3858 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:48.375907  1537 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.344485  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1767) took 1024 ms. Trace:
I20260709 12:57:48.392524  1719 rpcz_store.cc:276] 0709 12:57:47.323260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.427369 (+104109us) service_pool.cc:224] Handling call
0709 12:57:48.344249 (+916880us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5400175cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:48.344411 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948589440}
I20260709 12:57:48.393859  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.395205  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:48.386677  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.362919  1718 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:48.328051  3885 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.365758  3500 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:48.381289  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.397925  1640 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.367583  3810 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:57:48.393891  1537 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.399775  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.374719  3868 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.400285  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.402031  1719 raft_consensus.cc:2376] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6. Re-sending same reply.
I20260709 12:57:48.398161  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.377787  3894 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:48.406924  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.389705  3853 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:48.403882  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.404858  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.400503  1537 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.413805  1570 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:48.397743  3879 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.414721  1610 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.427461  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:48.418313  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1412) took 3595 ms. Trace:
I20260709 12:57:48.440609  1638 rpcz_store.cc:276] 0709 12:57:44.822860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.826733 (+  3873us) service_pool.cc:224] Handling call
0709 12:57:44.827116 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:48.094890 (+3267774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.418068 (+323178us) spinlock_profiling.cc:243] Waited 3.27 s on lock 0x7b54001c4654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:48.418251 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7513260288}
I20260709 12:57:48.436105  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.442548  1639 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:48.447642  1640 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:57:48.408982  2312 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.450675  1713 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:48.451208  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.451798  1719 raft_consensus.cc:2376] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5. Re-sending same reply.
I20260709 12:57:48.407035  3813 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:48.457093  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 48201.8us
I20260709 12:57:48.406219  3829 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.388473  3861 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:48.455372  1645 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:48.477138  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.401059  3802 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:57:48.437856  3810 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:48.522056  3765 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.481449  1570 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:48.453652  3879 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:48.555105  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:48.476514  3941 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:57:48.465571  3865 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:48.542225  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 74238.8us
I20260709 12:57:48.455672  3634 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.543411  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.476123  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:48.546010  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 192765us
W20260709 12:57:48.562799  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.450350  3685 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:48.403136  3863 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:57:48.521785  3894 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:48.553020  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 152588us
I20260709 12:57:48.555704  1568 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:48.557390  3810 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.558108  3879 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:48.581813  3964 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 12:57:48.584023  3963 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:57:48.559279  3882 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:48.586474  3922 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:48.591492  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.634145  1570 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:48.592522  1565 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:48.593377  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.593681  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1673) took 1006 ms. Trace:
I20260709 12:57:48.594877  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.595775  3807 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.597028  3825 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.645550  3825 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.541488  3483 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:48.649571  1646 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:57:48.650483  3483 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:48.650682  3810 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:48.598235  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.599730  3634 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.600769  1566 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:48.651391  1721 raft_consensus.cc:2376] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6. Re-sending same reply.
I20260709 12:57:48.652567  1721 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:48.632179  3500 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:57:48.653756  1721 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:48.653784  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:48.617635  3858 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.610028  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.610493  3974 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:57:48.613626  1715 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:48.612809  1469 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:48.542277  3862 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.616372  3865 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:48.600801  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:48.623692  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.678279  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.617317  1717 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.627439  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.679260  1684 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:48.679380  1717 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:48.679652  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52260.1us
I20260709 12:57:48.680584  1537 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.616556  3732 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:48.635344  1564 rpcz_store.cc:276] 0709 12:57:47.587536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.588923 (+  1387us) service_pool.cc:224] Handling call
0709 12:57:48.593494 (+1004571us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54001ff754. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:48.593627 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930174208}
I20260709 12:57:48.638091  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:48.617095  3679 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.641623  3972 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.641976  2340 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 2. Current term is 3. Ops: []
W20260709 12:57:48.642289  3908 consensus_meta.cc:287] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.000s
I20260709 12:57:48.643456  3807 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.604504  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:48.695178  1720 raft_consensus.cc:606] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:48.696637  1720 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:57:48.607741  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.698122  1569 raft_consensus.cc:2393] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
W20260709 12:57:48.678157  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.457168  3853 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:48.684003  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:48.686264  1564 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:48.702198  1564 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:48.702823  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 97643.4us
I20260709 12:57:48.703197  1569 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:48.690793  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.690488  1647 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
W20260709 12:57:48.698931  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.699918  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:48.687402  3922 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:48.690222  3679 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.684026  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:48.714442  1571 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:48.766101  3829 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:48.765730  1712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1770) took 1430 ms (client timeout 1678 ms). Trace:
I20260709 12:57:48.781123  1610 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:48.781122  1712 rpcz_store.cc:269] 0709 12:57:47.335575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.381745 (+ 46170us) service_pool.cc:224] Handling call
0709 12:57:48.765515 (+1383770us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54002c24d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:48.765644 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015324928}
W20260709 12:57:48.773974  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 137069us
W20260709 12:57:48.720281  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.785097  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.683598  3957 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.715610  1684 leader_election.cc:400] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7.
I20260709 12:57:48.786931  1684 leader_election.cc:403] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:48.690455  3500 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:48.787786  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 103841us
I20260709 12:57:48.730154   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:57:48.789058  1641 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:48.792811  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:48.790431  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.792567  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:48.839324  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:48.800036  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 84516.4us
I20260709 12:57:48.843291  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:48.844300  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 51765.2us
I20260709 12:57:48.847343  1537 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:48.850198  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.850333  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:48.850696  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.851272  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.851531  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.851960  1639 raft_consensus.cc:2368] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6.
I20260709 12:57:48.852593  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.853694  1639 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:48.779410  3829 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:48.706583  2342 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:48.855841  1537 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.856398  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.846493  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:48.790143  3634 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:48.862911  1717 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:57:48.863559  1717 pending_rounds.cc:85] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 3
I20260709 12:57:48.863878  1717 pending_rounds.cc:107] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:57:48.864174  1717 raft_consensus.cc:2889] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:48.746742  3732 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.799628  3957 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.857133  1643 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:57:48.817680  3838 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7.
I20260709 12:57:48.862157  1716 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:57:48.842458  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.789978  3791 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:48.839886  3861 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:48.898528  2346 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:48.859297  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.907729  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.909152  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.868091  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.861011  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:48.866808  3679 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.872249  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:48.872900  3862 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:48.853658  3813 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:48.855723  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:48.874703  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:48.926834  1717 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:48.886830  1641 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:48.891721  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:48.847582  3972 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:48.719127  3965 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:48.859444  3886 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:48.860370  3500 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:48.914008  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 53078.5us
I20260709 12:57:48.917973  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.910548  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.941602  1639 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:48.942086  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:48.942787  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.922834  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:48.909215  3976 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:57:48.816115  3807 consensus_queue.cc:1059] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:57:48.870059  3957 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.928937  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.894193  3922 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:48.924139  3813 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:48.935431  2343 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:48.916363  3679 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:48.936378  3792 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.541s	user 0.003s	sys 0.003s
I20260709 12:57:48.923918  3634 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:48.940634  3886 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:48.959833  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:48.929164  1537 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:48.945174  1643 raft_consensus.cc:2410] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:48.875424  3868 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.958091  3679 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.965150  3868 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:48.947870  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.966359  1641 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:48.967382  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.957381  3791 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:48.969290  3791 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:57:48.969532  3978 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:57:48.970218  3791 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:48.971367  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.946646  1639 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:48.959719  3886 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.954097  3813 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.962630  3483 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:57:48.980321  3960 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.433s	user 0.000s	sys 0.006s
I20260709 12:57:48.982009  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:48.982208  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:48.990046  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:48.994318  3807 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:48.995487  3974 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:57:48.995858  3825 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:48.996358  3974 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:48.996760  3974 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:48.997606  3974 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:48.991029  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 61940.3us
I20260709 12:57:48.992533  1644 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:57:48.960455  3853 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:48.993891  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:49.002609  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:49.013330  1715 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:49.004093  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:49.014483  1717 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.992146  3732 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:48.991734  3483 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:49.001875  3974 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.042768  1717 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:49.044359  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:49.009244  3829 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:49.031971  3732 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:49.031353  3807 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:49.046638  3792 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.058926  3732 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:49.054409  3885 consensus_meta.cc:287] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.654s	user 0.004s	sys 0.006s
I20260709 12:57:49.047924  3500 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:49.058578  3993 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:57:49.071564  3483 raft_consensus.cc:3055] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:49.072104  3483 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:49.072957  3483 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.073854  3483 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.075807  3679 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.076975  3807 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.082590  3813 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.084196  3813 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:49.069250  3985 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:57:49.084343  3879 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.068847  3885 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:49.070356  3500 raft_consensus.cc:697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:49.087577  3957 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.085315  3886 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.101518  3879 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:49.093171  3679 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:49.102821  3886 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:49.096624  3500 consensus_queue.cc:237] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.103211  3957 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:49.103746  3732 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.103018  3749 tablet_bootstrap.cc:492] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:49.106055  3732 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:49.106623  3749 tablet_bootstrap.cc:492] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:57:49.107343  3749 ts_tablet_manager.cc:1403] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 1.371s	user 0.035s	sys 0.033s
I20260709 12:57:49.068840  3792 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:49.139914  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 116818us
I20260709 12:57:49.141489  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:49.143538  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:49.145793  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:49.147310  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:49.148298  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.149549  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:49.150482  1639 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:49.152289  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:49.156345  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:49.160362  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:57:49.160712  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.163619  1712 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:49.170356  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1786) took 1160 ms. Trace:
I20260709 12:57:49.170802  1716 rpcz_store.cc:276] 0709 12:57:48.009954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.018307 (+  8353us) service_pool.cc:224] Handling call
0709 12:57:49.169891 (+1151584us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54002779d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:49.170123 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568374144}
I20260709 12:57:49.179317  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 213) took 1407 ms. Trace:
I20260709 12:57:49.179814  1642 rpcz_store.cc:276] 0709 12:57:47.771247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.889589 (+118342us) service_pool.cc:224] Handling call
0709 12:57:48.343267 (+453678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:48.343423 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:48.343448 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:48.343484 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:48.343512 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.343562 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:49.178875 (+835313us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54001d38d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:49.179110 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006276480}
I20260709 12:57:49.183686  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1456) took 1030 ms. Trace:
I20260709 12:57:49.186203  3483 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.184082  1566 rpcz_store.cc:276] 0709 12:57:48.152941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.193169 (+ 40228us) service_pool.cc:224] Handling call
0709 12:57:48.600585 (+407416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:48.651573 (+ 50988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:49.183247 (+531674us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54001ff750. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:49.183470 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934907776}
I20260709 12:57:49.188445  3634 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:49.196257  3634 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:49.197072  3679 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:49.205483  3791 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.192548  3884 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:57:49.209205  3807 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.197578  3634 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.216810  3813 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.218209  3885 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:49.218463  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:49.219174  3885 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.219822  3899 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:49.220127  3836 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:49.220842  3899 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.222365  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:49.223690  2347 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:49.215539  3992 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:57:49.218628  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:49.225970  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:49.226929  3732 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.226011  1610 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:49.230218  1610 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:49.230618  1535 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:49.232854  3732 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:49.233397  3732 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:49.233904  3732 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.230486  3813 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.224303  3998 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:49.247860  3685 raft_consensus.cc:3055] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:49.248346  3685 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:49.249691  3685 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.244107  3998 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:49.263891  3998 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:49.267967  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.269145  3825 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:49.269488  3899 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:49.271848  3685 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:49.276585  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1435) took 1164 ms. Trace:
W20260709 12:57:49.301832  3987 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
I20260709 12:57:49.301632  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:49.304939  2349 raft_consensus.cc:2393] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:49.312206  3797 raft_consensus.cc:3055] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:49.312728  3797 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:49.313476  3885 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:49.230221  3749 raft_consensus.cc:359] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:49.314038  3797 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.314754  3749 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:57:49.315834  3797 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.294543  3634 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.315649  3749 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:49.300918  1563 rpcz_store.cc:276] 0709 12:57:48.111697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.114199 (+  2502us) service_pool.cc:224] Handling call
0709 12:57:48.114505 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:48.114839 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:48.114867 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:48.115323 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:57:48.158878 (+ 43555us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:48.170419 (+ 11541us) log.cc:844] Serialized 14 byte log entry
0709 12:57:48.182635 (+ 12216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.182744 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:49.272046 (+1089302us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b1800425860. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:57:49.275844 (+  3798us) raft_consensus.cc:1685] finished
0709 12:57:49.276040 (+   196us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:49.276317 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11255,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":16905,"raft.queue_time_us":92952,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":2524,"spinlock_wait_cycles":3132160,"thread_start_us":43133,"threads_started":1,"wal-append.queue_time_us":63991}
I20260709 12:57:49.318467  3749 ts_tablet_manager.cc:1434] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.211s	user 0.010s	sys 0.000s
I20260709 12:57:49.321746  3634 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:49.322047  3832 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:49.280452  3962 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.732s	user 0.003s	sys 0.000s
I20260709 12:57:49.326014  3732 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.329497  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1450) took 1177 ms. Trace:
W20260709 12:57:49.331728  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 413705us
I20260709 12:57:49.332101  3732 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:49.334144  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:49.330971  1567 rpcz_store.cc:276] 0709 12:57:48.151450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.177405 (+ 25955us) service_pool.cc:224] Handling call
0709 12:57:48.177708 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:48.257071 (+ 79363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:48.257123 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:48.262630 (+  5507us) log.cc:844] Serialized 26 byte log entry
0709 12:57:48.363392 (+100762us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:48.363712 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 12:57:48.363938 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.364021 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:49.279482 (+915461us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:49.328911 (+ 49429us) raft_consensus.cc:1685] finished
0709 12:57:49.329077 (+   166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:49.329303 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78886,"prepare.queue_time_us":1697,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1927,"raft.queue_time_us":83503,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3494,"spinlock_wait_cycles":16098432,"thread_start_us":100451,"threads_started":1,"wal-append.queue_time_us":202082}
W20260709 12:57:49.289069  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 58613us
I20260709 12:57:49.345395  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:49.346541  1570 raft_consensus.cc:2368] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:57:49.347556  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:49.348224  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.348979  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:49.349242  3699 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:49.352815  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.359735  2348 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:49.362200  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:49.362738  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:49.363091  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:49.362219  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.363833  1721 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.367620  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:49.367900  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:49.368520  1717 raft_consensus.cc:2410] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:49.363629  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:49.373513  3199 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:49.373962  3685 consensus_queue.cc:1059] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:57:49.378322  3685 raft_consensus.cc:3055] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:49.378715  3685 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:49.379118  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:49.379917  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1793) took 1367 ms. Trace:
I20260709 12:57:49.379951  1719 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:49.379769  3685 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:49.392400  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.315670  3998 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.374029  3814 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.370725  3483 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:49.419759  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:49.422039  3807 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.425307  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:57:49.440080  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:49.440685  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.417966  3634 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:49.444128  3634 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.444670  2342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 495) took 1011 ms. Trace:
W20260709 12:57:49.445107  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 97961.2us
I20260709 12:57:49.445410  2348 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:49.445771  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:49.445142  2342 rpcz_store.cc:276] 0709 12:57:48.433266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.437127 (+  3861us) service_pool.cc:224] Handling call
0709 12:57:48.543460 (+106333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:48.858755 (+315295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:49.444169 (+585414us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540057bcd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:49.444461 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339086720}
I20260709 12:57:49.454210  3732 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:49.454927  3732 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.380494  1718 rpcz_store.cc:276] 0709 12:57:48.011940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.614960 (+603020us) service_pool.cc:224] Handling call
0709 12:57:48.766245 (+151285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:48.780175 (+ 13930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:48.780207 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:48.780251 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:48.780292 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.780357 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:49.357340 (+576983us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b48001b0258. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
0709 12:57:49.379537 (+ 22197us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002c24d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:49.379714 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13534,"raft.queue_time_us":15316,"raft.run_cpu_time_us":4632,"raft.run_wall_time_us":570976,"spinlock_wait_cycles":404637824}
I20260709 12:57:49.461017  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:49.461287  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:49.479583   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:49.482246  1563 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:49.481668  1469 catalog_manager.cc:5697] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 4, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:49.483448  1469 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:49.491250  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:49.492102  1640 raft_consensus.cc:2376] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5. Re-sending same reply.
I20260709 12:57:49.493283  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1798) took 1471 ms. Trace:
I20260709 12:57:49.493737  1713 rpcz_store.cc:276] 0709 12:57:48.022128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.136629 (+114501us) service_pool.cc:224] Handling call
0709 12:57:49.492896 (+1356267us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400084b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:49.493066 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574225152}
I20260709 12:57:49.496201  3998 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:49.508877  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:49.509553  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.503876  3685 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.525491  1721 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:49.510421  3807 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:49.532593  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50027.8us
I20260709 12:57:49.529093  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:49.536123  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:49.528616  1469 catalog_manager.cc:5697] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 4, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:49.545022  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:49.540894  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1444) took 1232 ms (client timeout 1518 ms). Trace:
I20260709 12:57:49.572796  3879 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:49.573563  3876 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:49.545688  3894 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.582126  1640 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:49.539130  3441 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:57:49.584801  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 45946.2us
I20260709 12:57:49.547319  3807 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:49.585933  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 50443us
W20260709 12:57:49.586010  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 62997.6us
I20260709 12:57:49.586768  3732 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:49.533666  3199 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.596773  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:49.611944  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:49.612804  1712 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:49.612937  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:49.613623  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:49.614259  1718 raft_consensus.cc:2376] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7. Re-sending same reply.
I20260709 12:57:49.612982  3699 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:49.535902  3899 consensus_queue.cc:1059] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:57:49.615643  3634 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:49.615978  3899 raft_consensus.cc:3055] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:57:49.616281  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 70299us
I20260709 12:57:49.616460  3899 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:49.615667  3699 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.618359  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:49.619442  1713 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:57:49.619369  4001 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 12:57:49.619810  3699 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:49.620620  3441 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:49.621696  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1810) took 1432 ms. Trace:
I20260709 12:57:49.622044  3441 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:49.604372  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 60626.9us
I20260709 12:57:49.622201  1714 rpcz_store.cc:276] 0709 12:57:48.189280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.677042 (+487762us) service_pool.cc:224] Handling call
0709 12:57:48.677306 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:48.677612 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:48.677637 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:48.688659 (+ 11022us) log.cc:844] Serialized 26 byte log entry
0709 12:57:49.229703 (+541044us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b1800137260. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1 00007f6a426efa0f
0709 12:57:49.360883 (+131180us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:49.360929 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:49.366721 (+  5792us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:49.620942 (+254221us) raft_consensus.cc:1685] finished
0709 12:57:49.620971 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:49.621381 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":330,"raft.queue_time_us":74,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7122,"spinlock_wait_cycles":7716096,"thread_start_us":113138,"threads_started":1,"wal-append.queue_time_us":736082}
W20260709 12:57:49.546355  1647 rpcz_store.cc:269] 0709 12:57:48.290694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.291985 (+  1291us) service_pool.cc:224] Handling call
0709 12:57:49.508260 (+1216275us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b5400336154. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:49.522686 (+ 14426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911388032}
I20260709 12:57:49.617941  3899 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.628885  1721 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:49.635250  3199 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:49.595618  3879 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:49.629446  1537 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:49.628266  2314 connection.cc:256] RPC call timeout handler was delayed by -1.0531235930000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
I20260709 12:57:49.656111  1469 catalog_manager.cc:5697] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 4, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:49.657440  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.658902  1469 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:49.659966  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:49.660806  1720 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.664837  3483 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:49.666430  3483 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:49.667877  3483 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:49.673779  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:49.675632  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:49.676765  3850 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:49.681933  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:49.682951  3802 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:49.686523  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 57146us
I20260709 12:57:49.646620  3879 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:49.691056  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:49.691495  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:49.650144  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:49.706830  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:49.710157  1643 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:49.713443  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:49.705925  3894 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:49.727157  1567 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:49.729468  1641 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
W20260709 12:57:49.735355  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 51947.6us
W20260709 12:57:49.735381  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 85445.7us
I20260709 12:57:49.734534  1684 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:49.736963  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.743707  1720 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:49.724077  1469 catalog_manager.cc:5697] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 4, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:49.684792  3838 consensus_queue.cc:1059] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:57:49.750068  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:49.736690  3699 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:49.752630  1640 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:49.735601  3894 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:49.757335  1719 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:57:49.760993  1467 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58430 (request call id 228) took 17870 ms (client timeout 15000 ms). Trace:
I20260709 12:57:49.761116  3900 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:49.761369  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 95949us
I20260709 12:57:49.761732  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-598f1b27b4ab45cfac5cc13489b2e687 received from {username='slave'} at 127.0.0.1:48852
I20260709 12:57:49.763319  1469 catalog_manager.cc:5697] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 4, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:49.764731  3765 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.765110  3147 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:57:49.765746  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:49.765764  3810 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:49.765997  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:49.768116  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:49.790297  1571 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:49.770233  3699 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.739668  3634 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:49.772302  1569 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:57:49.786705  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 122036us
W20260709 12:57:49.792889  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 49428.4us
I20260709 12:57:49.782697  3899 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.784814  3732 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:49.783322  3900 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:49.808877  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-598f1b27b4ab45cfac5cc13489b2e687 on tablet 598f1b27b4ab45cfac5cc13489b2e687 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:49.809247  3900 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:49.811987  1612 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:49.804363  1535 leader_election.cc:400] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6.
I20260709 12:57:49.812873  1535 leader_election.cc:403] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:57:49.813015  3483 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:49.813587  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 57946.9us
I20260709 12:57:49.814105  3765 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6.
I20260709 12:57:49.814610  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:49.815599  3765 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:49.816187  1535 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:49.816495  3998 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:49.773676  1467 rpcz_store.cc:269] 0709 12:57:31.826958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.827419 (+   461us) service_pool.cc:224] Handling call
0709 12:57:49.693096 (+17865677us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:40.449181 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:40.600206 (+151025us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:40.612437 (+ 12231us) write_op.cc:435] Acquired schema lock
0709 12:57:40.617539 (+  5102us) tablet.cc:662] Decoding operations
0709 12:57:40.905586 (+288047us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:40.911823 (+  6237us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:40.914763 (+  2940us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:57:41.066165 (+151402us) tablet.cc:701] Row locks acquired
0709 12:57:41.066221 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:57:41.066387 (+   166us) write_op.cc:270] Start()
0709 12:57:41.066550 (+   163us) write_op.cc:276] Timestamp: P: 1783601861066326 usec, L: 0
0709 12:57:41.066582 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:57:41.067341 (+   759us) log.cc:844] Serialized 6338 byte log entry
0709 12:57:41.524736 (+457395us) op_driver.cc:464] REPLICATION: finished
0709 12:57:41.928938 (+404202us) write_op.cc:301] APPLY: starting
0709 12:57:41.929074 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:41.966484 (+ 37410us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:41.966649 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:42.017392 (+ 50743us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:42.017735 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:57:42.017788 (+    53us) write_op.cc:312] APPLY: finished
0709 12:57:42.018243 (+   455us) log.cc:844] Serialized 113 byte log entry
0709 12:57:42.018447 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:42.018626 (+   179us) write_op.cc:454] Released schema lock
0709 12:57:42.018707 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:42.019134 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:42.019167 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":441653,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":403849,"apply.run_cpu_time_us":5589,"apply.run_wall_time_us":90186,"num_ops":16,"prepare.queue_time_us":357848,"prepare.run_cpu_time_us":29784,"prepare.run_wall_time_us":702752,"raft.queue_time_us":290169,"raft.run_cpu_time_us":7414,"raft.run_wall_time_us":112594,"replication_time_us":457928,"thread_start_us":592553,"threads_started":4,"wal-append.queue_time_us":128424,"wal-append.run_cpu_time_us":31778,"wal-append.run_wall_time_us":1822759}]]}
I20260709 12:57:49.820815  1638 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:57:49.830009  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:49.831528  1640 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:49.835139  3699 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:49.835541  1716 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:49.836282  1569 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:49.783092  3850 consensus_queue.cc:1059] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:57:49.837167  3850 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:49.837558  3850 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:49.838698  1569 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:49.838559  3850 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.839864  3850 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.840831  3765 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:49.841279  3765 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:49.841645  3765 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.841573  3894 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.846869  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:49.847254  3908 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:49.848011  2342 raft_consensus.cc:2410] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:57:49.848245  1646 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:49.848277  3908 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:49.849306  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:49.849592  3908 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.850214  1644 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:49.850812  3958 raft_consensus.cc:3055] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:49.851310  3958 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:49.851938  3908 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:49.858934  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.869045  1566 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:49.871717  3802 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:49.872864  1642 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:49.825795  3732 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:49.873929  3732 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:49.874121  2314 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:49.875129  3802 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:49.877605  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:49.878383  3802 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.880694  2314 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:49.881654  3863 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:49.882206  3863 raft_consensus.cc:697] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:49.883265  3863 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.801689  3807 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:49.886700  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.805567  3838 consensus_queue.cc:1059] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:57:49.889787  3832 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:49.890334  3832 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.890270  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:49.891520  4010 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:49.892618  3832 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:49.893733  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:49.895550  4010 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:49.898604  4010 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:49.900182  4010 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:49.900579  4010 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:49.830008  3634 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:49.901602  3634 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:49.905779  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.906800  4010 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:49.908392  1686 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.204s (SENT)
I20260709 12:57:49.909063  4010 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:49.909535  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.910164  3832 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:49.910598  3973 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:49.910732  3832 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.911461  3973 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.913126  3832 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:49.913645  3832 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:49.913812  3973 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:49.914335  3147 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:49.914801  3833 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:49.915234  3833 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:49.916136  3833 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.917367  3833 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.917460  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:49.916577  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:49.861575  1565 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.889941  3838 raft_consensus.cc:3055] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:57:49.933246  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 117195us
I20260709 12:57:49.935105  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:49.938426  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.941800  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:49.942130  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:49.944494  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:49.945930  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:49.946816  3832 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.948882  3973 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:49.949487  3973 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:49.949921  3973 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.950057  1469 catalog_manager.cc:5697] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 3, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:49.951840  3699 consensus_queue.cc:1059] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:49.951552  1469 catalog_manager.cc:5697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 4, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:57:49.952687  3699 raft_consensus.cc:3055] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:49.953083  3699 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:49.953938  3699 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.954514  3147 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:49.955053  3699 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.960521  3868 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:49.963477  3832 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.965576  3441 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:49.948954  3882 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:49.969573  3582 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:49.970100  3582 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:49.931272  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:49.977645  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:49.982424  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 61827us
I20260709 12:57:49.925709  3838 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:49.985648  3699 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:49.985796  3838 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.986227  3699 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.987279  3838 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.852447  3958 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:49.988193  3958 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.988354  3699 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:49.989251  3732 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:49.991305  1571 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:49.990144  3879 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:49.927718  3981 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.387s	user 0.000s	sys 0.006s
I20260709 12:57:49.984285  1686 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:49.997073  1563 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:49.984699  3765 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:49.999889  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 83622.5us
I20260709 12:57:49.997843  1565 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:49.971113  3582 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.015436  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:49.999589  3699 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:50.044467  3810 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.045389  3810 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.047964  3810 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:50.049628  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:50.050156  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:50.050657  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:50.051065  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:50.051383  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.052959  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:50.069517  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.070236  1720 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:50.071394  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 87330.2us
I20260709 12:57:50.075929  3732 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:50.066946  3814 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 12:57:50.080737  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 144267us
I20260709 12:57:50.081379  3858 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:57:50.086630  4011 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.121s	user 0.003s	sys 0.000s
W20260709 12:57:50.076550  3981 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:57:49.997246  3900 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:50.120255  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 161842us
I20260709 12:57:50.133841  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:50.138760  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:50.139461  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:50.139601  1712 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.140027  1718 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.142477  3582 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.147718  3732 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.148044  3863 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.169988  3894 raft_consensus.cc:2764] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:57:50.170943  3879 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:50.205392  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 97751.4us
I20260709 12:57:50.191829  3699 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:50.211665  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 184217us
I20260709 12:57:50.197191  3732 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:50.201670  3973 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.247622  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:50.231048  3765 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:50.211171  3863 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:50.260378  1643 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
W20260709 12:57:50.262135  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.271188  1712 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:57:50.275736  3965 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:57:50.276454  3975 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:57:50.283792  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 64591.8us
I20260709 12:57:50.277901  1535 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:50.235466  3699 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:50.281474  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 105811us
I20260709 12:57:50.262317  3908 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:50.284206  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:50.293743  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:50.298019  1713 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:57:50.313247  4012 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:57:50.285576  3832 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:50.323675  3699 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:50.292766  3765 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:50.329087  3900 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:50.332571  3147 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:50.333132  3147 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:50.334100  3147 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:50.335598  3147 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.336408  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:50.337184  1643 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:50.337553  4015 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:57:50.339861  3973 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:50.340189  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:50.341547  3732 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:50.279017  3838 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:57:50.345350  3838 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:50.346122  3838 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:50.347185  3838 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:50.347522  3838 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:50.348083  3965 raft_consensus.cc:3055] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:50.348557  3965 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:50.349563  3965 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.350450  1718 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:57:50.351042  3965 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:50.356539  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 60214.2us
I20260709 12:57:50.365370  3810 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.366853  1713 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:50.366127  3810 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.374192  1563 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:50.374989  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:50.376931  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.381613  3879 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.382296  3879 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.385378  1713 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:57:50.388550  1643 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:50.392930  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:50.389063  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:50.396068  1646 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:50.397225  1686 leader_election.cc:400] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:57:50.397595  1686 leader_election.cc:403] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:50.397642  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:50.395612  1684 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:50.394843  3797 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.399722  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:50.400377  1718 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:50.399725  3797 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:50.403961  3797 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:50.405856  1537 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:50.406352  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:50.368825  3765 raft_consensus.cc:697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:50.384450  3879 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:50.398430  1713 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
W20260709 12:57:50.413367  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 135596us
I20260709 12:57:50.366675  3876 consensus_queue.cc:1059] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:57:50.374722  3885 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:50.348385  3838 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.432273  1537 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:50.440269  3863 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:50.440429  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46263.8us
W20260709 12:57:50.441731  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 47338.9us
I20260709 12:57:50.442910  3441 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:50.444197  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:50.444742  1646 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
W20260709 12:57:50.447924  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 50892.1us
I20260709 12:57:50.432981  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:50.410722  3732 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:50.453636  3879 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:50.459260  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:50.429675  3894 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:50.411149  3810 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:50.458159  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:50.461758  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:50.446508  3582 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:57:50.484622  1646 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:57:50.481216  1641 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:50.433923  2345 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:57:50.461019  3879 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:50.450831  3958 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:50.445678  3882 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.463095  3894 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:50.491189  3810 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:50.465791  3732 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:50.494055  3838 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:50.510586   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:50.481343  3899 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:50.495633  3879 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:50.513206  3973 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.513840  3973 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.517027  3882 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.519596  3882 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:50.524869  3810 raft_consensus.cc:697] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:50.503906  3958 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:50.526129  3810 consensus_queue.cc:237] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.527294  3958 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.504702  3858 consensus_queue.cc:1059] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:57:50.505900  3894 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:50.533926  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 89811.4us
I20260709 12:57:50.534797  1535 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:50.535701  3199 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:50.536733  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:50.546746  1565 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:50.492733  3634 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:50.550660  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:50.552803  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 96040.7us
I20260709 12:57:50.553086  1565 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:50.550971  4027 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:50.569046  3879 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:50.551304  3634 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:50.574645  3634 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:50.549628  3765 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:50.586287  4021 raft_consensus.cc:3055] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:50.586762  4021 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:50.587708  4021 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:50.592983  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:50.594444  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:50.595322  4027 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:50.595870  4027 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:50.596113  3838 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:50.596939  4027 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.602027  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:50.603058  1713 raft_consensus.cc:2410] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:50.608374  1610 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:50.612167  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 156215us
I20260709 12:57:50.615101  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:50.715471  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 248053us
W20260709 12:57:50.762761  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 168392us
I20260709 12:57:50.613927  3634 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:57:50.794694  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 78149.6us
W20260709 12:57:50.797590  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.804625  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:50.806311  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:50.807284  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 134493us
I20260709 12:57:50.814589  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:50.793550  3634 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:50.714840  3894 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.808054  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:50.800885  3885 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.821625  3868 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:50.876307  1565 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:57:50.868942  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 71476us
I20260709 12:57:50.814513  3975 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 12:57:50.871227  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.820837  3797 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:50.928656  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 120685us
I20260709 12:57:50.814805  3685 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:50.926669  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:50.938175  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 131189us
I20260709 12:57:50.884420  4018 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:50.888602  4034 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:57:50.819820  3634 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:50.922096  3765 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.937245  3868 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.924417  3958 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:50.868933  4028 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:50.999002  1571 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:50.946995  3797 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.002492  3797 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.002997  3797 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:50.970675  1612 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.562s (SENT) [suppressed 57 similar messages]
W20260709 12:57:50.997788  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 53846.4us
I20260709 12:57:51.005918  1686 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:50.815366  3732 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:50.945870  3965 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:51.018949  3147 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:50.941735  3885 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.981078  4036 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:51.052860  4036 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:51.053402  4036 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:51.057060  3833 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:50.954625  4018 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.012882  3797 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.043597  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:51.046753  4047 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.012234  3879 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:51.085338  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 79521.4us
I20260709 12:57:50.947273  3685 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:50.996868  3958 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.146941  1568 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:51.081072  3833 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:51.016263  3765 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:51.151253  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 232035us
I20260709 12:57:51.179170  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.184487  1719 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:51.183043  1720 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:51.179148  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 240297us
I20260709 12:57:51.171238  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:51.189973  1566 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:51.178602  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 239795us
I20260709 12:57:51.191074  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:51.196110  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:51.143131  3582 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.206082  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.099648  4049 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.212123  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.153260  3965 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.215467  1720 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:51.216933  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:51.223284  1712 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:57:51.217547  1716 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:51.233088  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.202471  3894 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.251701  1715 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:51.177021  4047 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.271354  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.272141  1720 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:57:51.272797  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:51.233760  4050 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.289098  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.213824  3582 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.305119  1714 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:51.235013  3965 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:51.318439  4043 log.cc:927] Time spent T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:57:51.318740  3797 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:51.292249  4050 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.324988  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:51.325220  4044 log.cc:927] Time spent T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:57:51.327078  4057 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.327461  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.327654  4057 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.329792  4057 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.330248  4021 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:51.330432  4057 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.330909  4057 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.249670  4049 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.333854  3582 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:51.335227  4049 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:51.328090  1714 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:51.337139  1719 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:51.339617  1566 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:57:51.345578  4018 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.346724  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:51.348748  3965 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:51.349294  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:51.350694  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:51.314481  3833 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.357856  1568 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:51.335862  4049 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:51.365270  1715 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:51.351230  1564 raft_consensus.cc:2376] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6. Re-sending same reply.
I20260709 12:57:51.355809  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:51.363826  1720 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:57:51.377403  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:51.378259  1568 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:51.383793  1721 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:57:51.384559  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.388965  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:51.389994  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.390672  1715 raft_consensus.cc:2376] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6. Re-sending same reply.
I20260709 12:57:51.390875  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.392117  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:51.410343  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 188932us
I20260709 12:57:51.336863  3868 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.327111  4050 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.422217  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:51.423278  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:51.420444  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:51.425419  1565 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:51.357187  3899 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:51.433194  3965 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:51.423070  1639 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:51.360566  4047 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.466486  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:51.477586  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:51.483295  1568 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:51.483240  1571 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:51.463567  3868 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.493358  3868 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.494719  1714 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:51.389670  3885 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.451530  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:51.439373  1564 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:51.451278  3685 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.465611  3958 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:51.429390  4057 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.499014  3973 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:51.498731  3899 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.495741  3965 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.502326  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:51.618151  1568 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:51.414971  4049 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.518927  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:51.619612  1721 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 2.
I20260709 12:57:51.620885  4049 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.620707  4052 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:51.438357  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.464300  4069 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.555588  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:51.558697  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.428440  3797 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:51.639189  4069 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.463533  3975 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:51.577514  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 81844.3us
I20260709 12:57:51.642364  3975 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.642894  4021 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:51.580384  3868 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.640106  3797 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.653818  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:51.655270  4052 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.655818  4052 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.584981  3885 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:51.585995  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:51.615097  1566 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:51.615598  3863 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:51.616372  3899 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:51.623303  3685 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:51.635869  1714 raft_consensus.cc:2376] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6. Re-sending same reply.
I20260709 12:57:51.639314  1720 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:51.389494  3634 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.707203  3634 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:51.667232  4077 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:57:51.657001  3885 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.671480  1566 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:51.687433  4051 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.693271  3685 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.672183  3863 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:51.695008  1639 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:57:51.695225  4036 consensus_meta.cc:287] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.012s
W20260709 12:57:51.714797  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:51.726215  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:51.734364  4051 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.745121  4026 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.769688  2345 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:51.769975  4026 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:51.769676  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:51.771814  2348 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
W20260709 12:57:51.729218  4060 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:57:51.781528  1715 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:51.776425  4036 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.363040  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 255) took 1170 ms. Trace:
I20260709 12:57:52.363651  1640 rpcz_store.cc:276] 0709 12:57:51.192483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.192631 (+   148us) service_pool.cc:224] Handling call
0709 12:57:51.193083 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:51.262750 (+ 69667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:51.262831 (+    81us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:51.298144 (+ 35313us) log.cc:844] Serialized 26 byte log entry
0709 12:57:51.425647 (+127503us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:51.425706 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:51.425811 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:52.362788 (+936977us) raft_consensus.cc:1685] finished
0709 12:57:52.362810 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:52.362975 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130800,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":111083,"threads_started":2,"wal-append.queue_time_us":154582}
W20260709 12:57:51.900276  4062 log.cc:927] Time spent T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.435s	user 0.000s	sys 0.001s
I20260709 12:57:51.900532  3958 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.366250  3958 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:51.944123  3973 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.367282  3973 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:52.368037  4069 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:52.288739  4060 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:57:51.791323  3797 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:51.839160  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:52.369678  3973 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:52.143272  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.371258  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1703) took 1482 ms. Trace:
I20260709 12:57:51.814793  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:52.372691  2348 raft_consensus.cc:2410] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:57:52.365043  1713 consensus_meta.cc:287] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.710s	user 0.014s	sys 0.011s
I20260709 12:57:52.375881  1713 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:52.371690  1563 rpcz_store.cc:276] 0709 12:57:50.916264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.928354 (+ 12090us) service_pool.cc:224] Handling call
0709 12:57:50.972207 (+ 43853us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:51.037327 (+ 65120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:51.037385 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:51.041431 (+  4046us) log.cc:844] Serialized 52 byte log entry
0709 12:57:51.193683 (+152252us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:51.215168 (+ 21485us) log.cc:844] Serialized 14 byte log entry
0709 12:57:51.736562 (+521394us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800470200. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287
0709 12:57:51.736733 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:51.736834 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:52.370911 (+634077us) raft_consensus.cc:1685] finished
0709 12:57:52.371055 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:52.371188 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22615,"prepare.queue_time_us":22066,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":4130,"raft.queue_time_us":76980,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":18049,"spinlock_wait_cycles":23996800,"thread_start_us":168731,"threads_started":2,"wal-append.queue_time_us":574440}
W20260709 12:57:51.924502  1612 leader_election.cc:336] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.541s (SENT)
W20260709 12:57:52.377790  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 453301us
I20260709 12:57:52.390177  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1825) took 1140 ms. Trace:
I20260709 12:57:52.390653  1713 rpcz_store.cc:276] 0709 12:57:51.235882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.653566 (+417684us) service_pool.cc:224] Handling call
0709 12:57:52.376403 (+722837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.424844  1720 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:52.432168  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1829) took 1132 ms. Trace:
I20260709 12:57:52.432458  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1831) took 1103 ms. Trace:
I20260709 12:57:52.435055  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:52.392917  1567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.002s	sys 0.017s
W20260709 12:57:52.436599  1567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.003s	sys 0.017s
I20260709 12:57:52.368468  3958 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:52.432919  1720 rpcz_store.cc:276] 0709 12:57:51.328931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.421602 (+1092671us) service_pool.cc:224] Handling call
0709 12:57:52.424379 (+  2777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.432263 (+  7884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:52.432416 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.441063  1642 raft_consensus.cc:2368] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:52.432602  1715 rpcz_store.cc:276] 0709 12:57:51.299620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.414500 (+114880us) service_pool.cc:224] Handling call
0709 12:57:52.432098 (+1017598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.373919  4051 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:52.444871  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.346791  3732 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:57:52.391073  2342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.000s	sys 0.015s
I20260709 12:57:52.443709  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 254) took 1233 ms. Trace:
W20260709 12:57:52.154628  4059 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.703s	user 0.000s	sys 0.002s
I20260709 12:57:52.154975  3441 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:52.449453  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:52.450152  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:52.465566  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:51.970858  3885 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:51.897706  4068 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:52.451648  3899 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:52.451890  3732 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.452309  4026 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:52.444927  3894 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:52.438021  3973 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:52.442482  3797 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.422993  3863 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.454483  1564 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:57:52.477645  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1715) took 1155 ms. Trace:
I20260709 12:57:52.454728  3765 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:52.459381  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:52.460464  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:52.479653  1719 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:52.480134  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1849) took 1014 ms. Trace:
I20260709 12:57:51.876077  4072 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:52.445456  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:52.449898  1567 rpcz_store.cc:276] 0709 12:57:51.210088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.348225 (+138137us) service_pool.cc:224] Handling call
0709 12:57:51.348616 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:51.360909 (+ 12293us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:51.402383 (+ 41474us) log.cc:844] Serialized 14 byte log entry
0709 12:57:52.443274 (+1040891us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:52.443387 (+   113us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:52.443450 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:52.443531 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:52.443646 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6039,"prepare.queue_time_us":53504,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":8026,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3216,"thread_start_us":1034285,"threads_started":1}
I20260709 12:57:52.390329  4052 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:52.464694  1568 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:51.897229  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:52.155329  3882 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.370368  2345 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:52.490216  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:52.490633  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:52.490845  2314 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:52.490928  1718 raft_consensus.cc:2376] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7. Re-sending same reply.
I20260709 12:57:52.491214  1721 raft_consensus.cc:2376] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6. Re-sending same reply.
I20260709 12:57:52.491641  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1848) took 1036 ms. Trace:
I20260709 12:57:52.475212  1639 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:52.476267  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:52.493564  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:52.494306  1714 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:52.494904  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1835) took 1164 ms. Trace:
I20260709 12:57:52.495283  1714 rpcz_store.cc:276] 0709 12:57:51.330134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.482922 (+1152788us) service_pool.cc:224] Handling call
0709 12:57:52.494841 (+ 11919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.483546  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:52.448014  4069 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:57:52.492287  1718 rpcz_store.cc:276] 0709 12:57:51.455665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.481629 (+1025964us) service_pool.cc:224] Handling call
0709 12:57:52.491582 (+  9953us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.446269  3958 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.480520  1719 rpcz_store.cc:276] 0709 12:57:51.465937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.460158 (+994221us) service_pool.cc:224] Handling call
0709 12:57:52.480065 (+ 19907us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.484756  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:52.477962  1564 rpcz_store.cc:276] 0709 12:57:51.322156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.589342 (+267186us) service_pool.cc:224] Handling call
0709 12:57:52.447347 (+858005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.477424 (+ 30077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:52.477576 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.491719  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1850) took 1023 ms. Trace:
W20260709 12:57:52.462947  2342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.000s	sys 0.016s
I20260709 12:57:52.491719  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1717) took 1164 ms. Trace:
I20260709 12:57:52.481105  3973 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.497327  1640 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:52.476672  3885 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:52.498821  3882 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:52.498657  1642 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:52.521301  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:52.541777  1714 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:52.490079  3814 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.500936  2340 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:52.531944  3732 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:52.532830  3765 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:52.468003  3441 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.490285  4052 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.486407  3894 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:52.539186  2348 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 3: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:52.539554  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:52.550423  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:52.550920  1719 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:52.551183  1714 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:52.552031  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:52.552764  1719 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:52.536237  1721 rpcz_store.cc:276] 0709 12:57:51.468247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.477680 (+1009433us) service_pool.cc:224] Handling call
0709 12:57:52.491661 (+ 13981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.536782  1568 rpcz_store.cc:276] 0709 12:57:51.322723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.443980 (+1121257us) service_pool.cc:224] Handling call
0709 12:57:52.464520 (+ 20540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.487110 (+ 22590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:52.487291 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.538121  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:52.474987  3899 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.489148  3965 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:52.546105  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:52.505741  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 60350.7us
I20260709 12:57:52.486884  3797 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:52.548036  4063 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:52.492165  4072 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:52.567725  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:52.568503  1721 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:57:52.568682  1642 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:52.569340  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1838) took 1238 ms. Trace:
I20260709 12:57:52.569772  1721 rpcz_store.cc:276] 0709 12:57:51.330951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.555747 (+1224796us) service_pool.cc:224] Handling call
0709 12:57:52.566488 (+ 10741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.569032 (+  2544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:52.569274 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.489574  4068 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.542958  3958 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:52.583851  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:52.568079  3833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.006s	sys 0.027s
I20260709 12:57:52.547861  3814 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.563956  3732 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 12:57:52.601892  1566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1710) took 1358 ms (client timeout 1562 ms). Trace:
W20260709 12:57:52.615842  1566 rpcz_store.cc:269] 0709 12:57:51.237020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.352400 (+115380us) service_pool.cc:224] Handling call
0709 12:57:52.594989 (+1242589us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54001658d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:52.595126 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518481664}
I20260709 12:57:52.565444  3965 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:52.597054  2349 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:52.597209  3685 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:52.555910  4052 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.592556  1535 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:52.549260  3885 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:52.620453  1715 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
W20260709 12:57:52.613677  3833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.007s	sys 0.028s
I20260709 12:57:52.624259  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:52.624898  1721 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:57:52.601688  4079 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:52.613420  4036 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:52.625295  3965 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:52.630894  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:52.648751  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1702) took 1766 ms. Trace:
I20260709 12:57:52.649307  4087 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.677058  3814 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:52.677786  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:52.678618  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:52.679005  3765 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:52.679553  3973 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:52.817502  1721 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
W20260709 12:57:52.840209  1612 leader_election.cc:336] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.541s (SENT)
I20260709 12:57:53.003669  3868 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.007284  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:57:52.863282  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.002992  4063 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.007445  3868 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:53.008255  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 168087us
W20260709 12:57:53.008994  1612 leader_election.cc:336] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.567s (SENT)
I20260709 12:57:53.009217  2344 raft_consensus.cc:2410] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:57:53.009846  1612 leader_election.cc:336] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.567s (SENT)
I20260709 12:57:52.651500  4079 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:52.837703  3894 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.010630  4063 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:53.011487  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:52.912102  2342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 344) took 1109 ms. Trace:
W20260709 12:57:52.962796  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:53.004172  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 306933us
I20260709 12:57:53.029462  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:52.888185  1639 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:53.010636  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:53.013839  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.012172  1715 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:52.948683  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:53.039999  1646 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:53.041158  1721 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:53.067265  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:52.975406  4083 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:57:53.067534  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.067921  1715 raft_consensus.cc:2376] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6. Re-sending same reply.
I20260709 12:57:52.696964  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:52.680295  3882 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.070376  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.075157  1721 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:52.924770  3441 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:52.906342  4069 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:52.959146  3634 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:53.024439  3894 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.023299  1572 rpcz_store.cc:276] 0709 12:57:50.816289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.821132 (+  4843us) service_pool.cc:224] Handling call
0709 12:57:50.821445 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:50.916635 (+ 95190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:50.916691 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:50.936394 (+ 19703us) log.cc:844] Serialized 52 byte log entry
0709 12:57:51.204448 (+268054us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:51.204507 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:51.204895 (+   388us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:52.153875 (+948980us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:52.577623 (+423748us) raft_consensus.cc:1685] finished
0709 12:57:52.577652 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:52.582456 (+  4804us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27959,"raft.queue_time_us":53801,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":25333,"spinlock_wait_cycles":91639040,"thread_start_us":190819,"threads_started":1,"wal-append.queue_time_us":469375}
I20260709 12:57:53.024843  3973 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:57:53.077351  4081 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.474s	user 0.001s	sys 0.000s
I20260709 12:57:52.948154  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:53.078764  3958 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.073042  4072 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.061753  4087 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.088529  3833 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.453575  4106 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.454890  4106 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.455442  4063 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.455874  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:53.457474  4106 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.104665  3899 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.453109  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.407605  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:53.459182  1717 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:53.459385  1718 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:53.460155  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.180377  3885 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.460784  1717 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:53.441157  3441 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.461670  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.461853  3441 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.462416  1717 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:53.464130  3441 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.461082  4104 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:53.270915  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.465543  1572 raft_consensus.cc:2410] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:57:53.450947  4113 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 12:57:53.456581  1715 raft_consensus.cc:2376] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5. Re-sending same reply.
I20260709 12:57:53.467427  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.467984  1715 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:53.468267  1572 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:57:53.468806  3863 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:53.454101  4080 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:53.469424  4080 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:53.470333  3797 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.425930  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.401160  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 258) took 1106 ms. Trace:
W20260709 12:57:53.196635  1640 consensus_meta.cc:287] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.001s
I20260709 12:57:53.111984  3894 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.248924  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.110147  3973 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.278740  4079 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.397686  3975 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:53.313432  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.022s	sys 0.022s
I20260709 12:57:53.087834  4069 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:53.089906  2340 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:53.472927  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1494) took 1886 ms. Trace:
I20260709 12:57:53.487442  3833 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.487648  1645 rpcz_store.cc:276] 0709 12:57:51.586527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.594960 (+  8433us) service_pool.cc:224] Handling call
0709 12:57:52.432135 (+837175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.593911 (+161776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:52.593942 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:52.593987 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:52.594041 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.472679 (+878638us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540040d3d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:53.472735 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.472862 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371523840}
I20260709 12:57:53.248054  4099 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:53.276772  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:53.472425  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:53.484687  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.450133  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.473757  1640 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:57:53.271261  4096 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:57:53.490911  3685 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.028023  2342 rpcz_store.cc:276] 0709 12:57:51.745239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.750497 (+  5258us) service_pool.cc:224] Handling call
0709 12:57:51.788373 (+ 37876us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:51.794846 (+  6473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:51.794878 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:51.795359 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:57:52.539094 (+743735us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:52.634812 (+ 95718us) log.cc:844] Serialized 14 byte log entry
0709 12:57:52.649463 (+ 14651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:52.649610 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:52.809326 (+159716us) raft_consensus.cc:1685] finished
0709 12:57:52.809357 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:52.854443 (+ 45086us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19273,"prepare.queue_time_us":487738,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2866,"raft.queue_time_us":51338,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":51031,"thread_start_us":821541,"threads_started":2,"wal-append.queue_time_us":819136}
I20260709 12:57:53.491492  3685 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.471624  3868 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.383330  4100 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.493721  1646 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:53.470348  4080 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.493491  4100 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.494494  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1422) took 1020 ms. Trace:
I20260709 12:57:53.494707  4080 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.494953  1640 rpcz_store.cc:276] 0709 12:57:52.474333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.475976 (+  1643us) service_pool.cc:224] Handling call
0709 12:57:53.494427 (+1018451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.277153  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:53.452234  4090 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:57:53.497272  1638 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:53.498260  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1833) took 2168 ms. Trace:
I20260709 12:57:53.103212  3634 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.498799  1713 rpcz_store.cc:276] 0709 12:57:51.329577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.415661 (+1086084us) service_pool.cc:224] Handling call
0709 12:57:52.416054 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:52.416469 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:52.416500 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:52.417118 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:57:53.023040 (+605922us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:53.023095 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.023180 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:53.451511 (+428331us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:53.497946 (+ 46435us) raft_consensus.cc:1685] finished
0709 12:57:53.497966 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.498172 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1444,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":73182080,"thread_start_us":357059,"threads_started":1,"wal-append.queue_time_us":828566}
I20260709 12:57:53.500756  3685 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.501237  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.502099  1713 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
W20260709 12:57:53.270665  4109 log.cc:927] Time spent T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:57:53.473404  1567 rpcz_store.cc:276] 0709 12:57:52.294710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.488662 (+193952us) service_pool.cc:224] Handling call
0709 12:57:52.496767 (+  8105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.574273 (+ 77506us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:57:52.810056 (+235783us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.124772 (+314716us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.124855 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:57:53.124911 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.400683 (+275772us) spinlock_profiling.cc:243] Waited 77.2 ms on lock 0x7b5400093154. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:53.400782 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.401046 (+   264us) inbound_call.cc:177] Queueing success response
0709 12:57:53.450309 (+ 49263us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
Metrics: {"prepare.queue_time_us":627854,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":326535,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":172,"spinlock_wait_cycles":194207744,"thread_start_us":549686,"threads_started":3,"wal-append.queue_time_us":392732}
W20260709 12:57:53.484822  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 455443us
I20260709 12:57:53.503234  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.504491  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:53.505403  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.246632  4097 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:53.506141  4097 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.213397  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:53.501281  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 491405us
W20260709 12:57:53.496923  4105 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.251s	user 0.002s	sys 0.002s
I20260709 12:57:53.470904  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:53.509097  1612 leader_election.cc:336] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.672s (SENT)
I20260709 12:57:53.509143  1715 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
W20260709 12:57:53.509846  1612 leader_election.cc:336] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.672s (SENT)
I20260709 12:57:53.510267  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:53.511021  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.277524  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.513494  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.514289  2343 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:53.513669  3685 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:57:53.515326  1712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1845) took 2095 ms (client timeout 1979 ms). Trace:
W20260709 12:57:53.479799  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.022s	sys 0.026s
I20260709 12:57:53.476125  3894 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.482311  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.518329  1646 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:53.519891  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.520589  1646 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
W20260709 12:57:53.521080  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44685.9us
I20260709 12:57:53.481074  4069 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.523008  4069 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.523206  4097 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.523515  2347 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:57:53.524289  3882 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:53.525319  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.525691  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:53.526551  3882 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:53.526955  3882 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.527040  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.527688  3882 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:53.528110  1715 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:57:53.512459  1717 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:53.529805  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.530505  1717 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:57:53.531649  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.103768  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 255) took 1883 ms. Trace:
I20260709 12:57:53.504542  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.533535  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.534348  1646 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:53.248500  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.558656  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.563912  1717 raft_consensus.cc:2410] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:53.535871  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1711) took 2261 ms. Trace:
W20260709 12:57:53.557199  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.543401  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:53.188863  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 256) took 1777 ms. Trace:
I20260709 12:57:53.566535  1640 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:53.536552  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:53.388399  1720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.004s
I20260709 12:57:53.551097  1718 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
W20260709 12:57:53.567701  1720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.009s	sys 0.006s
I20260709 12:57:53.565548  1641 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:53.577560  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1834) took 2247 ms. Trace:
I20260709 12:57:53.568866  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.578359  1572 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:53.579007  1610 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:53.579032  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.577973  1720 rpcz_store.cc:276] 0709 12:57:51.329854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.438690 (+1108836us) service_pool.cc:224] Handling call
0709 12:57:52.452856 (+ 14166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:52.725312 (+272456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:52.725356 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:52.738544 (+ 13188us) log.cc:844] Serialized 26 byte log entry
0709 12:57:53.577240 (+838696us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:53.577279 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.577346 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:53.577391 (+    45us) raft_consensus.cc:1685] finished
0709 12:57:53.577403 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.577506 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52713,"raft.queue_time_us":359819,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":34323,"thread_start_us":1006453,"threads_started":2,"wal-append.queue_time_us":676880}
I20260709 12:57:53.582370  1640 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:57:53.568087  1563 rpcz_store.cc:276] 0709 12:57:51.411997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.443523 (+1031526us) service_pool.cc:224] Handling call
0709 12:57:52.463915 (+ 20392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.625424 (+161509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:52.625453 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:52.625491 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:52.625527 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.188550 (+563023us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54001fe854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:53.188612 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.188788 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370831232}
W20260709 12:57:53.515790  1712 rpcz_store.cc:269] 0709 12:57:51.419966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.200387 (+1780421us) service_pool.cc:224] Handling call
0709 12:57:53.515242 (+314855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.532807  1565 rpcz_store.cc:276] 0709 12:57:51.220451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.561744 (+341293us) service_pool.cc:224] Handling call
0709 12:57:52.430504 (+868760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.430762 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:52.699157 (+268395us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.093845 (+394688us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.094039 (+   194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.094105 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:53.098417 (+  4312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.101014 (+  2597us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.103707 (+  2693us) inbound_call.cc:177] Queueing success response
0709 12:57:53.494974 (+391267us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b48000402d8. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
Metrics: {"prepare.queue_time_us":864691,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":421103,"raft.run_cpu_time_us":2560,"raft.run_wall_time_us":408224,"spinlock_wait_cycles":19426176,"thread_start_us":645445,"threads_started":3,"wal-append.queue_time_us":373513}
W20260709 12:57:53.210356  4094 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
W20260709 12:57:53.573299  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 50269.5us
I20260709 12:57:53.185124  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:53.536585  1569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.013s
I20260709 12:57:53.389570  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1836) took 2059 ms. Trace:
W20260709 12:57:53.212666  4078 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
W20260709 12:57:53.574170  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 62860.8us
W20260709 12:57:53.597935  1569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.000s	sys 0.017s
I20260709 12:57:53.587420  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.599887  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:53.567734  1646 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:53.585104  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:53.213755  4082 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.475s	user 0.000s	sys 0.001s
I20260709 12:57:53.601060  1644 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:53.601701  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.215643  4110 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:53.602837  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.602991  4110 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.603613  1572 raft_consensus.cc:2410] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:57:53.515938  4063 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.604387  3441 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:53.604547  3833 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.604929  3441 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.605324  3441 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:53.605378  4097 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:53.606047  4097 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.608247  4097 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.605240  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1709) took 2406 ms. Trace:
I20260709 12:57:53.608847  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.609256  1570 rpcz_store.cc:276] 0709 12:57:51.198637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.205881 (+  7244us) service_pool.cc:224] Handling call
0709 12:57:51.222593 (+ 16712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:51.388738 (+166145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:51.388771 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:51.421793 (+ 33022us) log.cc:844] Serialized 26 byte log entry
0709 12:57:51.597299 (+175506us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:51.597353 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:51.597433 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:53.605019 (+2007586us) raft_consensus.cc:1685] finished
0709 12:57:53.605038 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.605160 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2531,"raft.queue_time_us":62974,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":31806,"thread_start_us":308923,"threads_started":2,"wal-append.queue_time_us":1194622}
I20260709 12:57:53.611022  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.611228  3882 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.611641  1713 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:53.611766  1570 raft_consensus.cc:2410] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:57:53.612332  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1841) took 2280 ms. Trace:
I20260709 12:57:53.613034  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.613600  1570 raft_consensus.cc:2376] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6. Re-sending same reply.
I20260709 12:57:53.614457  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.615502  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.615718  3441 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.616466  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:53.611809  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.617748  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.617313  1570 raft_consensus.cc:2410] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:53.618621  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:53.619638  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:53.619729  1610 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:53.618407  1572 raft_consensus.cc:2368] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 8.
I20260709 12:57:53.212997  4111 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.626628  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.215101  3765 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:53.563150  4068 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:53.634232  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.612048  4122 consensus_queue.cc:1059] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:57:53.563625  3965 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.624752  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.612708  1713 rpcz_store.cc:276] 0709 12:57:51.331913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.611180 (+2279267us) service_pool.cc:224] Handling call
0709 12:57:53.611451 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.612111 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.612278 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.627637  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.621011  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:53.637328  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.636453  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.199016  4052 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.642208  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.630283  1721 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:53.598713  1714 rpcz_store.cc:276] 0709 12:57:51.330405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.556001 (+1225596us) service_pool.cc:224] Handling call
0709 12:57:52.566797 (+ 10796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.567025 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:57:52.818438 (+251413us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.389050 (+570612us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.389143 (+    93us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:53.389218 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.389313 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.389488 (+   175us) inbound_call.cc:177] Queueing success response
0709 12:57:53.507825 (+118337us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b1800443500. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
Metrics: {"prepare.queue_time_us":726275,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":66,"raft.queue_time_us":11168,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":16987904,"thread_start_us":722594,"threads_started":2,"wal-append.queue_time_us":637664}
I20260709 12:57:53.632560  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:53.632927  2347 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:53.644358  2312 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:53.633245  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:53.645162  1640 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:53.605221  3685 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:53.635792  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:53.628042  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:53.639577  1646 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:53.622601  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1708) took 2444 ms. Trace:
I20260709 12:57:53.575258  4101 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:53.650153  1718 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:53.640765  1645 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:53.650785  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1433) took 1019 ms. Trace:
W20260709 12:57:53.210901  4089 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 12:57:53.646438  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.646566  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.651153  1718 rpcz_store.cc:276] 0709 12:57:52.630973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.642354 (+1011381us) service_pool.cc:224] Handling call
0709 12:57:53.646705 (+  4351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.650556 (+  3851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.650736 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.641469  1644 raft_consensus.cc:2410] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:53.645826  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:53.651865  1642 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:53.626653  3802 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:53.654870  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.655331  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:53.655896  1720 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:53.587440  4072 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:53.653324  1568 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:53.635836  4099 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:53.663348  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.664798  1570 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:53.664354  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.666916  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.633468  4111 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.670264  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1832) took 2341 ms. Trace:
I20260709 12:57:53.670722  4116 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:53.671239  4116 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.671525  2340 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:57:53.671746  4116 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.670684  1716 rpcz_store.cc:276] 0709 12:57:51.329263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.450841 (+1121578us) service_pool.cc:224] Handling call
0709 12:57:52.451244 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:52.451604 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:52.451632 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:52.452094 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:57:52.630214 (+178120us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:52.630271 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:52.630379 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:53.670066 (+1039687us) raft_consensus.cc:1685] finished
0709 12:57:53.670085 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.670209 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":272364,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":44049,"thread_start_us":177656,"threads_started":1,"wal-append.queue_time_us":372546}
I20260709 12:57:53.672297  2340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59844 (request call id 501) took 1070 ms. Trace:
I20260709 12:57:53.664342  4099 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.673399  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1440) took 1029 ms. Trace:
I20260709 12:57:53.673446  4099 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:53.673913  1714 rpcz_store.cc:276] 0709 12:57:52.643743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.657459 (+1013716us) service_pool.cc:224] Handling call
0709 12:57:53.672918 (+ 15459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.673108 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.673132 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.673171 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:53.673207 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.673257 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.673349 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.652818  4110 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.662758  3833 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:53.675499  3833 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.646286  4063 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.664402  3868 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.676939  4063 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.677703  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1442) took 1033 ms. Trace:
I20260709 12:57:53.678081  1716 rpcz_store.cc:276] 0709 12:57:52.644428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.672564 (+1028136us) service_pool.cc:224] Handling call
0709 12:57:53.677199 (+  4635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.677388 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.677416 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.677456 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:53.677492 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.677548 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.677651 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.679006  4063 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.677073  3868 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.679517  1572 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:53.650556  3975 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:53.652887  3814 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:53.686718  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.648203  1569 rpcz_store.cc:276] 0709 12:57:51.178665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.178827 (+   162us) service_pool.cc:224] Handling call
0709 12:57:51.206032 (+ 27205us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:57:51.578277 (+372245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:51.578403 (+   126us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:57:52.444262 (+865859us) log.cc:844] Serialized 78 byte log entry
0709 12:57:52.698837 (+254575us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:53.011311 (+312474us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.011710 (+   399us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.598427 (+586717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.598499 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:53.598539 (+    40us) raft_consensus.cc:1685] finished
0709 12:57:53.598552 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.622511 (+ 23959us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35807,"prepare.queue_time_us":713143,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":418602,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":53945,"thread_start_us":1409051,"threads_started":4,"wal-append.queue_time_us":704630}
I20260709 12:57:53.687356  1642 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:53.662210  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.689085  4095 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:53.689682  4093 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.689756  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.690675  1566 raft_consensus.cc:2410] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:57:53.690253  4093 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.686710  3814 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.692888  3814 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:53.657217  4074 consensus_queue.cc:1059] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:57:53.694444  4074 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:53.694767  4074 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:53.695505  4074 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.696910  3894 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.662197  4084 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.692004  1564 raft_consensus.cc:2410] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:57:53.684239  4052 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:53.697691  4084 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.662621  3958 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.686844  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.698696  3958 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.699396  2342 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:53.699947  4084 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.700086  4063 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:53.700740  4063 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:53.700819  3958 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.665143  4072 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.662995  3685 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.701671  4063 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.702715  4072 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.703115  3685 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.703599  4118 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.697377  3894 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.704196  4118 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.705861  3894 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.706384  4118 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.680222  2340 rpcz_store.cc:276] 0709 12:57:52.602185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.614507 (+ 12322us) service_pool.cc:224] Handling call
0709 12:57:53.672237 (+1057730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.662433  4101 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.707893  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:53.708936  4101 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.683182  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.657601  3802 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.698184  4052 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:53.711131  3802 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:53.711198  4052 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.712564  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 223) took 1066 ms. Trace:
W20260709 12:57:53.714504  1719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.020s	sys 0.020s
I20260709 12:57:53.688462  1720 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:53.717518  1720 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:53.717629  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1441) took 1073 ms. Trace:
I20260709 12:57:53.708485  1566 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:53.718080  1715 rpcz_store.cc:276] 0709 12:57:52.644092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.666850 (+1022758us) service_pool.cc:224] Handling call
0709 12:57:53.717191 (+ 50341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.717344 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.717367 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.717404 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:57:53.717434 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.717483 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.717578 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.714430  1716 rpcz_store.cc:276] 0709 12:57:52.646390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.681106 (+1034716us) service_pool.cc:224] Handling call
0709 12:57:53.711878 (+ 30772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.712067 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.712091 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.712136 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:53.712170 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.712323 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.712489 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.717298  1684 leader_election.cc:400] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:53.721402  1684 leader_election.cc:403] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:53.718844  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.711269  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:53.718279  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 224) took 1071 ms. Trace:
I20260709 12:57:53.675535  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 221) took 1030 ms. Trace:
W20260709 12:57:53.714955  1719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.020s	sys 0.020s
I20260709 12:57:53.722507  1720 rpcz_store.cc:276] 0709 12:57:52.646730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.717146 (+1070416us) service_pool.cc:224] Handling call
0709 12:57:53.717368 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.718062 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.718229 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.722731  1714 rpcz_store.cc:276] 0709 12:57:52.645595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.674831 (+1029236us) service_pool.cc:224] Handling call
0709 12:57:53.675114 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.675268 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.675290 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.675326 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:53.675361 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.675405 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.675487 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.723573  1610 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:53.728593  1640 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:57:53.671890  4111 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:53.734619  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 46379.2us
I20260709 12:57:53.735036  4125 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 3. Current term is 4.
I20260709 12:57:53.697357  3441 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.735163  3685 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:53.692273  4093 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.716990  4074 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:53.733736  4122 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.692049  4087 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.736593  4069 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:53.737030  4072 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:53.740202  4114 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.740777  4084 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:53.743530  4052 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.744686  1715 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:57:53.777184  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 225) took 1130 ms. Trace:
I20260709 12:57:53.758008  3973 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.746397  3882 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.747251  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:53.783957  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:53.784742  4118 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:53.785173  1535 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:53.785529  4118 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:53.786388  4118 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:53.787312  4052 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.787871  3802 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.749784  1537 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:53.797432  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 47740us
I20260709 12:57:53.798213  3802 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.683151  3868 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:53.798982  3868 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:53.799474  3868 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:53.756357  4125 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:57:53.800403  3868 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.760246  2349 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:53.760980  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:53.759262  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.758678  1717 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:53.753427  4099 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.805317  1641 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:53.806365  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.807101  4099 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.807513  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.807793  1647 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 7. Ops: []
I20260709 12:57:53.756354  1684 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:53.809072  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52801.6us
I20260709 12:57:53.809831  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:53.565692  1571 rpcz_store.cc:276] 0709 12:57:51.274086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.577185 (+303099us) service_pool.cc:224] Handling call
0709 12:57:51.585062 (+  7877us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:57:51.585482 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:51.585510 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:57:52.369645 (+784135us) log.cc:844] Serialized 78 byte log entry
0709 12:57:52.612966 (+243321us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:52.986155 (+373189us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.535288 (+549133us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.535512 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.535585 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:53.535624 (+    39us) raft_consensus.cc:1685] finished
0709 12:57:53.535637 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.535798 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13166,"prepare.queue_time_us":626054,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":48,"raft.queue_time_us":114800,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":14787,"thread_start_us":714869,"threads_started":3,"wal-append.queue_time_us":279194}
I20260709 12:57:53.810684  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:53.811512  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.770141  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 229) took 1121 ms. Trace:
I20260709 12:57:53.812849  1720 rpcz_store.cc:276] 0709 12:57:52.657332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.725260 (+1067928us) service_pool.cc:224] Handling call
0709 12:57:53.769625 (+ 44365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.769793 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.769825 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.769867 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:53.769913 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.769985 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.770084 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.814152  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.814881  1643 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:53.815765  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.816243  3973 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:53.816825  3973 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.817200  3973 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.817679  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.818331  1640 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:53.819222  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.819773  1640 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:53.821239  4125 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:53.821722  4125 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.822098  4125 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:53.816334  1643 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:53.825690  1643 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:57:53.827286  1643 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:53.820632  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.829911  1640 raft_consensus.cc:2410] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:53.768267  1566 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:53.774948  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.832962  1569 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:53.778270  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.777688  1715 rpcz_store.cc:276] 0709 12:57:52.647071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.719040 (+1071969us) service_pool.cc:224] Handling call
0709 12:57:53.744422 (+ 25382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:53.776795 (+ 32373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.777114 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:53.751610  3833 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:53.711308  3814 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.844245  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.769779  4069 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.788352  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:53.793841  4116 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.759756  4122 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.776530  4072 raft_consensus.cc:697] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:53.855420  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.778088  4084 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:53.776775  4114 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.748265  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.796440  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.857553  1646 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:53.858596  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.798171  1537 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:53.889393  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.750295  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.733490  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:53.814240  3965 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:53.769109  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 123355us
I20260709 12:57:53.891793  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.892496  2348 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 7. Ops: [5.6-5.6]
I20260709 12:57:53.894032  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.889456  1646 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:53.832906  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.895740  1569 raft_consensus.cc:2410] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:57:53.895963  1566 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:53.833427  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.835125  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.897015  1564 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:53.838325  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.839774  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:53.898413  1563 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:53.845105  1640 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:53.894704  1570 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:53.899818  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:53.847440  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 59168.7us
I20260709 12:57:53.845700  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.850325  4080 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:53.850102  4069 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.888916  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:53.889878  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 91783.1us
W20260709 12:57:53.890857  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 157432us
I20260709 12:57:53.679371  4131 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:53.923895  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:53.900040  1641 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:53.847565  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.901211  1535 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:53.927637  1565 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:57:53.928633  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:53.902190  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:53.926679  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.931640  1715 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:53.931799  1564 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:53.906070  3814 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.907054  3975 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.906993  1644 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:53.907768  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1837) took 2577 ms. Trace:
I20260709 12:57:54.104033  3765 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:53.908625  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:53.908910  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.105186  1572 raft_consensus.cc:2410] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:57:54.104272  1719 rpcz_store.cc:276] 0709 12:57:51.330666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.558662 (+1227996us) service_pool.cc:224] Handling call
0709 12:57:52.559020 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:52.904955 (+345935us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:57:53.076656 (+171701us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.725261 (+648605us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.725433 (+   172us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:53.761292 (+ 35859us) log.cc:844] Serialized 26 byte log entry
0709 12:57:53.761441 (+   149us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:53.761474 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.761536 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:53.841763 (+ 80227us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180034d3e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:57:53.851471 (+  9708us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b180034d3e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:57:53.907510 (+ 56039us) raft_consensus.cc:1685] finished
0709 12:57:53.907534 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.907665 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2164,"prepare.queue_time_us":412294,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":406853,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":92538,"spinlock_wait_cycles":72078976,"thread_start_us":1055966,"threads_started":3,"wal-append.queue_time_us":656624}
I20260709 12:57:54.106591  1572 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:57:53.901175  1571 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:54.104545  3765 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:53.916419  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:53.919663  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:53.920120  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 68713.4us
W20260709 12:57:54.109198  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 189579us
I20260709 12:57:54.109674  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.109941  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:54.110700  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.110929  1537 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.111610  1535 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.112087  1537 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.112438  4080 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.112825  4101 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.113023  4080 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:54.113386  4101 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.113588  4080 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.113876  4101 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.921973  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.116885  3868 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:54.117300  3868 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:54.117681  3868 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:53.917611  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 273345us
I20260709 12:57:53.922654  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.899478  3965 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.118815  3965 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.120216  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:54.069394  4118 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:54.122597  4068 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:54.003739  4129 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:57:54.122606  3833 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:54.123498  4080 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.001204  3797 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:54.108806  1571 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:54.124691  3833 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:54.125010  3797 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:53.929461  4097 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:57:54.125583  4080 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:54.108765  3765 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.126143  3797 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.127164  3765 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.112583  3958 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:54.129297  3958 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.129664  3958 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.131026  3441 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.131460  3441 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.131836  3441 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.133378  1572 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:54.133745  3868 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.989581  4072 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:53.901782  3882 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:54.146893  3882 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:54.072728  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:54.150825  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 78195.5us
I20260709 12:57:54.140409  3958 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.073671  4125 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.156319  3958 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:54.157800  4095 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.158555  4125 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.923512  4131 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.159526  4131 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:54.162372  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.163043  1572 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:54.163231  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 51429.4us
I20260709 12:57:53.899195  4099 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:54.164584  1684 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.165011  4099 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:54.165438  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.165498  2312 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:54.166410  1684 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.166167  4099 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.167590  3958 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.167954  3958 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.168004  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.168365  3958 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.915675  4100 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:54.056476  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.169019  4074 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:54.169194  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.169464  4074 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.170303  3802 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:54.169854  4074 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.171413  3802 raft_consensus.cc:697] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:54.171990  3833 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:54.172518  3833 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:54.172986  3833 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.074369  4084 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.929411  4087 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:54.062737  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.081990  4093 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.086516  3894 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:54.066522  4116 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:54.093808  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:54.094167  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.065279  3973 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.094758  1715 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:57:54.094969  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.169026  4100 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:54.097124  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:54.098971  3634 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:54.101032  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.063915  4114 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:53.907640  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:53.920841  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.117635  1535 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:54.218111  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 100521us
I20260709 12:57:54.218916  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:53.905351  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.121876  4111 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:54.121951  4121 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:54.138674  1570 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:54.141393  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 226) took 1494 ms. Trace:
I20260709 12:57:54.143069  3965 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:53.990974  3975 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:54.226400  1716 rpcz_store.cc:276] 0709 12:57:52.647451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.721194 (+1073743us) service_pool.cc:224] Handling call
0709 12:57:53.770493 (+ 49299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:53.774499 (+  4006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.774519 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:53.777394 (+  2875us) log.cc:844] Serialized 26 byte log entry
0709 12:57:54.053784 (+276390us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:54.053840 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:54.053931 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:54.141104 (+ 87173us) raft_consensus.cc:1685] finished
0709 12:57:54.141134 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:54.141314 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3400,"thread_start_us":240201,"threads_started":1,"wal-append.queue_time_us":268337}
I20260709 12:57:54.146373  1569 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:54.070667  1564 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:54.211941  4100 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.070861  4069 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.065960  4122 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:54.168663  1645 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:54.189217  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:54.207515  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 144848us
I20260709 12:57:54.207780  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:54.242877  1641 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.096076  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.243077  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:54.243957  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.214602  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.198279  4087 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.220329  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.228024  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.211258  4097 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.158367  4095 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.190138  3441 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:54.239454  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 117804us
I20260709 12:57:54.244678  1642 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:54.207942  4093 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.227144  4129 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.250996  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.253731  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:54.225917  3765 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:54.254724  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:54.281283  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.281594  1646 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.234901  2340 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:54.271201  1643 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:54.270561  2345 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:54.236393  4144 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.277467  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:54.238447  4100 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:54.282585  4144 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.255218  4087 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.257454  4097 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.273244  4122 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:54.256734  3634 raft_consensus.cc:2764] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:57:54.205979  3802 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.315179  4093 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:54.231436  3882 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.318454  1646 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:54.299836  3894 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:57:54.333199  4099 raft_consensus.cc:2764] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:57:54.333959  4097 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.270888  4116 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.338563  1610 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:54.232151  4101 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.308079  2342 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:54.310014  3973 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:54.311744  4118 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:54.313407  4069 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:54.342172  1570 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
W20260709 12:57:54.302770  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 49130.9us
W20260709 12:57:54.345180  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 63965.7us
I20260709 12:57:54.361480  1535 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.328060  4131 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.280398  4129 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.348032  1572 raft_consensus.cc:2410] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:57:54.337911  4116 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:54.349694  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.350716  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.351665  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.353035  2347 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:54.353739  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.297608  4072 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.365051  1713 raft_consensus.cc:2393] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:54.363288  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.362522  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.378460  4152 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.348129  3797 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:54.345928  3765 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:57:54.357846  4118 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:54.406327  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 43876.9us
I20260709 12:57:54.412962  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.414063  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.415022  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:54.410466  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 47273.8us
I20260709 12:57:54.395592  4099 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:57:54.399281  4129 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.416194  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.357842  4100 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.417745  4131 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:54.418004  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.420975  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.421465  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.407295  4072 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:54.422567  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.423053  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.412173  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.424114  3634 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:54.409016  2349 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
W20260709 12:57:54.402536  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 124194us
I20260709 12:57:54.424573  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.425175  4110 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:54.426223  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.428449  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:54.429296  4142 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:57:54.430399  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.432394  4101 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:54.432281  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 156928us
I20260709 12:57:54.483006  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:54.484902  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 59664.5us
I20260709 12:57:54.435856  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.485802  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.437292  1567 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:54.437527  3441 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:54.438828  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:54.398895  3868 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:54.440399  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.401289  4116 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.452903  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.454597  1572 raft_consensus.cc:2376] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6. Re-sending same reply.
W20260709 12:57:54.500686  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 47835.3us
I20260709 12:57:54.500835  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.416823  3685 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:54.457023  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.462348  1568 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:54.422035  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.461458  1565 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:54.409509  4069 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:54.407238  3797 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:54.415138  4118 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:54.465528  1571 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:54.423846  2344 raft_consensus.cc:2368] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8.
I20260709 12:57:54.413937  3894 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:54.438265  4068 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:54.465082  2312 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:54.519389  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 54393.8us
I20260709 12:57:54.465735  3882 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:57:54.477722  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.480796  1647 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:54.481510  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.522876  1569 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:54.523778  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:54.524559  4084 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:54.524993  4084 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.525415  4084 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.486354  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.494465  1642 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:54.457777  4111 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:54.527300  1570 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:57:54.487471  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 149444us
I20260709 12:57:54.527889  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:54.467677  4072 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.501505  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.463886  4095 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:54.482722  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:54.527314  4111 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.529809  3868 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:54.530776  4111 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:54.531661  4095 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:54.531993  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.508494  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.509057  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.532832  3868 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:54.482180  3634 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:54.533370  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:54.533852  3634 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:54.534309  4111 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:54.488445  2343 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:54.407066  4152 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.499817  4101 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:54.535181  4152 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.535363  4101 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.487434  3965 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:54.532938  1565 raft_consensus.cc:2376] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5. Re-sending same reply.
I20260709 12:57:54.528060  4114 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:54.532929  4125 raft_consensus.cc:3055] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:54.537648  4114 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:54.537803  4125 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:54.538713  4114 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.514904  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.540723  1571 raft_consensus.cc:2410] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:57:54.540877  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.538779  4125 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.534431  2340 raft_consensus.cc:2410] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:57:54.541797  4125 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.542587  4101 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:54.547371  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.547629  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.528110  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:54.517030  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 236766us
I20260709 12:57:54.506232  4122 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:54.505205  4069 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.562187  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.553442  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.554204  1568 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:54.555855  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.564224  1719 raft_consensus.cc:2410] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:54.558439  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.509985  3797 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:54.604965  1686 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.568819  1715 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:54.521056  4068 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:54.614039  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 72681us
I20260709 12:57:54.615765  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.629374  1712 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:54.615970  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.619274  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.630242  1570 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.631007  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:54.606060  1717 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:54.625787  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.629570  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.631922  1571 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:54.553076  3863 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:54.641485  1684 leader_election.cc:400] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8.
I20260709 12:57:54.641909  1684 leader_election.cc:403] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:54.633657  3868 consensus_queue.cc:1243] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer c05ea12435084ad9b281ed3a0a2ecebe log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:57:54.515118  4074 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.645113  1641 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:54.567070  4069 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.564924  4135 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:54.651968  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.560956  4159 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:54.601531  3973 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:54.652778  1645 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:54.673138  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.633725  4068 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.689631  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:54.690287  1714 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:54.687443  1713 raft_consensus.cc:2410] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:54.521296  3894 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:54.688347  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.633826  4158 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:54.635617  4101 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:54.695528  2348 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:54.639526  3965 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:54.603499  4084 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.653420  4149 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:54.627321  3833 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.705006  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.716250  1713 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:54.669451  4159 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:54.639966  3814 consensus_queue.cc:1059] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:57:54.692930  4135 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:54.734611  1720 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:54.734650  1570 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:57:54.735678  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.735834  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:54.736340  1569 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:54.736779  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.737291  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.737903  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.738497  1570 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:54.741176  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.741833  1570 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.742837  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.743168  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.744288  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.744375  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:54.744871  1568 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:54.721045  3973 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:54.750613  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.752663  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:54.751629  3833 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:54.724962  4159 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:54.753290  1713 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:54.731642  4149 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:54.754123  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:54.754189  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.753206  1565 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:54.758610  1570 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:54.758670  1714 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:57:54.776837  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.777578  1714 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:54.734063  3882 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:54.741824  4100 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:54.781365  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 156477us
W20260709 12:57:54.780463  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 294720us
I20260709 12:57:54.782536  1686 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.794229  1568 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:54.782778  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.795789  3973 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:54.796715  1686 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.797449  3973 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:54.798213  1686 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.798825  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:54.799340  1686 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.799751  1719 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:54.800100  3833 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:54.800709  1686 leader_election.cc:400] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 8.
I20260709 12:57:54.801560  1686 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.802021  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.802692  1686 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.803892  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.804486  3833 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:54.804626  4147 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:54.805059  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.805195  3833 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:54.805806  4147 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:54.806218  1686 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.806910  4147 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:54.810379  1720 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:54.811583  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.812420  3833 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:54.812953  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:54.813658  3833 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:54.814217  3833 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:54.815925  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:54.821754  4147 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:54.822221  4147 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.822623  4147 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:54.816354  4101 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:57:54.826174  4101 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:54.779729  4160 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:54.836506  2312 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:54.840921  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:54.841675  1714 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:54.779101  3685 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:57:54.864235  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 81509.6us
I20260709 12:57:54.850255  4157 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:54.784722  3882 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.905565  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:54.905670  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 261774us
I20260709 12:57:54.832238  3833 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:57:54.930919  1571 raft_consensus.cc:2410] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:57:54.838311  4175 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:54.932992  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:54.851361  4153 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:57:54.934288  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.937463  1714 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:57:54.939013  1715 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:57:54.946482  1713 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:54.943693  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:54.955556  2314 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:54.959479  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:54.959790  4172 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.959636  3685 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:54.885557  4149 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.905218  4110 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:54.977888  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.845060  4135 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:54.991622  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:54.952500  3975 consensus_meta.cc:287] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.004s
W20260709 12:57:54.953229  4087 consensus_meta.cc:287] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.644s	user 0.005s	sys 0.008s
I20260709 12:57:55.001574  1564 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:55.002326  1644 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:55.003305  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:54.964885  3894 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:54.985018  1640 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:54.968622  4122 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.994906  4173 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:57:54.994236  4165 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:57:54.978858  3973 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:54.978724  4157 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:54.982069  4074 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.034256  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:55.077920  3882 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.078179  4157 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:55.079341  4171 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.079846  4171 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:55.081059  4140 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:57:55.017354  4122 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:55.010959  4175 consensus_queue.cc:1059] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:57:55.082422  4144 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:55.047807  4168 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:57:55.035039  3958 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.866s	user 0.008s	sys 0.003s
W20260709 12:57:55.090965  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 145613us
I20260709 12:57:55.005713  3975 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:55.067261  4152 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.006s
I20260709 12:57:55.009970  4087 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.145426  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:55.153113  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:55.153844  1644 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:55.054227  4173 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:55.156291  4087 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:55.157094  1717 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:55.150440  4152 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.159047  1572 raft_consensus.cc:2368] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:57:55.188921  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:54.990389  4172 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:55.147133  4097 consensus_meta.cc:287] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.813s	user 0.008s	sys 0.001s
I20260709 12:57:55.033088  3634 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:55.202694  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 385374us
I20260709 12:57:55.127112  3958 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.057658  4158 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.128s
I20260709 12:57:55.215533  4175 raft_consensus.cc:3055] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:57:55.257110  4141 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:57:55.259527  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 52284.9us
I20260709 12:57:55.204470  3975 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.261518  4175 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:55.268098  4175 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.269498  4175 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:55.269701  4072 consensus_meta.cc:287] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.002s
I20260709 12:57:55.270118  4072 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.204849  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:57:55.263897  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 171716us
W20260709 12:57:55.195096  3797 consensus_meta.cc:287] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.002s
I20260709 12:57:55.265612  1686 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:55.157048  4173 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:55.304309  1686 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:55.312167  4152 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.312330  4182 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:55.313532  4182 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:55.313829  4072 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.313961  4182 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.314461  4182 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:55.297641  4125 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.006s
W20260709 12:57:55.317682  4118 consensus_meta.cc:287] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.000s
I20260709 12:57:55.318109  4118 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.320145  4118 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.253773  3634 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:55.321246  1686 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:55.321529  1718 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:55.322868  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:55.324244  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:55.259654  4179 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:57:55.325652  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:55.345816  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 311327us
W20260709 12:57:55.410941  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 85349.7us
I20260709 12:57:55.411630  1642 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:57:55.413013  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 78332.9us
I20260709 12:57:55.414754  1565 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:55.416951  3975 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:55.418634  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:55.416976  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:55.411705  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:55.292171  4129 consensus_meta.cc:287] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.000s
I20260709 12:57:55.420720  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:55.427855  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:55.266702  4084 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:55.434672  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:55.277590  4153 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8.
W20260709 12:57:55.411705  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 86670.2us
I20260709 12:57:55.279150  4172 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.215655  4097 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.510277  1643 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:57:55.510848  1643 pending_rounds.cc:85] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 2
I20260709 12:57:55.510996  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:55.410575  4087 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:55.410735  4125 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:55.418408  4144 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:55.433593  4129 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.520310  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:55.428797  3965 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:55.522794  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:55.204741  4110 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.524537  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:55.534727  1568 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:55.542146  1565 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:55.511147  1643 pending_rounds.cc:107] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:55.542685  1643 raft_consensus.cc:2889] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:55.507965  4114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.022s	sys 0.048s
I20260709 12:57:55.445395  3958 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:55.546746  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1459) took 1095 ms. Trace:
I20260709 12:57:55.339022  3797 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:55.525883  4116 consensus_meta.cc:287] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.011s	user 0.008s	sys 0.003s
I20260709 12:57:55.546162  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:55.524637  4084 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:55.538553  4069 consensus_meta.cc:287] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.848s	user 0.011s	sys 0.000s
I20260709 12:57:55.551565  1563 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:55.546954  2340 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:57:55.562929  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 148769us
I20260709 12:57:55.550813  3894 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:55.582719  4084 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.540062  3965 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:55.548571  1639 rpcz_store.cc:276] 0709 12:57:54.451283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.497624 (+ 46341us) service_pool.cc:224] Handling call
0709 12:57:54.497959 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:54.788069 (+290110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:54.788112 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:54.788726 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:57:54.951743 (+163017us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:54.951933 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:54.952272 (+   339us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.546449 (+594177us) raft_consensus.cc:1685] finished
0709 12:57:55.546476 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:55.546667 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":191687,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":8065,"thread_start_us":451607,"threads_started":2,"wal-append.queue_time_us":334992}
W20260709 12:57:55.549414  4114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.023s	sys 0.049s
I20260709 12:57:55.593842  1647 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:55.599108  1568 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
W20260709 12:57:55.601655  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 300602us
I20260709 12:57:55.609975  1565 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
W20260709 12:57:55.653158  4068 consensus_meta.cc:287] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.951s	user 0.006s	sys 0.005s
I20260709 12:57:55.658499  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:55.621578  3965 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:55.659679  4176 consensus_queue.cc:1059] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.229s
I20260709 12:57:55.659839  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:55.661314  4174 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:55.661945  4174 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:55.657702  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:55.587785  4069 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.610718  4169 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:55.670243  1568 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:55.671852  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:55.691828  1713 raft_consensus.cc:2393] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:55.693161  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:55.694132  1713 raft_consensus.cc:2368] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:57:55.672794  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:55.696826  1714 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:57:55.674388  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:55.699136  1719 raft_consensus.cc:2376] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4. Re-sending same reply.
I20260709 12:57:55.656942  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:55.654505  4147 consensus_meta.cc:287] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.830s	user 0.006s	sys 0.007s
I20260709 12:57:55.703078  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:55.655498  3894 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.716950  1646 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:55.716867  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:55.714742  1612 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.562s (SENT)
I20260709 12:57:55.717760  1565 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:55.610217  4116 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.709220  1686 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:55.729072  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:55.719867  1612 connection.cc:256] RPC call timeout handler was delayed by -2.6406708069999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
I20260709 12:57:55.721717  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:55.733183  1713 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:55.734467  1719 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:55.652863  4182 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.712795  3765 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.669661  4068 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.713581  4169 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:55.747062  3765 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:55.773231  4116 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.774521  4182 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:55.777437  1569 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:57:55.778065  4159 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.980s	user 0.008s	sys 0.004s
I20260709 12:57:55.778147  4129 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.662781  4174 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.752691  2340 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:57:55.753664  4200 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.755326  4069 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.755729  3802 raft_consensus.cc:3055] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:55.756552  2344 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:57:55.715466  4147 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.749395  3797 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:55.778662  4159 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.779004  1639 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:57:55.847271  1571 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:55.826628  4195 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:57:55.725008  3894 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.843532  1565 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:55.757193  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:55.803746  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:57:55.801656  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 290731us
I20260709 12:57:55.738364  3958 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:55.734123  4114 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:55.796314  1647 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:55.865972  1642 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:55.847595  1713 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:55.870458  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:55.863461  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:55.880448  1684 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:55.804710  4097 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:55.865450  4198 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:57:55.857234  2344 pending_rounds.cc:85] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Aborting all ops after (but not including) 6
I20260709 12:57:55.861531  4200 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:55.876909  3894 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:55.919689  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:55.885322  4155 log.cc:927] Time spent T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 1.251s	user 0.004s	sys 0.003s
I20260709 12:57:55.906836  3965 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:55.849713  4084 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:55.852967  3802 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:55.885232  4147 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:56.000671  1642 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
W20260709 12:57:56.096819  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 364731us
W20260709 12:57:56.097625  1612 connection.cc:256] RPC call timeout handler was delayed by -2.6236353229999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 12:57:56.098285  1612 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.811s (SENT) [suppressed 24 similar messages]
I20260709 12:57:55.885429  3797 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:56.092898  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 212134us
I20260709 12:57:55.919191  1684 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:56.112169  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 193096us
I20260709 12:57:55.921613  2344 pending_rounds.cc:107] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:57:55.904383  3958 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:56.108083  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:56.108815  1612 connection.cc:256] RPC call timeout handler was delayed by -2.6136708069999486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260709 12:57:55.928447  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:56.111153  1571 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:56.115751  1571 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:56.115094  1640 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:55.991386  4200 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:55.974395  4087 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:56.122332  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:56.123831  3894 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:56.124066  4160 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:57:56.120992  1612 connection.cc:256] RPC call timeout handler was delayed by -2.4903708069999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 12:57:56.124434  3894 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:56.124817  1612 connection.cc:256] RPC call timeout handler was delayed by -2.293270806999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 12:57:56.124622  4160 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.127388  4160 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:56.127995  1567 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:57:56.128049  1612 connection.cc:256] RPC call timeout handler was delayed by -2.2338708069999598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2275s for a response
W20260709 12:57:56.128885  1612 connection.cc:256] RPC call timeout handler was delayed by -2.0579608829999643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
I20260709 12:57:55.968341  4125 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.126762  3894 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:56.129885  4125 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.133426  4125 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.114190  2344 raft_consensus.cc:2889] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:55.919210  4169 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.142692  4129 raft_consensus.cc:1064] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
W20260709 12:57:56.129317  1612 connection.cc:256] RPC call timeout handler was delayed by -2.03784017199996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23540000000000003s for a response
I20260709 12:57:56.122334  4184 consensus_queue.cc:1059] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:57:56.145289  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4104923809999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
I20260709 12:57:56.145726  3894 raft_consensus.cc:3055] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:57:56.145814  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3518708069999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3255s for a response
I20260709 12:57:56.146256  3894 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:57:56.146438  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3081824870000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 12:57:56.146994  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2181824869999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 12:57:56.147202  3894 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.149744  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.129251  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:56.151698  1643 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:55.907737  4114 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:56.158229  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:55.931707  4190 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.189s
I20260709 12:57:56.159173  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:56.118021  4084 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:56.160348  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.163218  1570 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:56.164793  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1522) took 1934 ms. Trace:
I20260709 12:57:56.118429  1571 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.167057  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.168569  1571 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:57:56.170094  2348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 365) took 1817 ms (client timeout 1952 ms). Trace:
W20260709 12:57:56.170588  2348 rpcz_store.cc:269] 0709 12:57:54.352664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.353430 (+   766us) service_pool.cc:224] Handling call
0709 12:57:56.169872 (+1816442us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54004781d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:56.170025 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671062272}
I20260709 12:57:56.165228  1638 rpcz_store.cc:276] 0709 12:57:54.230555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.230724 (+   169us) service_pool.cc:224] Handling call
0709 12:57:54.243855 (+ 13131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:54.244191 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:54.244218 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:54.259247 (+ 15029us) log.cc:844] Serialized 26 byte log entry
0709 12:57:54.406814 (+147567us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:54.406891 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:54.407271 (+   380us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.884754 (+1477483us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:56.160992 (+276238us) raft_consensus.cc:1685] finished
0709 12:57:56.161017 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:56.164719 (+  3702us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6516,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":15886,"spinlock_wait_cycles":13252992,"thread_start_us":131166,"threads_started":1,"wal-append.queue_time_us":243403}
I20260709 12:57:56.148578  3894 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:56.150243  4097 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:56.196072  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:56.165691  4084 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.165856  4167 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.199805  4167 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.201720  4171 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:56.202196  4167 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:56.114645  3797 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.158502  3441 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:57:56.224694  4180 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.225299  4180 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.225687  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.226145  3765 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.228111  4180 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.229085  1714 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:56.229440  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:56.230114  1719 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:56.230165  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:56.230888  1714 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:56.231176  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:56.231789  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:56.234650  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:56.235261  1715 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:56.231806  1719 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:57:56.239275  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1456) took 1578 ms. Trace:
I20260709 12:57:56.185897  3802 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.239686  1717 rpcz_store.cc:276] 0709 12:57:54.661091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.801746 (+140655us) service_pool.cc:224] Handling call
0709 12:57:56.238992 (+1437246us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54001068d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:56.239206 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814705536}
I20260709 12:57:56.240386  3802 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:56.162336  3685 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:57:56.248243  4159 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:56.198227  4097 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.188207  4116 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:57:56.205864  4084 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:56.256856  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 138203us
I20260709 12:57:56.258751  1571 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:57:56.260702  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.260885  1684 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:56.246505  4114 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.218137  3958 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.262573  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.437542  1571 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
W20260709 12:57:56.437405  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 211787us
I20260709 12:57:56.358956  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1452) took 1801 ms. Trace:
I20260709 12:57:56.395749  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1514) took 1663 ms. Trace:
W20260709 12:57:56.437803  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 176988us
I20260709 12:57:56.439267  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:56.440047  1718 rpcz_store.cc:276] 0709 12:57:54.557556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.557762 (+   206us) service_pool.cc:224] Handling call
0709 12:57:56.358737 (+1800975us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400301454. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:56.358885 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744251136}
I20260709 12:57:56.447842  1571 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:56.440919  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.454478  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.440244  1569 rpcz_store.cc:276] 0709 12:57:54.733833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.753865 (+ 20032us) service_pool.cc:224] Handling call
0709 12:57:56.395461 (+1641596us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400113354. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:56.395666 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307101952}
I20260709 12:57:56.353281  1719 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:57:56.465976  1719 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:56.356483  1717 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:57:56.262667  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:56.483560  1714 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:57:56.463430  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:56.486655  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:56.485567  1569 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:56.484717  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:56.489720  1719 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
W20260709 12:57:56.345116  4229 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 12:57:56.361491  4111 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:57:56.492587  1572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1737) took 2073 ms (client timeout 2102 ms). Trace:
I20260709 12:57:56.496193  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:56.492089  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:56.497254  1572 rpcz_store.cc:269] 0709 12:57:54.419424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.500541 (+ 81117us) service_pool.cc:224] Handling call
0709 12:57:56.492397 (+1991856us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54001a8954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:56.492527 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512021248}
I20260709 12:57:56.497654  2348 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:56.498008  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:56.498584  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.343406  4122 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.271371  4147 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:56.499200  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:56.285143  4199 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:56.485652  3965 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:56.489305  4095 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:56.359529  4087 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:56.350553  3797 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.359292  3973 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:56.485594  4178 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.507084  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:56.499680  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.513068  1535 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:56.525413  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:56.505211  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:56.516355  1639 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:57:56.491950  4169 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:56.500007  3685 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:56.262404  3441 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.247s
I20260709 12:57:56.528142  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:56.531853  1572 raft_consensus.cc:2410] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:57:56.256882  4129 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.521514  3765 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:56.528734  4162 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:56.521700  4174 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:56.536716  4172 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:56.517860  4122 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:57:56.528896  4121 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:56.531294  4199 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:56.532449  3797 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:56.529785  4097 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:56.529799  3973 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.534739  3441 consensus_queue.cc:1243] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer 2af567a273d44ca89d2b3b0f7c815bd1 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:57:56.603099  3685 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:56.534540  4169 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.628835  3685 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.630722  4169 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:56.630975  3685 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.588588  4230 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:56.632397  4230 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.632843  4230 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:56.529695  4178 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.633699  4160 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.634248  4160 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.634620  4178 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.635591  1571 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:56.636603  4160 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:56.637940  1571 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:56.614089  4174 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.525146  4087 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.536976  4232 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:56.600004  3765 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:56.609633  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:56.612658  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:56.641330  4087 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:56.641567  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1531) took 1705 ms (client timeout 1799 ms). Trace:
I20260709 12:57:56.518999  4095 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:56.641956  1647 rpcz_store.cc:269] 0709 12:57:54.936274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.936425 (+   151us) service_pool.cc:224] Handling call
0709 12:57:56.641405 (+1704980us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54001d38d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:56.641500 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415840512}
I20260709 12:57:56.643819  4095 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.634716  1716 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:57:56.636626  1644 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:56.647394  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.659382  1716 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:57:56.663920  1714 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:56.662967  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:56.645941  4121 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:56.670871  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.615948  4199 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:56.668776  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:56.679172  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.615473  4172 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.645005  4208 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:57:56.682574  2314 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:56.660663  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:56.680373  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 173409us
I20260709 12:57:56.688560  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:56.690577  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:56.675915  4190 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:56.692698  1612 leader_election.cc:400] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:57:56.681830  4199 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:56.681386  4167 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:56.714885  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:56.681268  4171 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:57:56.691710  3802 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:56.726428  4084 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.733134  4191 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:56.688344  4052 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:56.737676  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:56.722136  3894 consensus_meta.cc:287] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 12:57:56.747411  1565 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:56.799991  1569 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:56.743691  3765 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.694840  4239 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:57:56.807793  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 125292us
I20260709 12:57:56.809816  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 299) took 1049 ms. Trace:
I20260709 12:57:56.810204  1565 rpcz_store.cc:276] 0709 12:57:55.759953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.872719 (+112766us) service_pool.cc:224] Handling call
0709 12:57:56.747013 (+874294us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a4770dfc0 00007f6a476f8929 00007f6a476f83d2 00007f6a40c6fbd4
0709 12:57:56.747226 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:56.809479 (+ 62253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:56.809757 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230856960}
I20260709 12:57:56.811961  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.745905  3797 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:56.745814  4172 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:56.748862  3802 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.752842  4234 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:56.749601  4052 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.739042  4174 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:56.759858  4087 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.814845  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.813748  4191 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:56.806916  4232 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.745298  4184 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:57:56.752995  3685 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:57:56.830263  1612 leader_election.cc:400] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:57:56.848213  1612 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:56.816327  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:56.744458  4121 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:56.814638  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 166018us
I20260709 12:57:56.828843  4052 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:56.841967  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:56.854307  1642 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:57:56.849874  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.830770  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.856211  1565 raft_consensus.cc:2376] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6. Re-sending same reply.
I20260709 12:57:56.824961  3802 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:56.857223  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:56.860598  1565 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:56.855815  1569 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:56.861656  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:56.862159  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.863384  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.836208  4241 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:56.865943  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.868855  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.866158  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.870013  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:56.870486  1569 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:56.826144  4173 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:57:56.802314  4230 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.872815  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:56.836570  4190 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:57:56.882750  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:56.835757  4087 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.864609  4239 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:56.864687  4172 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:56.886839  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:56.864516  3797 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:56.897187  2348 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:56.898546  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:56.907181  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:56.907879  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1474) took 1159 ms. Trace:
I20260709 12:57:56.908179  1713 rpcz_store.cc:276] 0709 12:57:55.748098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.906923 (+1158825us) service_pool.cc:224] Handling call
0709 12:57:56.907823 (+   900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:56.908741  4234 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:56.909175  4234 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:56.910292  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:56.910786  4192 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:56.880002  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:56.911458  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:56.911525  4191 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:56.913931  3973 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:57:56.902928  4186 log.cc:927] Time spent T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.641s	user 0.000s	sys 0.011s
I20260709 12:57:56.912520  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:56.924302  1569 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:56.853365  4248 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:57:56.932273  4244 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:57:56.933221  4246 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:57:56.958254  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 138297us
I20260709 12:57:56.876168  3685 consensus_queue.cc:1059] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:57:56.936898  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:56.938133  4247 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:57:56.940959  1644 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:56.950181  1569 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:56.965134  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:56.965739  1647 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:56.951026  1638 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:56.910178  4234 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:56.922327  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.847153  4232 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:56.934113  4242 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 12:57:56.959657  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:56.957294  4192 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:56.974912  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:56.977841  1647 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:56.980022  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 57760us
I20260709 12:57:56.979399  4234 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:56.965378  4184 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:56.976063  4241 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:56.979298  3685 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:56.988780  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1452) took 2560 ms. Trace:
I20260709 12:57:56.976677  3863 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.982224  4084 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:56.992515  1646 rpcz_store.cc:276] 0709 12:57:54.425697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.425894 (+   197us) service_pool.cc:224] Handling call
0709 12:57:56.985993 (+2560099us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400298e54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:56.986133 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2843496320}
I20260709 12:57:56.981397  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:56.985467  4192 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:56.994993  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:56.991743  4159 consensus_queue.cc:1059] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:57:57.011631  1647 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:57:57.012741  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.012990  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1463) took 2263 ms. Trace:
I20260709 12:57:57.013949  1647 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:57.015204  1647 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:57.019626  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.013392  1720 rpcz_store.cc:276] 0709 12:57:54.733133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.811221 (+ 78088us) service_pool.cc:224] Handling call
0709 12:57:54.811554 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:54.811929 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:54.811967 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:54.812523 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:57:55.012351 (+199828us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:55.012388 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:55.012448 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:56.902278 (+1889830us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:57:56.993769 (+ 91491us) raft_consensus.cc:1685] finished
0709 12:57:56.993788 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:56.996828 (+  3040us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":366,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":8021376,"thread_start_us":60005,"threads_started":1,"wal-append.queue_time_us":317068}
I20260709 12:57:57.024405  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:56.986421  4097 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:57:56.995339  3863 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:57.010313  2344 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:57:57.058734  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:57.023131  3894 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:57.097348  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:57.098278  4099 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:57.098318  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:57.098951  4099 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:57.099083  4172 raft_consensus.cc:3055] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:57.099507  4099 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:57.100407  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1877) took 1373 ms. Trace:
I20260709 12:57:57.099534  4192 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.100934  1719 rpcz_store.cc:276] 0709 12:57:55.727483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.474541 (+747058us) service_pool.cc:224] Handling call
0709 12:57:56.474895 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:56.495369 (+ 20474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.100102 (+604733us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b54002c38d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:57.100334 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28744960}
I20260709 12:57:57.102275  4069 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:57.100036  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:57.103266  4069 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:57.104414  4172 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:57:57.107612  1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1528) took 2175 ms (client timeout 2066 ms). Trace:
I20260709 12:57:57.105983  4172 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.111788  4172 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:57.112912  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.079057  1610 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:57:57.108057  1641 rpcz_store.cc:269] 0709 12:57:54.932505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.932683 (+   178us) service_pool.cc:224] Handling call
0709 12:57:57.107365 (+2174682us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b5400290254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:57.107523 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689572736}
I20260709 12:57:57.109310  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:56.992565  4184 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:57.134502  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.138399  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1878) took 1410 ms. Trace:
I20260709 12:57:57.143982  3685 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:57.145531  2343 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:57.031337  4178 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:57.034373  4241 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.078001  3797 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:57.086037  3634 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:57.097534  3894 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.179466  1564 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:57.138914  1717 rpcz_store.cc:276] 0709 12:57:55.727781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.476367 (+748586us) service_pool.cc:224] Handling call
0709 12:57:56.493322 (+ 16955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:56.493576 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:56.512043 (+ 18467us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.106707 (+594664us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b1800312460. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d423a
0709 12:57:57.137996 (+ 31289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.138056 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:57.138118 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.138211 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.138332 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40254,"prepare.queue_time_us":35325,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":25272704,"thread_start_us":75480,"threads_started":1,"wal-append.queue_time_us":125444}
I20260709 12:57:57.047497  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:57.061426  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:57.118944  4121 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:57:57.183028  1563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1727) took 2762 ms (client timeout 1613 ms). Trace:
I20260709 12:57:57.187398  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:57.187527  1563 rpcz_store.cc:269] 0709 12:57:54.417027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.422337 (+  5310us) service_pool.cc:224] Handling call
0709 12:57:57.178999 (+2756662us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400134554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:57.179206 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497573248}
I20260709 12:57:57.188083  1717 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:57:57.027894  4199 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:57.056388  4052 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:57.145588  3685 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.234835  1686 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:57.236270  3958 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:57.198015  3797 raft_consensus.cc:2764] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:57:57.205650  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:57.206349  4184 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:57.241278  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:57.179862  3634 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:57.242529  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:57.242738  3634 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.243738  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:57.210645  4172 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:57.244987  4172 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.213382  3973 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:57.215583  3863 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:57.178697  4178 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.216272  1639 raft_consensus.cc:1240] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:57.152006  4097 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:57:57.195308  4121 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.218140  2344 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:57:57.219190  4052 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:57.223877  4260 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:57:57.225183  4169 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:57.179548  4241 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:57.226622  4232 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:57.227393  4230 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:57.229326  3894 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:57.244252  3634 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:57.253886  1686 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:57:57.321605  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 67825.3us
I20260709 12:57:57.240203  4199 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:57.258626  1638 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:57:57.323601  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:57.244303  1563 raft_consensus.cc:2376] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6. Re-sending same reply.
I20260709 12:57:57.262925  4178 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:57.263439  3973 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:57.313787  1537 connection.cc:256] RPC call timeout handler was delayed by -1.1384020870000313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 12:57:57.325343  1570 raft_consensus.cc:2410] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:57:57.330806  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:57.331887  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.204519  3802 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:57.340396  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:57.341455  1563 raft_consensus.cc:2410] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:57.342406  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:57.343032  1563 raft_consensus.cc:2376] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7. Re-sending same reply.
I20260709 12:57:57.344048  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:57.344200  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.344470  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:57.332631  1537 connection.cc:256] RPC call timeout handler was delayed by -1.0610020870000199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 12:57:57.346164  1537 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:57.346432  1721 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:57.347096  4178 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:57.348737  1537 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:57.349526  4178 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:57.350127  4178 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:57.350556  4178 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:57.350648  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:57.345142  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:57.354164  1714 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:57:57.356820  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:57.358170  4245 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.531s	user 0.000s	sys 0.003s
W20260709 12:57:57.359138  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58424 (request call id 230) took 18044 ms (client timeout 15000 ms). Trace:
W20260709 12:57:57.363615  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:57.363960  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.364725  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:57.365491  1572 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:57.366315  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:57.366731  4069 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:57.367374  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:57.368633  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:57.368245  4069 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.370060  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.370633  1571 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:57.378612  4199 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:57.379384  4199 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:57.384593  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.406212  1566 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:57:57.406929  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 300) took 1550 ms. Trace:
I20260709 12:57:57.407282  1566 rpcz_store.cc:276] 0709 12:57:55.856376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.965620 (+109244us) service_pool.cc:224] Handling call
0709 12:57:57.391932 (+1426312us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a4770dfc0 00007f6a476f8929 00007f6a476f83d2 00007f6a40c6fbd4
0709 12:57:57.392168 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.406698 (+ 14530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.406874 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230726400}
I20260709 12:57:57.359836  1721 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
W20260709 12:57:57.406240  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 57595.9us
I20260709 12:57:57.410494  1537 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:57.414731  1537 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:57.412671  1563 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:57.411108  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.416368  1646 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:57.330370  4147 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:57.422384  4269 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:57.436342  1641 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:57.423101  1569 pending_rounds.cc:85] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 6
I20260709 12:57:57.436934  1569 pending_rounds.cc:107] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:57:57.436990  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:57.422945  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:57.433161  4122 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:57.434417  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:57.435199  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:57.437209  1569 raft_consensus.cc:2889] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:57.424183  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1525) took 3161 ms. Trace:
I20260709 12:57:57.428032  1572 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:57.428967  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:57.438196  2349 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:57.492971  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.432060  3863 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:57.482906  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 45990.1us
I20260709 12:57:57.443491  1645 rpcz_store.cc:276] 0709 12:57:54.249037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.249277 (+   240us) service_pool.cc:224] Handling call
0709 12:57:54.651237 (+401960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:54.689694 (+ 38457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.409814 (+2720120us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400096ad0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:57.409945 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923531520}
I20260709 12:57:57.496716  1644 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:57:57.483662  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 45778.4us
W20260709 12:57:57.361579  1469 rpcz_store.cc:269] 0709 12:57:39.314503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:39.346125 (+ 31622us) service_pool.cc:224] Handling call
0709 12:57:57.359000 (+18012875us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:50.998599 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:50.999305 (+   706us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:50.999359 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:57:50.999381 (+    22us) tablet.cc:662] Decoding operations
0709 12:57:51.000903 (+  1522us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:51.000981 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:51.001013 (+    32us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:57:51.002303 (+  1290us) tablet.cc:701] Row locks acquired
0709 12:57:51.002353 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:57:51.002531 (+   178us) write_op.cc:270] Start()
0709 12:57:51.002673 (+   142us) write_op.cc:276] Timestamp: P: 1783601871002453 usec, L: 0
0709 12:57:51.002699 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:57:51.003453 (+   754us) log.cc:844] Serialized 5614 byte log entry
0709 12:57:52.948723 (+1945270us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b540038a0a8. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a48af09e1 00007f6a48aef64c 00007f6a4616b3bb 00007f6a4616d71a 00007f6a4616d6a8 00007f6a4616d628 00007f6a4616d5e3 00007f6a4616c7fc 00007f6a4859f626 00007f6a48599dd8 00007f6a42740310
0709 12:57:52.949095 (+   372us) op_driver.cc:464] REPLICATION: finished
0709 12:57:53.450768 (+501673us) write_op.cc:301] APPLY: starting
0709 12:57:53.450882 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:53.451239 (+   357us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:53.451285 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:53.528694 (+ 77409us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:53.529127 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:57:53.529184 (+    57us) write_op.cc:312] APPLY: finished
0709 12:57:53.529615 (+   431us) log.cc:844] Serialized 101 byte log entry
0709 12:57:53.652173 (+122558us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:53.662404 (+ 10231us) write_op.cc:454] Released schema lock
0709 12:57:53.672192 (+  9788us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:53.686982 (+ 14790us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:53.718643 (+ 31661us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5451215,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":501288,"apply.run_cpu_time_us":28122,"apply.run_wall_time_us":221895,"num_ops":14,"prepare.queue_time_us":540565,"prepare.run_cpu_time_us":35128,"prepare.run_wall_time_us":218517,"raft.queue_time_us":337245,"raft.run_cpu_time_us":56683,"raft.run_wall_time_us":1407708,"replication_time_us":703813,"spinlock_wait_cycles":22958976,"thread_start_us":778882,"threads_started":5,"wal-append.queue_time_us":586657,"wal-append.run_cpu_time_us":19500,"wal-append.run_wall_time_us":2262946}]]}
I20260709 12:57:57.488746  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.497274  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.497622  1646 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:57.497879  1645 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 2.
I20260709 12:57:57.492974  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:57.487425  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.504918  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.505882  1720 raft_consensus.cc:2393] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:57.321799  4169 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.436414  4147 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.437325  3894 raft_consensus.cc:2764] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:57:57.442593  4072 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:57.521122  4072 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.523865  4072 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:57.413305  3958 consensus_queue.cc:1059] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:57:57.517954  1646 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:57:57.528343  1646 pending_rounds.cc:85] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 3
I20260709 12:57:57.528224  1716 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:57.528604  1646 pending_rounds.cc:107] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:57:57.528913  1646 raft_consensus.cc:2889] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:57.494185  4157 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:57.519699  1645 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:57.439308  4192 consensus_queue.cc:1059] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:57:57.556020  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1521) took 2119 ms. Trace:
I20260709 12:57:57.556797  1564 rpcz_store.cc:276] 0709 12:57:55.436605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.436762 (+   157us) service_pool.cc:224] Handling call
0709 12:57:57.179174 (+1742412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:57.180882 (+  1708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.555751 (+374869us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400134550. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:57.555937 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4006158208}
I20260709 12:57:57.564762  4087 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:57.566314  4087 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.567086  4087 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.577584  4159 raft_consensus.cc:3055] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:57.578303  4159 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:57.520169  1712 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:57:57.584888  1570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1740) took 1461 ms (client timeout 1911 ms). Trace:
W20260709 12:57:57.585692  1570 rpcz_store.cc:269] 0709 12:57:56.151114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.108858 (+957744us) service_pool.cc:224] Handling call
0709 12:57:57.584562 (+475704us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001a8454. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:57:57.584794 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472132480}
I20260709 12:57:57.515662  4147 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:57.484274  4122 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.593160  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.602469  1642 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:57:57.617185  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:57.618104  1642 raft_consensus.cc:2376] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6. Re-sending same reply.
I20260709 12:57:57.624082  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:57.624950  1642 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:57.628321  3802 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:57.603123  4157 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:57.629801  4157 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:57.631955  4169 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:57.610905  4162 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:57.632956  4162 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:57.633131  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:57.633853  4162 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.634965  4087 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:57.635429  4162 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:57.635489  4087 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:57.637836  3973 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:57.639554  4241 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:57.435578  4136 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:57.579747  4159 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.642824  4159 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:57.593549  4172 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:57.644273  4121 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:57.644709  4239 raft_consensus.cc:3055] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:57.645087  4239 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:57.645803  4239 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.646737  4239 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:57.653576  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.642119   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:57.646065  4068 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:57.665225  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 302) took 1532 ms. Trace:
I20260709 12:57:57.665767  1639 rpcz_store.cc:276] 0709 12:57:56.132811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.535707 (+402896us) service_pool.cc:224] Handling call
0709 12:57:56.599516 (+ 63809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.266444 (+666928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.664932 (+398488us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54002a85d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:57.665145 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417773824}
I20260709 12:57:57.665879  4135 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:57.667200  1721 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:57:57.653400  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:57.673466  4199 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:57.677372  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1472) took 1930 ms. Trace:
I20260709 12:57:57.677937  1718 rpcz_store.cc:276] 0709 12:57:55.747394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.546188 (+798794us) service_pool.cc:224] Handling call
0709 12:57:56.563387 (+ 17199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:56.645749 (+ 82362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:56.645870 (+   121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:56.645933 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:56.645986 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.677084 (+1031098us) spinlock_profiling.cc:243] Waited 82.1 ms on lock 0x7b54002df854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:57:57.677146 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.677300 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188738944}
I20260709 12:57:57.634625  4174 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:57.673208  4135 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:57:57.680598  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 352036us
I20260709 12:57:57.716770  1686 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:57.690027  4174 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.742478  1639 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:57.742949  1639 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:57.746997  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.749194  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.749886  1713 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:57.752007  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:57.752417  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:57.753162  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:57.755656  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.755839  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:57.729121  4169 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:57.782327  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:57.783584  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:57.731297  4122 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:57.787127  1714 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:57.788807  1721 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:57.788971  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.789676  1719 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:57:57.789875  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.790784  1717 raft_consensus.cc:2368] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:57:57.743702  4174 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:57.795940  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.755743  1639 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.797353  1639 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:57.795362  4093 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:57.801331  4093 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:57.793608  4169 raft_consensus.cc:697] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:57.805701  4169 consensus_queue.cc:237] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.809321  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:57.810096  2343 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:57.793601  1714 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:57.793952  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:57.813088  1686 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.595s (SENT)
W20260709 12:57:57.813990  1686 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.596s (SENT)
I20260709 12:57:57.813850  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:57.814960  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:57.813740  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:57.815395  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.822160  1643 raft_consensus.cc:2410] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:57.823040  1721 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: []
W20260709 12:57:57.815091  1686 leader_election.cc:336] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.659s (SENT)
I20260709 12:57:57.832932  1686 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:57.833367  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.837301  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.838246  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:57.839078  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 286364us
W20260709 12:57:57.815447  4063 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.005s	sys 0.010s
W20260709 12:57:57.842604  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.842869  1713 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
W20260709 12:57:57.843428  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:57.843828  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.839284  4286 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:57.844576  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.812803  4084 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:57.845597  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:57.818735  4093 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:57.871716  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:57.849371  1646 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:57.850659  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:57.875022  1712 raft_consensus.cc:2368] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:57:57.850875  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:57.854286  1719 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
W20260709 12:57:57.888079  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 73017.3us
I20260709 12:57:57.889475  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:57.886538  3973 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:57.844481  4063 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.010s
I20260709 12:57:57.894698  1612 leader_election.cc:400] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:57:57.839705  4287 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.899407  1612 leader_election.cc:403] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:57:57.914568  1639 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:57:57.849262  4277 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:57.916103  1639 pending_rounds.cc:85] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 2
I20260709 12:57:57.868755  4199 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:57.899355  4069 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:57.891606  4172 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:57.918637  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.015s	sys 0.026s
W20260709 12:57:57.935186  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.015s	sys 0.026s
I20260709 12:57:57.927901  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:57.929628  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.918780  1639 pending_rounds.cc:107] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:57:57.938859  1639 raft_consensus.cc:2889] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:57.915266  4192 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:57:57.918633  4277 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:57.909986  4241 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:57:57.848819  4286 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:57.888947  4084 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:57:57.971804  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:58.151489  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 55594.7us
W20260709 12:57:58.347047  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 404259us
I20260709 12:57:58.362226  1612 leader_election.cc:400] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:57:58.363281  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:57:57.952150  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:58.355976  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 1.27689e+06us
I20260709 12:57:58.145362  1642 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:57:58.368304  1642 pending_rounds.cc:85] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 2
I20260709 12:57:58.368697  1642 pending_rounds.cc:107] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:57:58.369050  1642 raft_consensus.cc:2889] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:58.009308  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.372887  4277 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:58.378517  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:58.379361  1640 raft_consensus.cc:2393] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:58.382275  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:57:57.954684  4282 log.cc:927] Time spent T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:57:57.957954  4099 consensus_meta.cc:287] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.858s	user 0.008s	sys 0.008s
W20260709 12:57:58.150862  4162 consensus_meta.cc:287] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.009s
W20260709 12:57:57.955304  4284 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:57:58.384532  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:58.391340  4097 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:57:58.177356  4290 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 12:57:58.185604  4178 consensus_meta.cc:287] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.002s
I20260709 12:57:58.378368  4087 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.387002  4291 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:58.387339  4095 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:57.933385  4287 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:58.391230  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:58.422397  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.392406  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:58.392668  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:57:58.186352  4274 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.360s	user 0.001s	sys 0.003s
I20260709 12:57:58.396270  1610 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:58.391625  4199 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:58.404222  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:58.429132  1641 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:57:58.404237  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:58.405313  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:58.430413  1644 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:57:58.381871  3973 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:58.406002  1638 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:58.412832  1647 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:57:58.441581  1647 pending_rounds.cc:85] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:57:58.441885  1647 pending_rounds.cc:107] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:57:58.442150  1647 raft_consensus.cc:2889] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:58.444315  4147 consensus_meta.cc:287] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.834s	user 0.007s	sys 0.002s
I20260709 12:57:58.415832  4178 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:58.432504  4239 consensus_meta.cc:287] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.785s	user 0.009s	sys 0.003s
I20260709 12:57:58.445717  1640 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:57:58.446327  4178 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:58.411008  3634 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.083s	user 0.008s	sys 0.008s
I20260709 12:57:58.381343  4052 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:57:58.428170  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.421918  4095 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:58.435385  4286 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.435082  4199 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.412698  4190 consensus_queue.cc:1059] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:57:58.449067  1645 raft_consensus.cc:2410] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:57:58.438318  4136 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.797s	user 0.014s	sys 0.000s
I20260709 12:57:58.421900  4087 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.441275  1721 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:57:58.440927  3973 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.465626  1713 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:58.465052  4287 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.473589  4286 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:58.477864  4286 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.479606  4199 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:58.478492  4174 consensus_meta.cc:287] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.003s
I20260709 12:57:58.427620  4241 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:58.398133  4099 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.423935  4291 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.484836  4116 raft_consensus.cc:3055] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:58.450251  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:58.498383  1720 raft_consensus.cc:606] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:58.498806  1720 raft_consensus.cc:614] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:58.425196  4097 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:57:58.493379  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 1.06442e+06us
I20260709 12:57:58.491240  4174 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.495602  4052 raft_consensus.cc:3055] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:58.495669  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 320) took 1080 ms. Trace:
I20260709 12:57:58.473717  4095 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.495431  4180 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:58.495947  3833 raft_consensus.cc:3055] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:58.479619  4087 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.500116  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:58.431766  4159 consensus_queue.cc:1059] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 12:57:58.515237  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 139002us
I20260709 12:57:58.523844  1715 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:58.494062  3765 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:58.513319  1572 rpcz_store.cc:276] 0709 12:57:57.415744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.512400 (+ 96656us) service_pool.cc:224] Handling call
0709 12:57:57.512693 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.512916 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:57:57.525772 (+ 12856us) log.cc:844] Serialized 14 byte log entry
0709 12:57:58.495329 (+969557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.495381 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:57:58.495436 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.495504 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.495614 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":969308,"prepare.queue_time_us":12910,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":980891}
I20260709 12:57:58.513140  4052 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:58.498037  4116 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:58.477026  4147 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.516492  3833 raft_consensus.cc:740] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:58.529428  3765 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.506637  3894 consensus_queue.cc:1059] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:57:58.574842  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1771) took 1781 ms. Trace:
W20260709 12:57:58.582131  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 82086.7us
I20260709 12:57:58.591157  1719 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:58.591272  1572 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:57:58.591634  1572 pending_rounds.cc:85] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 5
I20260709 12:57:58.591903  1572 pending_rounds.cc:107] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:57:58.592200  1572 raft_consensus.cc:2889] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:58.583449  1571 rpcz_store.cc:276] 0709 12:57:56.793441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.371538 (+578097us) service_pool.cc:224] Handling call
0709 12:57:57.371850 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.372094 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:57.372482 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 12:57:58.498306 (+1125824us) log.cc:844] Serialized 14 byte log entry
0709 12:57:58.574474 (+ 76168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.574530 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:58.574586 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.574654 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.574781 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1091514,"prepare.queue_time_us":203,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":57,"raft.queue_time_us":1054597,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":4576,"thread_start_us":110644,"threads_started":1,"wal-append.queue_time_us":367228}
I20260709 12:57:58.596187  4277 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.598487  4277 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:58.532320  4063 consensus_queue.cc:1059] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:57:58.583402  3765 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:58.581764  4199 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:58.603994  3868 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.604426  4199 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.604866  3868 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.606642  4199 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:58.607146  4199 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.607582  4199 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.581596  4184 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:58.609009  4084 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.609237  4291 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.609246  4184 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:57:58.612017  4184 raft_consensus.cc:3055] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:58.612464  4184 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:58.617044  1712 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:58.617417  4184 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.618865  4184 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.624526  4199 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:58.630414  1537 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:58.630491  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:58.539063  4295 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:58.634416  1686 leader_election.cc:336] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.756s (SENT)
W20260709 12:57:58.638720  1686 leader_election.cc:336] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.810s (SENT)
I20260709 12:57:58.639129  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:58.587527  4286 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:58.578847  4248 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:57:58.647821  1721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "523c299f124340818ee040d8a887dba6"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:58.650156  3973 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:58.651482  4147 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.652961  1564 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:58.659155  1721 raft_consensus.cc:606] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:58.677489  1721 raft_consensus.cc:614] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:57:58.677112  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46793.1us
I20260709 12:57:58.675840  1564 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:58.637069  4159 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:57:58.687776  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 305581us
I20260709 12:57:58.681380  1564 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.589401  4097 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.647578  4116 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.694744  4116 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:58.697119  4305 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:57:58.698999  4301 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:57:58.633802  4269 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:57:58.693570  3868 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:58.616314  1470 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 2 to 4, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:58.749500  4178 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.750156  4178 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.750048  1470 catalog_manager.cc:5697] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 1 to 5, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.646890  4239 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:57:58.687553  4122 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:58.653010  4266 consensus_queue.cc:1059] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:57:58.752311  1470 catalog_manager.cc:5697] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:58.644848  4295 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:58.777619  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 62288.2us
I20260709 12:57:58.782346  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:58.784380  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:58.647287  4052 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.789772  1470 catalog_manager.cc:5697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 4 to 5, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.776535  4122 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:58.794499  1537 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:58.798698  1537 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:58.782647  3765 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.788375  4191 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.786842  4269 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:58.788110  4174 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:58.781531  4180 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:57:58.791971  4099 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:58.807101  1537 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:58.809142  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 272547us
I20260709 12:57:58.796445  4122 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.795869  3882 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:58.797698  4178 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:58.810772  1470 catalog_manager.cc:5697] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 2 to 3, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.798033  4276 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:58.827044  4276 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:58.827544  4276 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:58.809288  4191 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.830770  4191 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:58.832227  4295 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:58.802153  4080 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:58.818259  4152 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:58.832894  4080 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:58.833401  4080 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.834738  3765 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:58.835526  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.810722  4121 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:57:58.805876  4206 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.837309  4122 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.842201  4122 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:58.842105  3833 consensus_queue.cc:260] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.843264  3833 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:58.847602  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 208877us
I20260709 12:57:58.847579  4286 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:58.850292  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 161789us
W20260709 12:57:58.851698  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:58.852120  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:58.852818  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.823290  1470 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 1 to 4, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 4 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:58.850239  3973 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:58.853796  3973 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:58.838460  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.858575  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:58.858822  4277 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.859133  4206 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.859398  4277 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.861584  4206 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.861956  4306 raft_consensus.cc:3055] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:58.814291  4269 raft_consensus.cc:697] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:58.862499  4306 raft_consensus.cc:740] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:57:58.851459  4147 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:58.871922  4239 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.873199  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:58.817304  1537 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:58.855742  1470 catalog_manager.cc:5697] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 1 to 3, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.874032  1713 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
W20260709 12:57:58.874737  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 57508.5us
I20260709 12:57:58.875347  1470 catalog_manager.cc:5697] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 1 to 2, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.851778  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:58.864246  4241 raft_consensus.cc:3055] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:58.867468  4052 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:58.851616  1721 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:58.868848  1712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:58.889753  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:58.856307  3973 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.876729  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:58.881152  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:58.882486  1719 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:58.863535  4277 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.891371  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:58.898103  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:58.844274  4095 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:58.896268  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.875669  1537 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:58.897668  1713 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:58.901786  1717 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:57:58.902242  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:58.903579  1537 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:58.889219  4241 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:58.892627  4121 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:58.928234  4121 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.928740  4121 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.928681  4241 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.929966  4241 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:58.906486  4199 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:58.933174  4199 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:58.933576  4199 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:58.897378  4087 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:58.935606  4087 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:58.936036  4087 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:58.936322  4184 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:58.936823  4184 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.904546  4122 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:58.946398  1718 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: []
W20260709 12:57:58.907958  4111 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.272s	user 0.047s	sys 0.075s
I20260709 12:57:58.912499  4192 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:57:58.917203  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.947263  1537 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:58.905859  3765 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:58.951875  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:58.917661  4152 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:58.950753  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:58.921106  4286 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.921329  1684 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:58.921833  4114 consensus_queue.cc:1059] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:58.959343  4307 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:58.959787  4307 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:58.960126  4307 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:58.897527  4295 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:57:58.964510  4095 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:58.964915  4114 raft_consensus.cc:3055] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:58.965135  4295 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:58.965826  4295 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:58.966928  4295 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.956166  3882 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:58.969429  3882 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:58.969820  3882 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:58.970911  4307 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.972859  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:58.973527  4307 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:57:58.953424  4152 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.977329  4152 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:58.863746  4306 consensus_queue.cc:260] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:57:58.928347  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.985303  4080 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.987151  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:58.987447  4080 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:58.896986  4269 consensus_queue.cc:237] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.905323  3973 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:58.947223  1712 raft_consensus.cc:606] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:58.989387  1712 raft_consensus.cc:614] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:58.954751  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:58.956207  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:58.872481  4239 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:58.992147  4235 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:58.953550  4111 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.047s	sys 0.075s
I20260709 12:57:58.965346  4114 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:58.993719  4114 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.994304  4239 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:58.994812  4114 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:58.958700  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:58.989312  3973 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:58.996145  4239 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:58.927289  4276 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:58.996306  3973 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.957795  2348 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:57:58.996140  4286 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:58.999577  4095 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:58.992583  4235 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.005762  4277 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:59.039920  1646 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:59.041302  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:59.042496  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:59.043527  4184 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.007411  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.008853  1712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:57:59.015908  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.018877  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:59.012822  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.020246  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.020666  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:59.021147  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.020s	sys 0.057s
I20260709 12:57:59.023486  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:59.023717  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.048902  1644 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:59.049401  1639 raft_consensus.cc:2410] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:59.034372  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:57:59.006354  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 120785us
I20260709 12:57:59.050518  1643 raft_consensus.cc:2410] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:59.050875  1712 raft_consensus.cc:606] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:59.051329  1712 raft_consensus.cc:614] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:57:59.053779  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.020s	sys 0.057s
W20260709 12:57:59.054227  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 1.55786e+06us
I20260709 12:57:59.047310  1610 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:59.056109  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:59.056931  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:59.057770  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.058418  1563 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:57:58.968564  4295 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.017581  4217 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.060869  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:59.063943  1572 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:59.066350  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.043540  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.069878  1564 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.070297  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:59.075812  1718 raft_consensus.cc:2410] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:57:59.047772  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.076526  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.067127  1563 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:59.077502  1570 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:59.078784  1715 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:57:59.081224  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:59.083671  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:59.087478  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:59.089636  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:59.091442  1721 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:59.094048  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:59.095001  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.095515  1640 raft_consensus.cc:2410] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:57:59.098220  1567 raft_consensus.cc:2393] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.098453  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.099287  1563 raft_consensus.cc:2410] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:57:59.062289  1610 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:59.019449  4307 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:57:59.046851  4306 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:59.102317  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:57:59.128216  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 66052.6us
I20260709 12:57:59.045495  4235 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.044261  4286 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:57:59.127797  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.105285  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.103701  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:59.116917  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.060194  3634 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:59.133598  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:59.131443  1566 raft_consensus.cc:2410] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:59.060422  4277 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.145084  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.145687  1572 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:57:59.136322  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:59.147044  1721 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:59.131466  1568 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:59.106953  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:59.148727  1715 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:57:59.118728  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:59.060262  3833 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:57:59.141185  1714 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:59.158823  1721 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:59.135187  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:59.159441  1563 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.160051  1716 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:57:59.141871  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:59.161276  1567 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.162333  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.163079  1567 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:57:59.164096  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.142159  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.165639  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.166568  1571 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.167479  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.142729  1639 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:59.150682  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.170164  4174 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.170696  1570 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.171818  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.092065  4147 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:59.172876  4147 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:57:59.173409  4147 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:59.099720  4184 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:59.139021  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 318297us
I20260709 12:57:59.178436  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.178833  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.178876  2312 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.060817  3882 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.188285  2348 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:59.188558  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.133299  4239 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:59.168572  1571 raft_consensus.cc:2410] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:59.189344  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.195048  1570 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:57:59.182185  1567 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.192337  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:59.193048  1535 connection.cc:256] RPC call timeout handler was delayed by -1.6597831779999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 12:57:59.196799  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:57:59.201488  1535 connection.cc:256] RPC call timeout handler was delayed by -1.513083177999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 12:57:59.201951  1535 connection.cc:256] RPC call timeout handler was delayed by -1.2457831780000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
I20260709 12:57:59.202085  1567 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:57:59.202385  1535 connection.cc:256] RPC call timeout handler was delayed by -1.0023535980000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 12:57:59.190698  2312 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.134126  4114 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.197154  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:59.192994  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:59.204290  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:59.118124  4136 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:57:59.219359  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:59.220086  1570 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:57:59.217757  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 142286us
I20260709 12:57:59.211565  1563 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:57:59.215340  1568 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.215849  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:59.222600  1686 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.223356  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:59.223793  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.215817  1567 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.224659  4084 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.203876  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.225421  1686 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.226545  3634 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:59.227171  3634 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.227497  4095 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.227753  3634 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.228266  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:59.229374  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.229152  4097 consensus_queue.cc:1059] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:59.230119  1563 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.230741  4097 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:59.232856  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.233162  1568 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:57:59.232884  4192 raft_consensus.cc:3055] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:59.233804  4192 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:57:59.234090  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:57:59.234220  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 43653.6us
I20260709 12:57:59.234606  4192 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.235935  4192 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:59.236907  4317 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:59.230858  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:57:59.238754  1563 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.239482  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.240316  1563 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:57:59.239467  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:59.241127  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.242055  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.242946  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.225441  4084 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:59.252739  4114 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.217723  2344 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:57:59.091537  4217 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.234622  1568 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:59.257414  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53606.9us
I20260709 12:57:59.258129  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:59.259148  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.249284  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:57:59.226970  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:59.266882  1572 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.268778  1563 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:59.193400  4157 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:59.272383  1535 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.280937  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.281663  1570 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.283068  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:57:59.287297  4191 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:59.254709  4095 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.215116  4080 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.280243  3765 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:59.313293  1568 raft_consensus.cc:2410] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:57:59.314903  1568 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:59.170720  4174 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.188581  4184 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.177098  4277 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.260041  4241 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:59.271023  4122 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.317322  1563 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:57:59.273864  4269 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:57:59.321108  4080 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.334635  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.290298  4164 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:59.291327  4178 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.291109  3868 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:59.346603  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:59.372357  1570 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:59.317878  3765 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.323594  4111 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 12:57:59.364884  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.316406  4311 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:57:59.296787  4312 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:57:59.293545  4206 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:57:59.365926  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.377718  1646 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:59.378031  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:59.378569  1645 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:59.378633  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.369426  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:59.370054  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:57:59.337567  4276 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:59.290882  4152 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.337415  3833 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:59.373415  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.348696  1568 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:59.390992  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:57:59.393358  1567 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
W20260709 12:57:59.396759  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 160998us
I20260709 12:57:59.408279  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:57:59.403795  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 176867us
I20260709 12:57:59.410091  1686 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:57:59.420472  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:59.379073  4310 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 12:57:59.373588  4239 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:57:59.423470  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 140457us
I20260709 12:57:59.377552  3765 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.421638  1647 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:57:59.372396  3868 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.350343  4286 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.425791  4069 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:59.373646  4199 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:59.441151  4087 consensus_meta.cc:287] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 12:57:59.441037  3868 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.426152  4178 consensus_queue.cc:1059] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:57:59.425299  3973 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.449584  4069 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:59.458709  3882 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:59.458751  4121 consensus_meta.cc:287] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.001s
I20260709 12:57:59.452574  4095 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:57:59.465911  4069 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:59.453768  4087 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.480403  4307 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:59.482332  4328 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.483981  4184 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:59.498565  4325 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:57:59.495157  4174 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:59.501587  4318 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:57:59.500097  4322 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:57:59.496167  4321 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:57:59.502583  4328 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.535197  4328 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:59.582222  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 299670us
I20260709 12:57:59.589352  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:59.595605  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 326) took 1058 ms. Trace:
I20260709 12:57:59.596175  1564 rpcz_store.cc:276] 0709 12:57:58.537099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.539223 (+  2124us) service_pool.cc:224] Handling call
0709 12:57:58.588225 (+ 49002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.652863 (+ 64638us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b540036a4a0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426abdc0 00007f6a427361c0 00007f6a42737231 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c
0709 12:57:59.069506 (+416643us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b58008d02d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426900aa 00007f6a42712447 00007f6a4272afe7 00007f6a4272c7de 00007f6a42736b49 00007f6a42737416 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4
0709 12:57:59.593984 (+524478us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:59.594078 (+    94us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:59.594766 (+   688us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:59.594869 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.595045 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.595326 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49530,"raft.queue_time_us":107064,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":24101,"spinlock_wait_cycles":887281664,"thread_start_us":273872,"threads_started":1}
I20260709 12:57:59.599835  1564 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:59.601490  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 310) took 2641 ms. Trace:
I20260709 12:57:59.602036  1569 rpcz_store.cc:276] 0709 12:57:56.959501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.422413 (+462912us) service_pool.cc:224] Handling call
0709 12:57:57.422819 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:58.491790 (+1068971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.491821 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:58.492450 (+   629us) log.cc:844] Serialized 52 byte log entry
0709 12:57:58.897976 (+405526us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:58.898018 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.898104 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:59.600867 (+702763us) raft_consensus.cc:1685] finished
0709 12:57:59.600924 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.601249 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1000089,"raft.queue_time_us":1003525,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":405188,"threads_started":1,"wal-append.queue_time_us":551127}
W20260709 12:57:59.594180  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 312721us
I20260709 12:57:59.611876  1641 raft_consensus.cc:2410] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:57:59.615267  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 205094us
I20260709 12:57:59.619136  1567 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:57:59.625526  1686 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.650836  1572 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:59.637987  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.639635  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:59.641022  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.643479  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:59.645571  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:59.648406  1569 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:59.626286  1714 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:59.652374  1686 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.499078  4152 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.707284  2349 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:57:59.707881  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.709168  2348 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:59.708519  2347 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:57:59.552091  4235 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.719481  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:57:59.719769  4184 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:59.719837  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.720665  1717 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:59.707327  4266 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.480835  4080 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:59.724880  4068 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:57:59.725669  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:57:59.725533  4266 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.727284  3973 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.728171  4192 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.728474  4095 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:59.729214  4341 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:59.728929  4192 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.729768  4341 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:57:59.730299  4341 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.731801  4192 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.733963  1564 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:59.736048  1564 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:59.737198  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 85114.9us
I20260709 12:57:59.738005  4277 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.738384  1686 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.739950  4266 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.477310  4121 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.743394  4121 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:59.746194  4087 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.747186  4087 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:57:59.748941  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.749917  4241 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:59.750826  4241 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.752624  1565 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:57:59.759198  4069 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.761163  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.761822  1570 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:59.762974  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:59.763736  1570 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:59.765377  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:59.766963  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:59.767796  1715 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.761718  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:59.769718  4184 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:59.771462  4184 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.772024  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.775116  4235 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:59.775975  4114 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.777010  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:59.785899  1645 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:57:59.740468  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.719534  4217 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.827334  3973 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:57:59.837208  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 129244us
I20260709 12:57:59.837435  4116 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.838204  4116 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.843695  4235 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:59.848709  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 129474us
W20260709 12:57:59.837198  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 396624us
I20260709 12:57:59.855907  1638 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:57:59.856417  4217 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:59.857004  4217 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:57:59.857589  4217 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:59.874594  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 134326us
I20260709 12:57:59.875686  1686 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.876995  4286 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.881616  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:57:59.882651  1714 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:59.883662  1721 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:59.881645  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:57:59.885257  1718 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:57:59.885169  2342 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:59.886379  4335 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.886946  4335 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.888975  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.892122  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:57:59.897455  4269 raft_consensus.cc:3055] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:59.897970  4269 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:59.899060  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.899528  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:57:59.901146  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:57:59.899264  4097 consensus_meta.cc:287] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.668s	user 0.002s	sys 0.013s
I20260709 12:57:59.885673  3868 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.907068  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.907218  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:57:59.907970  1566 raft_consensus.cc:2368] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9.
I20260709 12:57:59.870707  4192 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.908713  4192 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.909087  3973 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:57:59.910064  3868 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:57:59.910712  4324 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.460s	user 0.000s	sys 0.002s
I20260709 12:57:59.911378  4192 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.902182  4069 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:59.905633  4235 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.920686  1715 raft_consensus.cc:2410] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:57:59.915614  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:57:59.902112  2343 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:57:59.925418  4097 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:59.920090  4192 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.943681  4241 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:59.948158  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:57:59.949802  4333 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:57:59.950007  3634 consensus_meta.cc:287] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.009s
I20260709 12:57:59.951064  4311 raft_consensus.cc:3055] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:57:59.951484  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 59590us
I20260709 12:57:59.958738  4333 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:57:59.974689  3973 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:59.975370  3973 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.960215  4311 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:57:59.976990  4311 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:57:59.975593  4235 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:57:59.975667  3765 consensus_meta.cc:287] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.006s
W20260709 12:57:59.981089  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 117228us
I20260709 12:57:59.975806  3973 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:59.919178  4269 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:57:59.983104  4147 consensus_meta.cc:287] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.809s	user 0.017s	sys 0.000s
W20260709 12:57:59.983857  4084 consensus_meta.cc:287] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.733s	user 0.006s	sys 0.010s
I20260709 12:57:59.984808  4116 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:57:59.985219  4336 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:59.986083  4217 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:57:59.987629  4343 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.990715  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:00.025641  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:57:59.979033  4192 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.005349  4135 consensus_queue.cc:1059] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:59.973428  3634 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.009814  4341 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.013283  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:00.027611  2343 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:00.013720  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:00.028424  3634 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:57:59.974684  4333 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:00.019341  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:00.033217  1641 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:00.028367  4192 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.040330  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:00.040979  4174 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:00.041671  4174 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:00.043318  4277 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.043440  4114 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:00.049006  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:00.050056  4184 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.051718  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:00.051805  4336 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:00.052894  3868 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.053530  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:00.053732  4080 consensus_queue.cc:1059] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:58:00.055094  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:00.056102  4217 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.056329  4184 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.020812  3765 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.031096  4084 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:00.056130  3894 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:00.057689  3894 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:00.058187  3894 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:00.058820  3765 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.060428  1719 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:00.064836  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 69340.3us
I20260709 12:58:00.065766  1718 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:58:00.075702  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:00.077366  4122 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:00.072867  4286 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.078248  4122 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.079355  4239 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:00.079720  1715 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:00.079964  4239 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:00.045061  4174 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:00.087600  1610 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:00.088037  3868 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:00.088744  3868 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.090229  3634 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:00.088415  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 54067us
I20260709 12:58:00.090847  3634 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.091400  3634 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:00.072048  4114 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:00.029343  4147 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:00.096738  4136 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:00.100885  1714 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:58:00.102149  4343 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.103816  3868 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.104287  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1583) took 1085 ms. Trace:
I20260709 12:58:00.104784  4122 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.104745  1640 rpcz_store.cc:276] 0709 12:57:59.018536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.018645 (+   109us) service_pool.cc:224] Handling call
0709 12:58:00.103816 (+1085171us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b54001d2ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:00.104071 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97106816}
I20260709 12:58:00.108812  4342 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:00.109391  4114 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.111558  3634 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.113857  1713 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:00.114842  4147 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:00.090349  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:00.116394  1686 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:00.081842  4341 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:00.118491  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1484) took 1035 ms. Trace:
I20260709 12:58:00.119040  1535 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:00.119932  4122 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.120910  4122 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:00.121322  4122 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:00.121731  4122 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:00.109432  4342 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.119959  2349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59844 (request call id 519) took 1169 ms. Trace:
I20260709 12:58:00.123293  2349 rpcz_store.cc:276] 0709 12:57:58.950369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.950485 (+   116us) service_pool.cc:224] Handling call
0709 12:58:00.119709 (+1169224us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540007e9d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:00.119855 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565542144}
I20260709 12:58:00.120904  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 289) took 1049 ms. Trace:
I20260709 12:58:00.125227  1610 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:00.125507  3894 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.126124  4307 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:00.126288  4192 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:00.126744  4307 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:00.127022  4192 raft_consensus.cc:697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:00.128216  4192 consensus_queue.cc:237] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.120636  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:00.130673  1535 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:00.118908  1713 rpcz_store.cc:276] 0709 12:57:59.083241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.086107 (+  2866us) service_pool.cc:224] Handling call
0709 12:57:59.086464 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:00.114479 (+1028015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:00.116163 (+  1684us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002c42d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:00.118423 (+  2260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361577728}
W20260709 12:58:00.137518  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.137907  3634 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.125196  1717 rpcz_store.cc:276] 0709 12:57:59.071691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.071817 (+   126us) service_pool.cc:224] Handling call
0709 12:57:59.128585 (+ 56768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.721212 (+592627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:00.120560 (+399348us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400213c54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:00.120826 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312326912}
I20260709 12:58:00.142732  1718 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:00.128038  4307 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.140545  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:00.137622  3868 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:00.136669  3894 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.151485  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:00.152220  2349 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:00.154912  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:00.160298  1571 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:00.132061  3973 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.164462  4180 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:00.153563  4147 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:00.165469  4336 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:00.168269  3868 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:00.210068  4180 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:00.160190  4135 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:58:00.169117  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 64550.5us
I20260709 12:58:00.173302  4307 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:00.174938  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1593) took 1123 ms. Trace:
I20260709 12:58:00.212013  2349 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:00.173337  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:00.176584  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:00.177222  4235 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:00.180348  4116 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.217325  4116 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.182644  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:00.219808  4116 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.181387  3894 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:00.220727  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:00.221043  3894 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:00.183676  4342 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:00.185935  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.185971  1570 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:58:00.221917  3894 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:00.222308  4121 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.190635  4164 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:00.214469  3868 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.223055  4164 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:00.223855  4235 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:00.194535  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.184919  1569 pending_rounds.cc:85] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 6
I20260709 12:58:00.224211  4164 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.224947  1569 pending_rounds.cc:107] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:58:00.225320  1569 raft_consensus.cc:2889] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:00.225423  4164 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.226243  4235 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.194818  4337 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:00.189235  4174 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.213524  1610 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:00.216611  4135 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:00.217617  1686 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:00.226900  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 101811us
I20260709 12:58:00.202049  4314 raft_consensus.cc:3055] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:00.236006  2340 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:00.238246  4199 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.237764  4180 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.212496  1642 rpcz_store.cc:276] 0709 12:57:59.051276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.409027 (+357751us) service_pool.cc:224] Handling call
0709 12:57:59.409303 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:59.409667 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:59.409693 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:59.410100 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 12:57:59.681517 (+271417us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:59.681651 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.681749 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:00.172337 (+490588us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b1800353f80. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:00.174393 (+  2056us) raft_consensus.cc:1685] finished
0709 12:58:00.174414 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:00.174702 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":855,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7353,"spinlock_wait_cycles":8215424,"thread_start_us":269062,"threads_started":1,"wal-append.queue_time_us":269471}
I20260709 12:58:00.212348  4336 raft_consensus.cc:697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:00.250286  1641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:58:00.251204  1641 raft_consensus.cc:606] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:00.251612  1641 raft_consensus.cc:614] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:00.252756  4116 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.253217  4342 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:00.253553  4116 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.253958  4342 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.256072  4342 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.256494  3634 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:00.257062  3634 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.257258  4337 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:00.257786  4342 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.258320  4337 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:00.258895  4337 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:00.259248  3634 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.260442  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:00.261065  4173 raft_consensus.cc:3055] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:00.261500  4336 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.258462  4342 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.265360  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:00.266662  4116 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.232964  4135 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:00.240010  4314 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:00.261539  4173 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:00.269008  4311 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.268599  4314 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.269416  4173 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.270869  4173 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:00.252828  4199 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.272859  4199 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.268460  4135 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.248685  3765 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.275784  3765 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.275086  4199 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.278388  3765 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:00.267043  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.275130  4135 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:00.282924  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 65427.8us
I20260709 12:58:00.283145  4087 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:00.283855  4087 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:00.284770  1686 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:00.285928  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 65363.3us
I20260709 12:58:00.216593  3973 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:00.270924  4174 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.241482  4235 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:00.290421  4147 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:00.289723  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:00.290664  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:00.291345  2349 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:58:00.293265  1610 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:00.285334  4328 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:58:00.270807  4314 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:00.297665  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:00.296376  4341 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 12:58:00.311424  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 48297.8us
I20260709 12:58:00.246228  4122 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.313800  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1549) took 1211 ms. Trace:
I20260709 12:58:00.285034  4087 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.292454  4342 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.290798  4235 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:00.318135  2349 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:58:00.321337  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:00.297082  4116 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:00.322588  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:00.326238  1641 raft_consensus.cc:2393] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:00.329433  1610 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:00.260190  4337 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.332522  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:00.317179  4206 consensus_queue.cc:1059] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:58:00.335496  4342 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:00.319796  1567 rpcz_store.cc:276] 0709 12:57:59.102809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.171359 (+1068550us) service_pool.cc:224] Handling call
0709 12:58:00.171750 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:00.172010 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:00.298968 (+126958us) log.cc:844] Serialized 14 byte log entry
0709 12:58:00.313331 (+ 14363us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:00.313497 (+   166us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:00.313542 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:00.313606 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:00.313744 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118766,"prepare.queue_time_us":140288,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":96,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":13939,"threads_started":1,"wal-append.queue_time_us":14368}
I20260709 12:58:00.337884  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:00.325881  4199 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:00.348943  1640 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:00.350104  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.328887  4116 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.354434  4333 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.356957  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:00.358032  1686 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:00.367100  4359 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.367712  4359 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.370076  4359 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.370589  4360 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:00.371045  4360 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.371378  4360 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.344405  4328 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:58:00.375329  4330 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.375917  4330 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.363818  4206 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:00.377122  4206 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:00.376390  2340 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:00.381498  2340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 376) took 1185 ms. Trace:
I20260709 12:58:00.382987  4330 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:00.383055  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 330) took 1313 ms. Trace:
I20260709 12:58:00.382748  4206 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.384307  4206 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:00.384804  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.384887  4342 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.424539  1642 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:00.353556  4116 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.382030  2340 rpcz_store.cc:276] 0709 12:57:59.195834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.199667 (+  3833us) service_pool.cc:224] Handling call
0709 12:58:00.172980 (+973313us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b58001b4b98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60feee 0000000000375939 00007f6a476831e0 00007f6a4774c0c4 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:58:00.381414 (+208434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8081664}
W20260709 12:58:00.387791  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 58727.2us
W20260709 12:58:00.432344  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.432792  1639 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:00.377861  4337 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:00.378212  3973 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:00.438468  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 80520.4us
I20260709 12:58:00.383610  1563 rpcz_store.cc:276] 0709 12:57:59.069120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.269575 (+200455us) service_pool.cc:224] Handling call
0709 12:57:59.269851 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.317193 (+ 47342us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:59.364352 (+ 47159us) log.cc:844] Serialized 14 byte log entry
0709 12:58:00.281305 (+916953us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b18002e0300. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a3f649a40 00007f6a3f6444e4 00007f6a3f644455 00007f6a4612c3c7 00007f6a4273e9a7 00007f6a4274e0bf 00007f6a4274e038
0709 12:58:00.337666 (+ 56361us) log.cc:844] Serialized 14 byte log entry
0709 12:58:00.346216 (+  8550us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:00.350834 (+  4618us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:00.375589 (+ 24755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:00.382621 (+  7032us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b5400311fd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:00.382691 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:00.382834 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96533,"prepare.queue_time_us":515125,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":53843,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":4924,"spinlock_wait_cycles":114563584,"thread_start_us":384957,"threads_started":2,"wal-append.queue_time_us":448513}
I20260709 12:58:00.378679  4199 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:00.459621  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.462574  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:00.457178  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:00.473193  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:00.473491  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:00.486836  1642 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.482522  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:00.500790  4341 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:00.501533  3868 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.502082  3868 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.507619  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:00.508841  4122 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.510176  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:00.504352  3868 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:00.514233  4199 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:00.515167  4374 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:58:00.517246  4375 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:58:00.521858  4342 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:00.515215  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 85993.1us
I20260709 12:58:00.461827  4333 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:00.537919  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 71157.9us
I20260709 12:58:00.492724  4359 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:00.545053  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:00.545755  1639 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:00.552896  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:00.557214  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.556476  1640 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:00.546162  4312 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:00.564961  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:00.468618  4235 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.551302  4359 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:00.590245  4371 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 12:58:00.591601  3833 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.117s
W20260709 12:58:00.594287  4385 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:58:00.595145  4217 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:00.595597  4217 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:00.596721  1721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:58:00.596552  4217 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.597365  1721 raft_consensus.cc:606] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:00.597792  1721 raft_consensus.cc:614] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:00.598223  4217 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.554909  3973 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:00.603135  3973 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.607592  4359 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.615536  4252 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:00.616134  4252 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:58:00.622799  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.548810  4087 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:58:00.637027  1639 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:00.566320  4199 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.638597  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:00.639905  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:00.584601  4239 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.002s
I20260709 12:58:00.644330  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:00.641137  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:00.641898  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:00.642582  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:00.648360  2340 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:00.661645  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:00.592519  4147 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:00.634475  3973 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:00.675387  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:00.598266  4335 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:00.688849  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 135536us
I20260709 12:58:00.664752  3868 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.733552  1646 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:00.733353  3868 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.734601  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:00.735355  2346 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:58:00.711239  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 46684.8us
I20260709 12:58:00.737149  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:00.739055  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:00.740366  2345 raft_consensus.cc:2393] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:00.655110  4239 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.736205  3868 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:00.727705  4387 log.cc:927] Time spent T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:58:00.727630  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:00.728504  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:00.728572  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:00.729982  4307 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:00.730348  1645 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:00.731803  1721 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:58:00.746119  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.723869  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:00.749508  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.753047  1638 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:00.747932  4360 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:00.760558  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.786420  1647 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:00.786942  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:00.791249  1641 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:00.786206  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:00.796175  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:00.797276  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:00.798234  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:00.797641  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:00.804699  1684 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:00.786734  2342 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:00.799505  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:00.793557  4336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.035s
I20260709 12:58:00.810596  1647 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:00.807761  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:00.810446  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:00.799443  1565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1773) took 1734 ms (client timeout 2180 ms). Trace:
I20260709 12:58:00.792881  4307 raft_consensus.cc:697] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:00.813884  1565 rpcz_store.cc:269] 0709 12:57:59.054967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.056723 (+  1756us) service_pool.cc:224] Handling call
0709 12:58:00.755472 (+1698749us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400113d54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:00.789142 (+ 33670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597185920}
I20260709 12:58:00.819664  1564 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:00.812924  1638 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:00.820348  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:00.837100  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:00.807741  4336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.008s	sys 0.035s
I20260709 12:58:00.800240  4235 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:00.838691  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:00.848278  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:00.849104  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:00.853034  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:00.749382  4252 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.853199  1716 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:00.854797  1647 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:00.859071  1563 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:00.823141  4343 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:00.868119  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:00.855237  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.861058  4235 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.861912  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:00.863327  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:00.869448  1569 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:00.868988  1571 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:00.877199  1572 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:00.885795  4360 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:00.887208  4307 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:00.894199  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:00.895085  1568 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:00.876286  3973 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.848629  3833 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:00.897357  3973 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:00.898906  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.911028  4199 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:00.911763  4199 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:00.914055  4199 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:00.914942  1566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1567) took 1739 ms (client timeout 1628 ms). Trace:
W20260709 12:58:00.915520  1566 rpcz_store.cc:269] 0709 12:57:59.175544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.179782 (+  4238us) service_pool.cc:224] Handling call
0709 12:57:59.719375 (+539593us) spinlock_profiling.cc:243] Waited 914 us on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:58:00.914678 (+1195303us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54003124d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:00.914858 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431797248}
I20260709 12:58:00.919196  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1587) took 1894 ms. Trace:
I20260709 12:58:00.923484  2347 raft_consensus.cc:2410] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:00.936203  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:00.941870  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 62828.4us
W20260709 12:58:00.943625  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 454252us
I20260709 12:58:00.822625  4342 consensus_queue.cc:1059] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 12:58:00.949158  3833 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:00.952847  4199 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:00.953344  3833 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:00.954842  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:00.955492  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.946424  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:00.963721  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:00.964428  2349 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.976329  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:00.976601  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:00.958681  4116 consensus_meta.cc:287] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.001s
I20260709 12:58:00.919672  1644 rpcz_store.cc:276] 0709 12:57:59.025227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.059720 (+ 34493us) service_pool.cc:224] Handling call
0709 12:57:59.060073 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:59.176777 (+116704us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:59.355066 (+178289us) log.cc:844] Serialized 14 byte log entry
0709 12:57:59.823731 (+468665us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:59.873716 (+ 49985us) log.cc:844] Serialized 26 byte log entry
0709 12:57:59.894727 (+ 21011us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:59.894773 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:00.089926 (+195153us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5400510ca0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426a9dbe 00007f6a426b4930 00007f6a426b48d8 00007f6a426b4858 00007f6a426b4813 00007f6a426b3a9c 00007f6a4859f626 00007f6a48599dd8 00007f6a426f07cb 00007f6a426f32c0
0709 12:58:00.918700 (+828774us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b5400337554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:00.918768 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:00.918827 (+    59us) raft_consensus.cc:1685] finished
0709 12:58:00.918846 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:00.918998 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99018,"prepare.queue_time_us":190146,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":7277,"raft.queue_time_us":114338,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":7736,"spinlock_wait_cycles":265966080,"thread_start_us":448525,"threads_started":3,"wal-append.queue_time_us":302974}
I20260709 12:58:00.979693  2343 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:00.977210  1563 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:00.982112  1714 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:00.982793  2340 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:58:00.983346   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:00.983410  4269 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:00.984143  1713 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:00.984472  4180 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:00.985976  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:00.976926  4336 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
W20260709 12:58:00.989256  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.989048  4360 consensus_queue.cc:1059] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:00.976790  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:00.994351  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:01.005311  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:00.998610  4180 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.016892  1713 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:01.016987  4180 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:01.020159  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.023054  1572 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:01.020884  1565 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:01.067418  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:01.068802  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 59994.1us
I20260709 12:58:01.034299  1571 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:01.072883  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:01.073452  1638 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:01.095983  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:01.098795  1721 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:01.116801  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.022709  4084 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.998600  4116 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:01.125586  1572 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:01.126173  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.069118  4239 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:01.144076  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 282191us
I20260709 12:58:01.145155  1684 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:01.133318  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:01.146701  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.148021  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.143430  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:01.138203  2349 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
W20260709 12:58:01.140813  1642 consensus_meta.cc:287] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.002s
I20260709 12:58:01.015686  4342 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 12:58:01.154765  1642 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:01.148115  1684 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:01.157577  1638 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:01.162998  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.160598  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.166072  1643 raft_consensus.cc:2368] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:58:01.166688  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.170507  1647 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:58:01.171147  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:01.172197  1569 raft_consensus.cc:2410] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:58:01.142367  4360 raft_consensus.cc:3055] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:58:01.162395  4393 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:58:01.162591  4147 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:01.188768  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:01.192219  1572 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:01.189620  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.193181  1569 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:58:01.167563  4330 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:01.195292  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.019093  3833 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:01.170023  4338 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:01.198688  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:01.196156  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.185449  4276 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.202100  1571 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
W20260709 12:58:01.207372  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 74112us
I20260709 12:58:01.211169  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.212010  1572 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:01.212455  4235 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:01.215257  4276 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.206785  4199 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.217366  4199 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.219280  4276 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:01.219576  4199 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:01.222784  4314 consensus_meta.cc:287] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.904s	user 0.012s	sys 0.001s
W20260709 12:58:01.224277  4206 consensus_meta.cc:287] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.839s	user 0.007s	sys 0.005s
I20260709 12:58:01.230134  1714 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:01.231335  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.231662  4277 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:01.233197  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:01.234035  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:01.234561  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.235512  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.235875  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.236141  1719 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:01.236898  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:01.211181  4379 log.cc:927] Time spent T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.897s	user 0.009s	sys 0.002s
I20260709 12:58:01.238644  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.239274  1716 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:01.239956  4206 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:01.240394  4206 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.240747  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:01.183049  4360 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:01.240906  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.240485  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.241849  1713 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:01.237018  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.241955  4360 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.240898  4206 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.243239  4360 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:01.149142  4084 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.248663  1569 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:01.259356  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.253712  1535 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:01.232369  4277 consensus_queue.cc:1243] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:01.274281  4180 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.198278  4330 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.183390  4286 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
W20260709 12:58:01.291700  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 303092us
I20260709 12:58:01.291857  1718 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:01.296873  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 88645.2us
I20260709 12:58:01.297878  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:01.292403  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.298836  1719 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:58:01.301916  1571 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:01.281939  4338 raft_consensus.cc:697] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:01.290436  4311 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:01.314726  1571 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:01.321151  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:01.322202  4336 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:01.323233  1535 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:01.324120  4336 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:01.325964  4336 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:01.327106  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:01.329523  4084 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:01.331333  1564 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.509s	user 0.003s	sys 0.004s
I20260709 12:58:01.315572  4068 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:01.335479  4116 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:01.336417  2342 consensus_meta.cc:287] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 12:58:01.336853  2342 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:01.336993  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.337934  4286 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:01.338376  4286 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:01.338943  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.339603  1717 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:01.339331  4286 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:01.341683  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:01.343176  1638 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:58:01.344286  4180 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:01.344463  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:01.291415  4330 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.345777  1565 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:58:01.345162  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:01.347347  1714 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:01.331039  1535 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:01.349786  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:01.349872  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:01.350625  1642 raft_consensus.cc:2410] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 2.
I20260709 12:58:01.332659  1564 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:01.352911  1644 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:58:01.353412  1564 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:01.353451  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:01.364094  1568 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:01.364301  1721 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:01.331374  4336 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:01.388435  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:01.385349  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:01.365175  1686 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.628s (SENT) [suppressed 18 similar messages]
I20260709 12:58:01.390056  1646 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:01.391433  1640 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:01.353137  4080 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:01.334719  4206 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:01.358376  4239 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:01.363567  4235 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:01.321451  4311 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:01.369395  4286 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:01.424970  4199 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:01.425498  4199 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.426044  4199 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:01.428328  4235 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.433342  4206 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:01.433068  4235 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.435491  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:01.439455  4239 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.440021  4239 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:01.457056  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 93838.5us
I20260709 12:58:01.411787  4080 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:01.452135  4359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.030s	sys 0.079s
I20260709 12:58:01.472784  4080 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:01.473464  4359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.031s	sys 0.079s
I20260709 12:58:01.503795  4408 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:01.504465  4408 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:01.505709  4408 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.507293  4408 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:01.508522  4330 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.509044  4406 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:01.509701  4406 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:01.511313  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.511494  4330 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:01.511950  4406 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:01.468705  4180 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:58:01.527052  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:01.527663  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:01.528025  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.530290  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:01.531109  1564 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:01.470954  4338 consensus_queue.cc:237] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.532248  2342 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:01.533726  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:01.534998  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.536381  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:01.545904  2342 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.548952  4239 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:01.531047  1563 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.560182  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:01.548416  4252 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:01.591183  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.589428  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:01.573350  4336 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.577661  4180 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:01.638890  4398 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.639590  4398 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:01.588610  4235 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:01.656165  2342 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:01.602545  4147 raft_consensus.cc:697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:01.574862  4191 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 12:58:01.700829  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 335636us
I20260709 12:58:01.620693  4336 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.675617  4180 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:01.711437  4199 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.713172  4398 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:01.693418  4311 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:01.713723  4199 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:01.731108  3973 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:01.739252  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:01.739032  4147 consensus_queue.cc:237] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.744024  1563 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:01.750524  1610 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:01.762864  1610 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:01.571960  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:01.766968  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:01.768201  1647 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:01.775309  1568 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:01.783994  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:01.785027  2342 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:58:01.786792  1610 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:01.788605  2347 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:01.789333  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:02.201483  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 629543us
I20260709 12:58:02.243700  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:01.929206  1685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.014s	sys 0.022s
W20260709 12:58:01.900475  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.244606  1644 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:58:02.201356  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 342686us
W20260709 12:58:02.245251  1685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.016s	sys 0.024s
I20260709 12:58:02.248456  4191 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.774888  4116 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:02.233485  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:02.082768  1567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.021s	sys 0.020s
W20260709 12:58:01.774319  3833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.017s
I20260709 12:58:01.789354  1641 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:58:01.999675  1719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.017s	sys 0.022s
W20260709 12:58:02.265806  1719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.022s	sys 0.025s
I20260709 12:58:01.791357  1645 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:58:02.241349  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.766551  4239 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:01.755846  4398 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.267946  4386 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.253173  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:02.268451  4386 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.268075  4398 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.270519  4398 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:02.082579  4174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.023s	sys 0.023s
W20260709 12:58:02.273052  4174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.023s	sys 0.027s
I20260709 12:58:02.273746  4174 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:02.273969  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:02.274444  4174 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:02.276685  4192 raft_consensus.cc:3055] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:02.276851  4413 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:02.249317   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:02.278185  4286 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:02.278640  3973 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:02.278789  4286 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:02.279033  3973 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:02.279625  4336 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:02.281141  1713 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:02.282171  3868 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:02.283111  3868 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:02.283891  4252 consensus_meta.cc:287] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.704s	user 0.006s	sys 0.002s
I20260709 12:58:02.284183  4418 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.283739  3868 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:01.774422  4328 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.275074  1684 leader_election.cc:400] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:58:01.840387  4342 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:02.285197  4337 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:02.263824  3833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.007s	sys 0.029s
W20260709 12:58:02.258425  1567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.024s	sys 0.023s
I20260709 12:58:02.306766  4337 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:02.287685  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:02.308202  1720 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:02.308066  4337 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:02.267575  4408 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.760s	user 0.003s	sys 0.007s
I20260709 12:58:01.871793  4383 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.309900  4337 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:02.310240  4383 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.277112  4192 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:01.848553  4311 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:01.756053  4180 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:02.301014  4410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.026s	sys 0.006s
I20260709 12:58:02.320437  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:02.321317  1716 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:02.303292  4414 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.303702  4191 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.278365  4413 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:02.270519  4386 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:02.279860  3973 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:02.313027  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 79650.4us
I20260709 12:58:02.279806  4286 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:01.774566  4359 consensus_queue.cc:1059] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.514s
I20260709 12:58:01.765179  4235 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.525s
I20260709 12:58:02.313333  4343 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.848362  4080 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.298100  4147 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.247629  4406 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:58:02.299669  4342 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:02.324626  4410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.026s	sys 0.006s
I20260709 12:58:02.358875  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:02.318864  4341 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:02.396435  4425 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:58:02.488529  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:02.401676  3868 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:02.297667  4418 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:02.406296  4383 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:02.407513  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1588) took 1529 ms. Trace:
I20260709 12:58:02.497529  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:02.497529  1569 rpcz_store.cc:276] 0709 12:58:00.878403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.261282 (+382879us) service_pool.cc:224] Handling call
0709 12:58:01.283040 (+ 21758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:01.309465 (+ 26425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:01.309508 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:01.314195 (+  4687us) log.cc:844] Serialized 26 byte log entry
0709 12:58:01.749529 (+435334us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:01.749573 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:01.749633 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:02.407161 (+657528us) raft_consensus.cc:1685] finished
0709 12:58:02.407193 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:02.407428 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9126,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":1100,"thread_start_us":361143,"threads_started":1,"wal-append.queue_time_us":958180}
I20260709 12:58:02.498378  1571 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:02.496987  1713 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:02.466077  3973 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:02.319519  4328 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:02.493088  1564 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:02.312757  4192 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:02.466747  4431 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:58:02.466077  4311 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.467255  4342 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:02.497146  4277 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:02.509619  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:02.327647  4414 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:02.488584  4423 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:02.363188  4343 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:02.515846  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 185004us
I20260709 12:58:02.538813  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:02.329262  4413 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:02.492172  4147 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:02.553689  1686 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:02.557679  4416 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:02.546481  4192 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:02.562537  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 318935us
I20260709 12:58:02.566681  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:02.569561  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.570580  2344 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:02.555406  4312 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:02.551158  4235 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:02.570215  1721 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:02.577253  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:02.580206  1569 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
W20260709 12:58:02.625066  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 77848.3us
I20260709 12:58:02.626055  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:02.558250  4416 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.532570  4311 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.561060  4341 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:02.667202  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:02.680703  1565 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:02.568773  4410 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:02.661723  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:02.569006  3868 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:58:02.724176  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 101069us
I20260709 12:58:02.718798  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1585) took 1844 ms. Trace:
I20260709 12:58:02.571210  4425 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:02.622393  4312 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:02.729391  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 103439us
I20260709 12:58:02.624543  4338 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.726550  1572 rpcz_store.cc:276] 0709 12:58:00.874330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.212813 (+338483us) service_pool.cc:224] Handling call
0709 12:58:01.213284 (+   471us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:58:01.213765 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:01.213805 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:58:01.214625 (+   820us) log.cc:844] Serialized 78 byte log entry
0709 12:58:01.601199 (+386574us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:01.863238 (+262039us) log.cc:844] Serialized 14 byte log entry
0709 12:58:02.234985 (+371747us) log.cc:844] Serialized 14 byte log entry
0709 12:58:02.718305 (+483320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:02.718423 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:02.718486 (+    63us) raft_consensus.cc:1685] finished
0709 12:58:02.718505 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:02.718720 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178705,"prepare.queue_time_us":156050,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":58,"raft.queue_time_us":423130,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":14556,"spinlock_wait_cycles":64353408,"thread_start_us":981318,"threads_started":3,"wal-append.queue_time_us":522292}
I20260709 12:58:02.678943  4277 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:02.719624  4410 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.777482  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:02.774150  1686 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:02.723539  4276 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:02.734992  4312 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:02.640057  4239 raft_consensus.cc:697] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:02.798768  1686 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:02.717387  4235 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:02.802053  1642 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:58:02.817329  1642 pending_rounds.cc:85] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 3
I20260709 12:58:02.817667  1642 pending_rounds.cc:107] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:58:02.817972  1642 raft_consensus.cc:2889] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:02.563102  4423 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.822496  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:02.823228  1641 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:02.785957  4410 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:02.784669  3814 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:02.825419  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:02.840683  1639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.011s
I20260709 12:58:02.785671  4408 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:02.855268  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.008s	sys 0.035s
W20260709 12:58:02.856952  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.008s	sys 0.035s
I20260709 12:58:02.845671  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:02.845074  1639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.002s	sys 0.011s
W20260709 12:58:02.840233  4116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.006s
I20260709 12:58:02.769726  3868 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:02.772205  4338 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:02.823736  4084 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:02.771884  4425 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.825662  4180 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:02.872686  4116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.010s	sys 0.006s
I20260709 12:58:02.854537  3814 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:02.899904  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.873908  1572 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:02.906849  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:02.873328  4430 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.507s	user 0.001s	sys 0.000s
I20260709 12:58:02.904219  3814 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:02.917145  4239 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:02.921842  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1818) took 1364 ms. Trace:
I20260709 12:58:02.922219  1568 rpcz_store.cc:276] 0709 12:58:01.557913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.570773 (+ 12860us) service_pool.cc:224] Handling call
0709 12:58:02.921687 (+1350914us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54001860d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:02.921787 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421911296}
I20260709 12:58:02.926397  4416 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:02.872521  4418 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:02.936501  1641 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:02.874768  4080 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:02.900767  4328 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:02.945904  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 379280us
W20260709 12:58:02.947259  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.009s	sys 0.012s
W20260709 12:58:02.947734  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.009s	sys 0.012s
W20260709 12:58:02.948009  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 694854us
I20260709 12:58:02.948908  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:02.904394  4116 raft_consensus.cc:697] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:02.924571  4337 consensus_meta.cc:287] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.000s
W20260709 12:58:02.941520  2341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.025s	sys 0.023s
W20260709 12:58:02.954068  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.954210  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1524) took 1597 ms. Trace:
I20260709 12:58:02.960052  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1817) took 1466 ms. Trace:
W20260709 12:58:02.944481  4427 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 12:58:02.953428  4448 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:58:02.963284  2313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.014s	sys 0.047s
W20260709 12:58:02.973667  2313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.014s	sys 0.047s
I20260709 12:58:02.934136  4191 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:02.976197  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:02.960568  1567 rpcz_store.cc:276] 0709 12:58:01.493320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.517154 (+ 23834us) service_pool.cc:224] Handling call
0709 12:58:01.517518 (+   364us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:58:01.517990 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:01.518022 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:58:01.518769 (+   747us) log.cc:844] Serialized 78 byte log entry
0709 12:58:02.307297 (+788528us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:02.307599 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 12:58:02.314746 (+  7147us) log.cc:844] Serialized 14 byte log entry
0709 12:58:02.924614 (+609868us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18002bed60. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a422ead70 00007f6a422de293 00007f6a422d3cea 00007f6a422d423a 00007f6a4273ea2a 00007f6a4274e0bf 00007f6a4274e038
0709 12:58:02.950364 (+ 25750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:02.950460 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:02.959812 (+  9352us) raft_consensus.cc:1685] finished
0709 12:58:02.959839 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:02.959996 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":422747,"prepare.queue_time_us":5152,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":89,"raft.queue_time_us":13138,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":136,"spinlock_wait_cycles":23559552,"thread_start_us":788170,"threads_started":1,"wal-append.queue_time_us":785744}
W20260709 12:58:02.982422  1716 consensus_meta.cc:287] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260709 12:58:02.982834  1716 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
W20260709 12:58:02.959575  2341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.025s	sys 0.024s
I20260709 12:58:02.963775  4445 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:02.963466  4444 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:02.948763  4414 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:02.960420  1719 rpcz_store.cc:276] 0709 12:58:01.357303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.358927 (+  1624us) service_pool.cc:224] Handling call
0709 12:58:01.391280 (+ 32353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:01.391511 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:01.418690 (+ 27179us) log.cc:844] Serialized 14 byte log entry
0709 12:58:02.682194 (+1263504us) log.cc:844] Serialized 14 byte log entry
0709 12:58:02.953385 (+271191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:02.953461 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:02.953540 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:02.953636 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:02.954133 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26946,"prepare.queue_time_us":688901,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":83,"raft.queue_time_us":111647,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":3148,"thread_start_us":1504334,"threads_started":3}
I20260709 12:58:02.964577  4447 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.909178  4443 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:58:02.954918  4359 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:02.974721  1535 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:03.035097  1712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1940) took 1775 ms (client timeout 2025 ms). Trace:
W20260709 12:58:03.010953  1613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.016s	sys 0.027s
I20260709 12:58:02.995340  4343 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:03.004844  4447 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:03.040016  1613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.018s	sys 0.034s
W20260709 12:58:03.039347  1712 rpcz_store.cc:269] 0709 12:58:01.231850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.235607 (+  3757us) service_pool.cc:224] Handling call
0709 12:58:03.007537 (+1771930us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400276fd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:03.007683 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330398976}
W20260709 12:58:03.073674  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 99065us
I20260709 12:58:03.073834  4458 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:03.005568  4448 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:03.068783  4429 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.397s	user 0.000s	sys 0.001s
I20260709 12:58:03.036939  4441 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.037742  4174 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:03.011456  4206 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:03.038148  4147 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:03.066152  4425 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:03.069908  4450 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:03.090049  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 262078us
I20260709 12:58:03.067369  4338 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:03.097443  2312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.008s	sys 0.027s
W20260709 12:58:03.115669  2312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.008s	sys 0.027s
I20260709 12:58:03.066313  4423 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:03.035070  2341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 385) took 2304 ms. Trace:
I20260709 12:58:03.082647  4443 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:03.084435  4084 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:03.098382  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 354) took 1898 ms. Trace:
I20260709 12:58:03.115484  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:03.116339  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:03.123600  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:03.130985  2347 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:03.089443  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:03.005299  4080 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:58:03.035202  3814 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:03.133466  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 45389.1us
I20260709 12:58:03.075182  4359 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.139070  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:03.139387  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.139631  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.140151  1713 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:03.140698  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:03.141021  1714 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:58:03.141340  1714 pending_rounds.cc:85] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 6
I20260709 12:58:03.141486  1714 pending_rounds.cc:107] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:58:03.141629  1714 raft_consensus.cc:2889] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:03.007534  4444 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.146785  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1524) took 1380 ms. Trace:
I20260709 12:58:03.116947  4450 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.007666  4445 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.252792  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.121410  1566 rpcz_store.cc:276] 0709 12:58:01.185996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.512379 (+326383us) service_pool.cc:224] Handling call
0709 12:58:01.521088 (+  8709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:01.521299 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:02.242768 (+721469us) log.cc:844] Serialized 14 byte log entry
0709 12:58:03.084304 (+841536us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:03.084360 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:03.084410 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.084477 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:03.084591 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10168,"prepare.queue_time_us":187788,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":40,"raft.queue_time_us":229097,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":19292,"thread_start_us":1313205,"threads_started":3,"wal-append.queue_time_us":661950}
W20260709 12:58:03.242352  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 106142us
I20260709 12:58:03.255249  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1523) took 1899 ms. Trace:
I20260709 12:58:03.010823  4116 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:03.164727  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 188586us
I20260709 12:58:03.242727  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:03.115267  4235 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:03.090560  4180 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:58:03.116902  3868 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:03.116765  4174 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:03.252002  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:03.089363  4458 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.255960  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:03.263015  1716 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:03.255662  1717 rpcz_store.cc:276] 0709 12:58:01.356070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.363293 (+  7223us) service_pool.cc:224] Handling call
0709 12:58:01.394097 (+ 30804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:01.437766 (+ 43669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:01.437796 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:01.438324 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:58:01.707126 (+268802us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:01.707162 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:01.707221 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:03.255042 (+1547821us) raft_consensus.cc:1685] finished
0709 12:58:03.255064 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:03.255190 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112856,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":255524,"threads_started":1,"wal-append.queue_time_us":1079286}
W20260709 12:58:03.268254  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 136462us
W20260709 12:58:03.270931  4439 log.cc:927] Time spent T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 12:58:03.143839  4418 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.134641  4343 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:03.134589  4338 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:03.131268  4408 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:03.097461  4441 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.249178  1639 rpcz_store.cc:276] 0709 12:58:01.766121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.766638 (+   517us) service_pool.cc:224] Handling call
0709 12:58:01.789735 (+ 23097us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:01.790195 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:01.790235 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:02.063970 (+273735us) log.cc:844] Serialized 26 byte log entry
0709 12:58:02.860998 (+797028us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:03.146208 (+285210us) log.cc:844] Serialized 14 byte log entry
0709 12:58:03.146491 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.146563 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:03.146600 (+    37us) raft_consensus.cc:1685] finished
0709 12:58:03.146611 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:03.146730 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39592,"raft.queue_time_us":175,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":31615,"thread_start_us":753481,"threads_started":2,"wal-append.queue_time_us":634154}
I20260709 12:58:03.135074  4311 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:03.131079  4328 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:03.282974  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:03.313285  1640 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:03.285305  1712 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:03.255909  1567 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:03.267323  1612 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:03.095376  4448 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.115473  4206 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.255545  4450 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:03.265952  4455 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:03.334064  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:03.303436  1566 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:03.304865  1535 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:03.306432  1571 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:03.321594  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:03.331633  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 64398.5us
I20260709 12:58:03.301153  4343 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.342847  1568 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:03.339577  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:03.337364  1644 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:03.345160  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1525) took 1069 ms. Trace:
I20260709 12:58:03.307655  3868 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:03.346561  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:03.351127  4465 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.351634  4414 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:03.352185  4464 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.352710  4084 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:03.353950  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:03.363528  1640 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
W20260709 12:58:03.354481  2344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 382) took 2624 ms (client timeout 1715 ms). Trace:
I20260709 12:58:03.345518  1721 rpcz_store.cc:276] 0709 12:58:02.275826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:02.298562 (+ 22736us) service_pool.cc:224] Handling call
0709 12:58:02.321158 (+ 22596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:02.580908 (+259750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.336543 (+755635us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400174dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:03.345099 (+  8556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571977600}
W20260709 12:58:03.355397  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50642.1us
I20260709 12:58:03.359851  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:03.284174  4461 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:58:03.373998  1714 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:58:03.365302  2344 rpcz_store.cc:269] 0709 12:58:00.711181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.736719 (+ 25538us) service_pool.cc:224] Handling call
0709 12:58:03.335653 (+2598934us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54004763d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:03.335751 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3557536128}
I20260709 12:58:03.360226  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:03.295981  4235 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:58:03.305771  4418 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.387251  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.387847  1715 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:03.300971  4174 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.389181  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.392217  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.354991  4343 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:03.341765  4286 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.395864  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:03.342796  4453 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:03.394093  1714 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:03.401609  1684 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:03.321916  4408 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.381623  4199 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:03.385464  4080 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:03.407410  1567 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:03.399323  4416 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:03.406419  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:03.418220  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:03.120826  2341 rpcz_store.cc:276] 0709 12:58:00.730897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.731719 (+   822us) service_pool.cc:224] Handling call
0709 12:58:00.732414 (+   695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:00.733097 (+   683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:00.733143 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:01.728879 (+995736us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b2c00021e98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4102da11 00007f6a4103d372 00007f6a4276fa01 00007f6a4273443a 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2
0709 12:58:01.871724 (+142845us) log.cc:844] Serialized 564 byte log entry
0709 12:58:03.004350 (+1132626us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:03.010625 (+  6275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.010735 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:03.010790 (+    55us) raft_consensus.cc:1685] finished
0709 12:58:03.010814 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:03.034961 (+ 24147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31697664,"thread_start_us":727664,"threads_started":1,"wal-append.queue_time_us":1029867}
W20260709 12:58:03.413612  1564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 357) took 1842 ms (client timeout 2013 ms). Trace:
W20260709 12:58:03.419492  1564 rpcz_store.cc:269] 0709 12:58:01.571193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.571918 (+   725us) service_pool.cc:224] Handling call
0709 12:58:03.413361 (+1841443us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b5400133654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:03.413533 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070217472}
I20260709 12:58:03.414323  1565 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:03.416364  1719 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:03.425132  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.429062  1714 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:03.426534  4473 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:03.430370  4473 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.430766  4473 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:03.424090  1568 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:03.341847  4328 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.442034  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.442744  1720 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:03.405640  3868 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.443537  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:03.446666  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:03.385087  4180 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:58:03.443531  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.415438  4199 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:03.445729  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 133986us
I20260709 12:58:03.447420  1721 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:03.447484  1566 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:03.384341  4414 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.384534  4084 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.382114  4465 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.475021  4383 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:03.457336  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:03.622267  1564 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:03.622447  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:03.422804  3814 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:03.508349  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 141345us
I20260709 12:58:03.405579  4286 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:03.510783  4460 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:58:03.511061  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.512717  4472 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:03.384446  4464 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.740007  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:03.453223  2312 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:03.422349  4457 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:03.455679  4199 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:03.455816  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53261.4us
W20260709 12:58:03.513185  4468 log.cc:927] Time spent T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:58:03.547490  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:03.423144  4406 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:03.474582  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:03.547025  4459 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:58:03.440879  4239 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:58:03.621212  4485 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:03.407171  4453 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.423943  4447 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:03.621675  4476 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:58:03.444283  4416 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.621754  4383 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:03.751121  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 297952us
I20260709 12:58:03.582947  4444 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:03.516486  3868 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.755239  1720 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:03.771668  1715 raft_consensus.cc:2393] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 3: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:03.785408  4174 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:03.737630  1612 connection.cc:256] RPC call timeout handler was delayed by -1.6073149630000216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 12:58:03.789947  2315 connection.cc:256] RPC call timeout handler was delayed by -1.1402625199999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:58:03.792811  1712 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
W20260709 12:58:03.853307  1612 connection.cc:256] RPC call timeout handler was delayed by -1.5551149629999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 12:58:03.853669  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4813149629999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 12:58:03.854030  1612 connection.cc:256] RPC call timeout handler was delayed by -1.37061496299998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 12:58:03.854382  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3247149630000195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 12:58:03.854749  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3005359309999562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
I20260709 12:58:03.797044  1686 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:03.834461  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:03.855100  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2501359309999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 12:58:03.855508  1612 connection.cc:256] RPC call timeout handler was delayed by -1.214014963000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 12:58:03.842094  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:03.755540  4445 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:03.737524  4461 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 12:58:03.813763  3973 consensus_meta.cc:287] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.283s	user 0.007s	sys 0.006s
W20260709 12:58:03.856168  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2113149630000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 12:58:03.870114  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2042359309999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:58:03.870638  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1933149629999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 12:58:03.871066  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1108458350000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 12:58:03.871441  1612 connection.cc:256] RPC call timeout handler was delayed by -1.068545835000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 12:58:03.841288  4383 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:03.804414  4406 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:03.872378  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:03.878059  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:03.841065  4311 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.879695  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:03.856350  4484 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:03.876919  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.036s	sys 0.094s
W20260709 12:58:03.899202  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.037s	sys 0.094s
W20260709 12:58:03.899595  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 565553us
I20260709 12:58:03.864972  4443 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:03.903952  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:03.873905  4418 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:03.872828  4174 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:03.926200  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:03.874577  4445 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.928098  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:03.887949  4457 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:03.888118  4444 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:03.905831  3973 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.894634  4408 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:03.970963  4478 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.495s	user 0.001s	sys 0.001s
W20260709 12:58:03.971354  4477 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.451s	user 0.000s	sys 0.001s
W20260709 12:58:03.972908  4483 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:58:03.958204  4328 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:03.974153  4406 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.951288  4481 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.389s
I20260709 12:58:03.957887  4447 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:03.925868  4239 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:03.922669  3814 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:03.951001  4235 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:03.962620  4444 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:03.892185  4311 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.951203  4174 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:04.005101  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 77109.2us
I20260709 12:58:03.908335  4484 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:03.949365  4443 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:04.006042  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 149740us
I20260709 12:58:04.000128  4084 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:03.959836  4445 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:03.993044  3973 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:04.038748  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 288435us
I20260709 12:58:04.184422  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:04.238519  1535 connection.cc:256] RPC call timeout handler was delayed by -1.8166177869999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 12:58:04.138137  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:03.997733  4408 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:04.010349  4457 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:04.035770  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 135460us
I20260709 12:58:04.081127  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:04.038103  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:04.079627  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:04.222014  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 187836us
I20260709 12:58:04.253724  2344 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:04.253924  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:04.256181  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:04.030292  4480 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:04.156407  4496 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 12:58:04.034495  4239 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:04.257285  4408 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.271337  4505 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.271797  4239 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:04.037067  4414 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:04.273485  4276 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:04.272539  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:04.275430  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:04.267829  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:04.155547  4493 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
W20260709 12:58:04.214277  4192 consensus_meta.cc:287] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.630s	user 0.012s	sys 0.000s
I20260709 12:58:04.209746  4488 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:04.017478  4485 raft_consensus.cc:697] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:04.034065  4444 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.271425  4408 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.272064  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:04.156095  4471 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.413s	user 0.000s	sys 0.003s
I20260709 12:58:04.149115  4456 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:04.155866  4482 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.141958  4492 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.180922  4498 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:04.262338  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 465372us
I20260709 12:58:04.275640  2348 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:04.209566  4416 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:04.212523  4410 consensus_meta.cc:287] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.336s	user 0.004s	sys 0.007s
I20260709 12:58:04.282891  2349 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:04.154806  4487 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.213255  4441 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:04.261327  4472 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:04.034089  3814 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:04.272027  4505 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:04.276232  4311 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:04.298534  1643 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
W20260709 12:58:04.575179  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 232086us
I20260709 12:58:04.575299  4498 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:04.576296  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:04.576509  4441 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.577199  4192 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:04.577054  4441 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:04.578119  4343 consensus_meta.cc:287] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.172s	user 0.009s	sys 0.000s
I20260709 12:58:04.348803  4457 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.230s
I20260709 12:58:04.578765  4492 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:04.571355  4485 consensus_queue.cc:237] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:04.579581  4410 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:04.579708  4192 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:04.579061  4441 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:04.564301  4506 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.580547  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:04.562354  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:04.582020  2340 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:04.580561  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:04.373765  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:04.583523  4312 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.757s	user 0.015s	sys 0.000s
W20260709 12:58:04.353982  4199 consensus_meta.cc:287] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 12:58:04.649654  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1959) took 1212 ms. Trace:
I20260709 12:58:04.580338  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:04.593195  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:04.652520  4502 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:58:04.652876  4511 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.374606  4174 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:04.290611  4116 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.406s
I20260709 12:58:04.276113  4480 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:04.277431  4286 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:04.871594  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.019s	sys 0.087s
I20260709 12:58:04.919827  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:04.888518  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:04.926955  2315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.007s	sys 0.014s
W20260709 12:58:04.927906  2315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.007s	sys 0.014s
I20260709 12:58:04.928048  4499 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:04.696820  4492 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:04.926563  1712 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:04.577874  4498 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:04.361630  4483 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:58:04.695418  2346 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:04.927358  4342 consensus_meta.cc:287] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 2.383s	user 0.009s	sys 0.006s
I20260709 12:58:04.710322  1642 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:58:04.930361  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.013s
W20260709 12:58:04.951406  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.006s	sys 0.013s
I20260709 12:58:04.896632  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:04.925238  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.019s	sys 0.088s
W20260709 12:58:04.952569  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 662638us
W20260709 12:58:04.886441  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1532) took 1523 ms (client timeout 1505 ms). Trace:
I20260709 12:58:04.289394  4465 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:04.921162  4452 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.563386  4413 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:04.966333  1537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.005s	sys 0.015s
W20260709 12:58:04.966706  1537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.005s	sys 0.015s
W20260709 12:58:04.966966  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 720299us
I20260709 12:58:04.925943  1718 rpcz_store.cc:276] 0709 12:58:03.437681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.437819 (+   138us) service_pool.cc:224] Handling call
0709 12:58:03.438112 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:03.516445 (+ 78333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:03.516492 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:03.547337 (+ 30845us) log.cc:844] Serialized 26 byte log entry
0709 12:58:03.759075 (+211738us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:03.759122 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.759215 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:04.649382 (+890167us) raft_consensus.cc:1685] finished
0709 12:58:04.649404 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.649560 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":457411,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":35438,"thread_start_us":98107,"threads_started":2,"wal-append.queue_time_us":247540}
W20260709 12:58:04.921942  4510 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 12:58:04.968132  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:04.313082  4464 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:04.277478  4447 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:05.014578  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 61257.6us
W20260709 12:58:05.014058  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.021s	sys 0.036s
I20260709 12:58:04.285187  4504 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:04.570901  3973 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:04.869773  4475 log.cc:927] Time spent T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.816s	user 0.002s	sys 0.002s
W20260709 12:58:04.930298  4239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.005s	sys 0.008s
I20260709 12:58:04.580582  4445 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:04.650422  4277 consensus_queue.cc:1059] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.303s
I20260709 12:58:04.653716  3814 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:04.651237  4487 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:04.955049  1568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1593) took 1829 ms (client timeout 1530 ms). Trace:
I20260709 12:58:04.646683  4307 consensus_queue.cc:1059] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.363s
I20260709 12:58:04.703962  4482 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:04.956502  4458 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:04.935324  4199 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:04.935644  4312 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:04.941565  4511 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:04.958005  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1958) took 1523 ms. Trace:
I20260709 12:58:04.958477  2340 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:04.958905  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1960) took 1519 ms. Trace:
W20260709 12:58:04.953655  1719 rpcz_store.cc:269] 0709 12:58:03.363294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.364266 (+   972us) service_pool.cc:224] Handling call
0709 12:58:04.886209 (+1521943us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54002df854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:04.886348 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49697536}
W20260709 12:58:04.959452  4383 consensus_meta.cc:287] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.071s	user 0.005s	sys 0.001s
W20260709 12:58:04.960460  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 367337us
I20260709 12:58:05.115998  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:05.117460  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:04.696010  4484 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:04.962837  4457 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:04.936264  4473 consensus_meta.cc:287] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.505s	user 0.013s	sys 0.000s
I20260709 12:58:04.583990  4472 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:05.124162  4472 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:05.124579  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:05.126446  4518 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:05.126989  4518 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.127295  4383 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:05.013321  1537 connection.cc:256] RPC call timeout handler was delayed by -1.0753322489999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 12:58:05.016404  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.021s	sys 0.036s
I20260709 12:58:04.928635  4499 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:04.954463  4286 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:04.953058  3868 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:05.129880  4464 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:05.130275  4464 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.130591  4464 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:05.130724  2344 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:05.026787  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:04.311565  4488 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:05.019438  4483 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:05.016438  4338 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:04.647562  4343 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.132836  4465 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:05.133291  4465 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:05.133661  4465 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:05.119728  4457 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:05.134308  4343 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:05.134474  4457 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:05.027854  4239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.005s	sys 0.008s
I20260709 12:58:05.098474  1714 rpcz_store.cc:276] 0709 12:58:03.435036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.435187 (+   151us) service_pool.cc:224] Handling call
0709 12:58:03.435508 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:03.548848 (+113340us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:04.004425 (+455577us) log.cc:844] Serialized 14 byte log entry
0709 12:58:04.497289 (+492864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:04.497358 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:04.497410 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.957778 (+460368us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b54002dda54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:04.957823 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.957950 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123454,"prepare.queue_time_us":484645,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":60722,"raft.queue_time_us":123898,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":20629,"spinlock_wait_cycles":91410176,"thread_start_us":487083,"threads_started":2,"wal-append.queue_time_us":957610}
I20260709 12:58:05.136077  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:05.136137  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:05.037329  1568 rpcz_store.cc:269] 0709 12:58:03.125799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.126003 (+   204us) service_pool.cc:224] Handling call
0709 12:58:04.954885 (+1828882us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b5400094a54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:04.954981 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175185152}
I20260709 12:58:05.022006  4512 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.137576  1641 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:05.137351  4512 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.137749  4518 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:05.139137  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:05.139355  4512 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:04.963907  4342 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:05.016588  4441 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:58:05.070799  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:05.141175  1718 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
W20260709 12:58:05.071594  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 491075us
I20260709 12:58:05.119812  4458 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:04.944789  4506 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.142233  4458 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:04.529304  4443 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.076172  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:05.144167  4458 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:05.145372  1535 connection.cc:256] RPC call timeout handler was delayed by -1.7833177869999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 12:58:05.145886  1535 connection.cc:256] RPC call timeout handler was delayed by -1.367517786999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 12:58:05.084110  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:05.068959  4440 raft_consensus.cc:3055] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:05.007330  4452 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:05.068598  4449 raft_consensus.cc:3055] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:05.121176  1686 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:05.102138  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:05.102252  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:05.150682  1638 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:05.105422  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:05.123390  4473 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.136857  1714 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:05.132855  4338 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.147709  1640 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:05.118654  1647 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:58:05.147877  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.141505  2347 raft_consensus.cc:2368] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8.
I20260709 12:58:05.144522  1644 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:05.101948  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:05.148978  4488 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:05.152341  4512 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:05.154747  4441 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.149228  4440 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:05.110690  4410 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:05.169366  2342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 389) took 1019 ms. Trace:
I20260709 12:58:05.766400  2342 rpcz_store.cc:276] 0709 12:58:04.150060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.150211 (+   151us) service_pool.cc:224] Handling call
0709 12:58:04.150609 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:04.286291 (+135682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:04.286525 (+   234us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:04.311108 (+ 24583us) log.cc:844] Serialized 52 byte log entry
0709 12:58:04.927847 (+616739us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:04.927909 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.929291 (+  1382us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:05.169049 (+239758us) raft_consensus.cc:1685] finished
0709 12:58:05.169075 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:05.169267 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":431925,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":59317,"thread_start_us":243877,"threads_started":2,"wal-append.queue_time_us":628985}
W20260709 12:58:05.237259  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 94542.9us
I20260709 12:58:05.161621  4472 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.771917  4472 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:05.325057  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:05.199549  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 47617.7us
I20260709 12:58:05.773217  1719 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:05.773703  4343 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.774580  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:05.774457  4343 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.776085  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:05.266341  4438 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.777240  4438 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:05.777678  4343 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:05.778602  4343 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.779336  4343 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.780498  4512 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:05.781739  4343 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:05.240885  4450 consensus_meta.cc:287] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.858s	user 0.004s	sys 0.009s
I20260709 12:58:05.783676  4450 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.785202  1639 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:05.149921  4518 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:05.785953  4518 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:05.161118  4505 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:05.156642  4307 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:05.159467  4517 log.cc:927] Time spent T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:58:05.787319  4307 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.787739  4307 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:05.789003  2349 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
W20260709 12:58:05.753222  1645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.001s	sys 0.013s
W20260709 12:58:05.792366  1645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.001s	sys 0.014s
I20260709 12:58:05.794258  4440 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.795517  4440 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:05.171566  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 155553us
I20260709 12:58:05.797338  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:05.799084  4338 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:05.809011  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1537) took 1729 ms. Trace:
I20260709 12:58:05.809486  1717 rpcz_store.cc:276] 0709 12:58:04.079820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.079969 (+   149us) service_pool.cc:224] Handling call
0709 12:58:04.155138 (+ 75169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:04.155619 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:04.155667 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:04.278318 (+122651us) log.cc:844] Serialized 26 byte log entry
0709 12:58:04.951959 (+673641us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:04.952017 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.952100 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:05.808797 (+856697us) raft_consensus.cc:1685] finished
0709 12:58:05.808817 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:05.808944 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24631,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7540,"thread_start_us":598926,"threads_started":1,"wal-append.queue_time_us":698079}
W20260709 12:58:05.312718  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 343175us
W20260709 12:58:05.814584  1686 connection.cc:256] RPC call timeout handler was delayed by -1.2854242969999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:58:05.815027  1686 connection.cc:256] RPC call timeout handler was delayed by -1.2746242969999457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 12:58:05.580754  4199 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:05.820058  1610 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.000s	sys 0.022s
I20260709 12:58:05.507992  2340 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:58:05.804947  1535 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:05.821084  1719 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:03.386673   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:05.820467  1610 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.000s	sys 0.022s
I20260709 12:58:05.783776  4512 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:05.160786  4487 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:05.428637  4474 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.844s	user 0.006s	sys 0.001s
I20260709 12:58:05.117578  1713 rpcz_store.cc:276] 0709 12:58:03.439453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.439585 (+   132us) service_pool.cc:224] Handling call
0709 12:58:03.439920 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:03.444016 (+  4096us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:03.749087 (+305071us) log.cc:844] Serialized 14 byte log entry
0709 12:58:04.162110 (+413023us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:04.162170 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:04.162237 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.958695 (+796458us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b5400276ad4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:04.958741 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.958850 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":515973,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":18192,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6988,"spinlock_wait_cycles":8919808,"thread_start_us":562259,"threads_started":2,"wal-append.queue_time_us":517407,"wal-append.run_cpu_time_us":1532,"wal-append.run_wall_time_us":1282441}
W20260709 12:58:05.824162  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 698581us
I20260709 12:58:05.800544  4506 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:05.840153  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:05.825562  4464 consensus_meta.cc:287] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.692s	user 0.012s	sys 0.000s
I20260709 12:58:05.841948  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:05.848824  1719 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:58:05.812431  4449 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:05.842796  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:05.528509  4520 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.843601  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:05.785961  4450 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:05.817217  4343 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:05.848253  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.808435  4441 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.866907  1610 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:05.825627  4342 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:05.867857  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:05.834262  4505 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:05.833370  4199 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:05.821233  2340 pending_rounds.cc:85] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Aborting all ops after (but not including) 5
I20260709 12:58:05.865336  1713 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
W20260709 12:58:05.886080  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 81190.2us
I20260709 12:58:05.907485  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:05.887799  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:05.867086  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:05.897778  1684 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:05.911016  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:05.913341  1719 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:58:05.913230  1684 connection.cc:256] RPC call timeout handler was delayed by -1.6538886520000347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29550000000000004s for a response
W20260709 12:58:05.896957  4457 consensus_meta.cc:287] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.762s	user 0.003s	sys 0.007s
I20260709 12:58:05.916164  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:05.896011  4342 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:05.920073  2342 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 3.
I20260709 12:58:05.926148  1717 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:05.893158  2340 pending_rounds.cc:107] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 12:58:05.937302  2340 raft_consensus.cc:2917] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
W20260709 12:58:05.936589  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 118004us
I20260709 12:58:05.937997  2340 raft_consensus.cc:2889] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:05.943547  2340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 400) took 1662 ms. Trace:
I20260709 12:58:05.943933  2340 rpcz_store.cc:276] 0709 12:58:04.281089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.950514 (+669425us) service_pool.cc:224] Handling call
0709 12:58:04.958344 (+  7830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.943304 (+984960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.943491 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:05.887274  4239 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:58:05.922545  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:06.024839  4441 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:06.025080  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 102590us
I20260709 12:58:06.026585  4522 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:05.860417  4464 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:05.921545  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 54693.6us
I20260709 12:58:05.913256  4199 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:05.925328  4465 consensus_meta.cc:287] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.000s
I20260709 12:58:05.886441  4343 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:05.964787  4526 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:05.939622  4457 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.939725  4342 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:05.944223  4473 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:05.942982  4527 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:05.910290  4506 consensus_queue.cc:1059] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:58:06.013160  1719 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:05.915011  4341 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:58:05.952677  4449 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:05.917127  4450 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:06.015069  4408 consensus_meta.cc:287] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.366s	user 0.013s	sys 0.002s
I20260709 12:58:06.016426  1535 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:05.930697  4505 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:58:05.921927  4488 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:06.023077  4444 consensus_meta.cc:287] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.355s	user 0.015s	sys 0.000s
I20260709 12:58:06.023620  4485 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.026988  4522 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.864724  4520 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:06.043061  1641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.012s	sys 0.010s
W20260709 12:58:06.042733  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 245475us
I20260709 12:58:06.095291  1717 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
W20260709 12:58:06.450037  1641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.013s	sys 0.018s
I20260709 12:58:06.139621  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:06.451397  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 435037us
I20260709 12:58:06.179833  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.452278  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.168428  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.453369  1571 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:58:06.454041  1567 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:06.454771  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:06.455060  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.462185  1567 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
W20260709 12:58:06.096220  4533 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:58:06.455494  4444 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:06.179721  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.608863  1566 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:06.610059  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:06.139601  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 225740us
W20260709 12:58:06.096239  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44329.6us
I20260709 12:58:06.166749  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.617724  1572 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
W20260709 12:58:06.619232  2312 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.993s (SENT) [suppressed 9 similar messages]
I20260709 12:58:06.463003  4522 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:06.341609  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 315487us
I20260709 12:58:06.649533  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:06.072183  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.650746  1563 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:06.651859  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.169649  4307 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:06.037796  4441 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:06.461390  4360 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:06.458102  4342 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:06.209753  4530 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.180900  4518 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:06.452791  1570 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:06.420590  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:06.461727  4217 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:06.462682  4450 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.330359  4338 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:06.654842  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:06.658532  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.735019  1563 raft_consensus.cc:2410] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:58:06.679664  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:06.678960  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 226814us
I20260709 12:58:06.736465  1567 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:06.737607  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.739964  1719 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 8. Ops: []
I20260709 12:58:06.463260  4408 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:06.054284  4465 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:06.690495  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:06.754419  2342 raft_consensus.cc:2410] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:06.464905  4485 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:06.660171  4360 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:06.748742  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.734098  2340 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 3.
I20260709 12:58:06.753396  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:06.759528  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.762310  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.683548  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.835584  1721 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:58:06.836722  1684 connection.cc:256] RPC call timeout handler was delayed by -1.2064825780000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 12:58:06.879669  1572 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
W20260709 12:58:06.880119  1684 connection.cc:256] RPC call timeout handler was delayed by -1.1272825780000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 12:58:06.844770  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 195310us
I20260709 12:58:06.907075  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:06.907858  1563 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:06.763481  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1597) took 3460 ms. Trace:
I20260709 12:58:06.908396  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:06.909039  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 48275.4us
I20260709 12:58:06.907347  1564 raft_consensus.cc:2393] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:06.909358  1565 rpcz_store.cc:276] 0709 12:58:03.302952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.303134 (+   182us) service_pool.cc:224] Handling call
0709 12:58:03.414107 (+110973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:03.422394 (+  8287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.763325 (+3340931us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b5400133650. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:06.763431 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219478912}
I20260709 12:58:06.767198  1686 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:06.908509  1567 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:06.795830  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.907313  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:06.913281  1647 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:06.914379  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.914966  1563 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:06.692880  4448 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:06.732695  4520 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:06.917173  1564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1606) took 3176 ms (client timeout 1518 ms). Trace:
W20260709 12:58:06.917550  1564 rpcz_store.cc:269] 0709 12:58:03.741225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.741825 (+   600us) service_pool.cc:224] Handling call
0709 12:58:06.748529 (+3006704us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:58:06.917081 (+168552us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5053184}
I20260709 12:58:06.918087  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:06.918852  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 151717us
I20260709 12:58:06.919216  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:06.920562  1645 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:06.740311  4450 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:06.926422  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.008s	sys 0.002s
W20260709 12:58:06.926739  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.008s	sys 0.002s
I20260709 12:58:06.927201  1610 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:06.834141  4545 raft_consensus.cc:3055] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:06.933318  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:06.931066  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:06.824364  4277 raft_consensus.cc:3055] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:06.692421  4239 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:06.941222  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.927470  1686 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:06.935592  4527 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:06.908345  4548 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.690232  4441 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:06.946169  4338 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:06.946345  1571 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:06.946723  4552 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:06.947539  2346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 398) took 2668 ms. Trace:
I20260709 12:58:06.957124  4553 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:06.952946  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:06.961896  4543 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:06.982318  2346 rpcz_store.cc:276] 0709 12:58:04.279310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.279437 (+   127us) service_pool.cc:224] Handling call
0709 12:58:04.279775 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.943570 (+663795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.947269 (+2003699us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54004cbdd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:06.947470 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955264896}
I20260709 12:58:06.965438  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:06.968664  4408 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:06.968828  4464 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:06.969599  4453 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:06.974355  4343 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:06.989351  4552 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:07.011989  4343 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:07.012032  4552 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:06.973975  1568 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.009s	sys 0.018s
W20260709 12:58:07.012858  1568 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.009s	sys 0.018s
I20260709 12:58:06.913394  4457 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:06.971237  4277 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:06.971767  1567 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:06.976524  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:06.980986  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:06.982601  1638 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:06.734654  4530 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:06.989624  4553 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.859439  4206 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:06.947641  4307 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:06.977558  4440 consensus_meta.cc:287] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.181s	user 0.008s	sys 0.006s
W20260709 12:58:07.013917  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 86778.3us
I20260709 12:58:07.012543  4343 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:06.938611  4545 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:07.037547  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 128872us
W20260709 12:58:07.051137  1714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.018s	sys 0.039s
I20260709 12:58:07.056775  1572 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
W20260709 12:58:07.033329  2314 connection.cc:256] RPC call timeout handler was delayed by -1.6899091199999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 12:58:07.057562  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:07.612934  1638 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:07.614154  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:07.056795  1570 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:06.978484  4540 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:07.061489  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:07.609583  1612 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.009s	sys 0.010s
W20260709 12:58:07.615298  1612 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.009s	sys 0.010s
I20260709 12:58:07.063237  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:07.615629  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 521264us
W20260709 12:58:07.073693  4542 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 12:58:07.077205  4277 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:07.051242  4453 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:07.078439  4343 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:06.988170  4360 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:07.082768  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1536) took 1957 ms. Trace:
I20260709 12:58:07.083784  2312 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:07.083464  1647 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:07.085623  4530 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:07.085618  1645 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:07.087152  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:07.097441  1714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.019s	sys 0.040s
I20260709 12:58:07.010238  4543 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:06.980248  4548 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:07.644411  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.007s	sys 0.028s
W20260709 12:58:07.644874  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.028s
I20260709 12:58:07.629547  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:07.645330  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 558215us
I20260709 12:58:07.649055  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1608) took 1581 ms. Trace:
I20260709 12:58:07.649428  1568 rpcz_store.cc:276] 0709 12:58:06.068117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.068256 (+   139us) service_pool.cc:224] Handling call
0709 12:58:06.068547 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:06.068783 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:07.024017 (+955234us) log.cc:844] Serialized 14 byte log entry
0709 12:58:07.648743 (+624726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:07.648794 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:07.648846 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.648910 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:07.649005 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3290,"prepare.queue_time_us":983656,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"thread_start_us":1466305,"threads_started":2}
I20260709 12:58:07.651721  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1545) took 2625 ms. Trace:
I20260709 12:58:07.652498  1714 rpcz_store.cc:276] 0709 12:58:05.026202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.785687 (+759485us) service_pool.cc:224] Handling call
0709 12:58:05.785927 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.786119 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:05.922998 (+136879us) log.cc:844] Serialized 14 byte log entry
0709 12:58:07.648048 (+1725050us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:07.648107 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:07.648163 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.648249 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:07.651647 (+  3398us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51589,"prepare.queue_time_us":236301,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":436598,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":152065,"thread_start_us":1853454,"threads_started":3,"wal-append.queue_time_us":737672}
I20260709 12:58:07.062700  4553 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:07.656080  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:07.628163  1641 rpcz_store.cc:276] 0709 12:58:05.124868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.138415 (+ 13547us) service_pool.cc:224] Handling call
0709 12:58:05.138687 (+   272us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:05.237920 (+ 99233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:05.237965 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:05.293590 (+ 55625us) log.cc:844] Serialized 52 byte log entry
0709 12:58:06.451025 (+1157435us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:06.451074 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.451151 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:07.082483 (+631332us) raft_consensus.cc:1685] finished
0709 12:58:07.082509 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:07.082672 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66073,"raft.queue_time_us":98525,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":991009,"threads_started":1,"wal-append.queue_time_us":1634806}
I20260709 12:58:06.983137  4239 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:07.114078  1566 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:07.104378  1571 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:07.610390  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:07.356554  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 429134us
W20260709 12:58:07.358992  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:07.385385  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 453795us
I20260709 12:58:06.945813  1713 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:07.660614  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:07.665705  1567 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.663228  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1971) took 1840 ms. Trace:
W20260709 12:58:07.354228  4342 consensus_meta.cc:287] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.000s
I20260709 12:58:07.667646  1713 rpcz_store.cc:276] 0709 12:58:05.822684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.945373 (+1122689us) service_pool.cc:224] Handling call
0709 12:58:06.945648 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:07.662631 (+716983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.663019 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:07.673591  1572 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:07.655573  4277 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:07.659049  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.008s	sys 0.007s
W20260709 12:58:07.677979  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.008s	sys 0.007s
W20260709 12:58:07.680933  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.679262  1686 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:07.663877  1569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.006s	sys 0.008s
I20260709 12:58:07.376274  4518 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:07.626318  4505 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.017s	sys 0.021s
I20260709 12:58:07.245426  4444 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:07.623111  4540 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:07.682917  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:07.376073  4180 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:07.675029  4473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.000s	sys 0.013s
W20260709 12:58:07.684480  1569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.006s	sys 0.009s
I20260709 12:58:07.689249  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:07.688221  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:07.691995  1644 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:07.645093  4545 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:07.685171  4505 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.017s	sys 0.021s
I20260709 12:58:07.695365  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1609) took 1626 ms. Trace:
I20260709 12:58:07.713747  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:07.734302  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 650537us
I20260709 12:58:07.747265  2312 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:07.694665  4473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.000s	sys 0.014s
I20260709 12:58:07.684988  4410 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:07.736414  1569 rpcz_store.cc:276] 0709 12:58:06.069182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.069313 (+   131us) service_pool.cc:224] Handling call
0709 12:58:06.069567 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:06.069742 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:06.659552 (+589810us) log.cc:844] Serialized 14 byte log entry
0709 12:58:07.695008 (+1035456us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:07.695063 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:07.695112 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.695191 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:07.695309 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105714,"prepare.queue_time_us":1175157,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":114446,"thread_start_us":1485102,"threads_started":2}
I20260709 12:58:07.670114  4342 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:07.762085  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:07.565855  4527 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:07.763334  1569 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:07.764086  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:07.764655  1572 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.696774  4540 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:07.775439  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:07.737629  4444 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.694466  4360 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.684789  4556 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:07.734894  4560 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:07.737161  4206 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:07.762853  4557 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:58:07.754745  4441 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:07.786513  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.687815  4518 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:07.824064  4543 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:07.824365  4518 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:07.775036  4545 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:07.734231  4180 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:07.767970  4485 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:07.830938  4485 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:07.830997  4342 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:07.831346  4485 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.831768  4485 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:07.832863  4548 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:07.791132  4556 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:07.834020  4239 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:07.834892  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1966) took 2018 ms. Trace:
W20260709 12:58:07.821524  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.819239  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:07.835709  1645 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:07.830402  4180 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:07.836921  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 147754us
W20260709 12:58:07.838569  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.835269  1717 rpcz_store.cc:276] 0709 12:58:05.816300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.461765 (+645465us) service_pool.cc:224] Handling call
0709 12:58:06.462085 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:06.658687 (+196602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:06.658714 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:06.659163 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:58:07.680028 (+1020865us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:07.680069 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.680138 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:07.834692 (+154554us) raft_consensus.cc:1685] finished
0709 12:58:07.834710 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:07.834836 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2845,"raft.queue_time_us":301813,"spinlock_wait_cycles":188862208,"thread_start_us":1211185,"threads_started":2,"wal-append.queue_time_us":1079652}
I20260709 12:58:07.794719  4206 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:07.846617  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 167654us
I20260709 12:58:07.847587  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:07.849141  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:07.890484  1686 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:07.900290  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:07.901371  2342 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:07.911506  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:07.911729  1572 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:07.912140  1568 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:07.912560  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:07.898970  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:07.917342  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:07.925614  1570 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:07.927816  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:07.928965  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1837) took 1014 ms. Trace:
I20260709 12:58:07.929030  1714 raft_consensus.cc:2376] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8. Re-sending same reply.
I20260709 12:58:07.835283  4564 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:07.938808  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:07.939357  1713 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:07.940589  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:07.941519  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:07.941929  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1834) took 1050 ms. Trace:
I20260709 12:58:07.942230  1717 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.942442  1572 rpcz_store.cc:276] 0709 12:58:06.862959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.912351 (+1049392us) service_pool.cc:224] Handling call
0709 12:58:07.913240 (+   889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:07.937783  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:07.889376  4561 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:58:07.944344  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:07.929524  1570 rpcz_store.cc:276] 0709 12:58:06.914967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.930384 (+ 15417us) service_pool.cc:224] Handling call
0709 12:58:07.928894 (+998510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:07.889777  4206 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.947103  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:07.947490  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:07.787566  4444 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:07.971987  1713 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:07.972163  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:07.973698  1716 raft_consensus.cc:2368] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:58:07.898046  4565 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:07.976538  1714 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:07.980536  2342 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:07.983886  1568 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:07.984434  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1618) took 1911 ms. Trace:
I20260709 12:58:07.984736  1568 rpcz_store.cc:276] 0709 12:58:06.072538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.938776 (+1866238us) service_pool.cc:224] Handling call
0709 12:58:07.983604 (+ 44828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:07.984228 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.984386 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:07.794016  4560 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:07.911065  4550 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:07.987366  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:08.019569  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 72155.1us
I20260709 12:58:08.032764  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:08.040551  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 142732us
I20260709 12:58:07.945340  4543 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:08.047228  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:08.049350  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:08.052770  1712 raft_consensus.cc:3055] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:08.101645  1568 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:08.101701  1712 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:07.948690  4575 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:07.944523  4564 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:08.085485  1717 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:08.090965  1647 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:07.945469  4563 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:08.022075  4550 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:08.102850  1712 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:07.990685  4576 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:08.041836  4457 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:08.042276  4473 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:07.986727  4565 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:08.098431  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1621) took 1930 ms. Trace:
I20260709 12:58:08.041631  4410 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:08.106909  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 82307us
I20260709 12:58:08.109704  1712 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:08.113196  1572 rpcz_store.cc:276] 0709 12:58:06.168609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.947182 (+1778573us) service_pool.cc:224] Handling call
0709 12:58:08.020265 (+ 73083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.020513 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:08.020863 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 12:58:08.097976 (+ 77113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:08.098049 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:08.098110 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.098208 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.098356 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":544,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":102,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":7617,"thread_start_us":76630,"threads_started":1}
I20260709 12:58:07.973043  4572 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.160s
W20260709 12:58:08.116357  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.114332  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:08.105252  4239 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:08.130687  4569 log.cc:927] Time spent T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.310s	user 0.000s	sys 0.000s
I20260709 12:58:08.135046  4540 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.109658  2345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 406) took 1194 ms. Trace:
I20260709 12:58:08.110726  4360 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 12:58:08.136930  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:08.519616  2343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 395) took 4267 ms. Trace:
I20260709 12:58:08.523401  4473 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:08.506608  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.524307  1640 raft_consensus.cc:2376] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8. Re-sending same reply.
W20260709 12:58:08.524856  1640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 350) took 1618 ms (client timeout 1946 ms). Trace:
I20260709 12:58:08.524385  4473 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:08.525146  2347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59844 (request call id 542) took 4387 ms (client timeout 1566 ms). Trace:
I20260709 12:58:08.508139  1565 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:08.499864  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.525766  2347 rpcz_store.cc:269] 0709 12:58:04.137643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.137836 (+   193us) service_pool.cc:224] Handling call
0709 12:58:08.524923 (+4387087us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54005e01d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.525050 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047790848}
I20260709 12:58:08.526577  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1628) took 1838 ms. Trace:
I20260709 12:58:08.494406  4465 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:08.434402  4560 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.516484  1564 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:08.249038  1717 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:08.496245  4383 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.487150  3973 raft_consensus.cc:3055] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:08.495946  4423 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:08.278577  4567 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.440s	user 0.000s	sys 0.001s
W20260709 12:58:08.490501  1566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1623) took 2173 ms (client timeout 2026 ms). Trace:
W20260709 12:58:08.432461  4343 consensus_meta.cc:287] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.012s
I20260709 12:58:08.534440  4359 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.534360  4239 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.534924  4343 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.275383  4482 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.536563  4239 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.537022  4343 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:08.529469  3973 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:08.434877  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1629) took 1472 ms (client timeout 1839 ms). Trace:
W20260709 12:58:08.538333  1647 rpcz_store.cc:269] 0709 12:58:06.962263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.655825 (+693562us) service_pool.cc:224] Handling call
0709 12:58:08.434569 (+778744us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b5400337054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.434784 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998434560}
I20260709 12:58:08.538470  3973 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.539652  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.539806  3973 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:08.540238  1647 raft_consensus.cc:2376] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8. Re-sending same reply.
I20260709 12:58:08.541061  4423 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.543107  4423 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:08.447867  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1627) took 1794 ms. Trace:
W20260709 12:58:08.544006  1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 342) took 1677 ms (client timeout 1756 ms). Trace:
I20260709 12:58:08.543902  1563 rpcz_store.cc:276] 0709 12:58:06.653643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.446826 (+1793183us) service_pool.cc:224] Handling call
0709 12:58:08.447198 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.447443 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:08.447484 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:08.447544 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:08.447597 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.447672 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.447796 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:08.544457  1644 rpcz_store.cc:269] 0709 12:58:06.866616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.906799 (+ 40183us) service_pool.cc:224] Handling call
0709 12:58:08.543820 (+1637021us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b5400337554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.543951 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803449088}
I20260709 12:58:08.545428  1563 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:08.545502  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.546088  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1823) took 1808 ms. Trace:
I20260709 12:58:08.546456  1563 rpcz_store.cc:276] 0709 12:58:06.737705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.545002 (+1807297us) service_pool.cc:224] Handling call
0709 12:58:08.545266 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.545839 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.546034 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.546975  4444 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.548400  4556 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.522943  2343 rpcz_store.cc:276] 0709 12:58:04.252383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.252551 (+   168us) service_pool.cc:224] Handling call
0709 12:58:04.262078 (+  9527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.654316 (+392238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:04.654368 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:04.654417 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:04.654459 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.519384 (+3864925us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54004781d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:08.519431 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.519559 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901464832}
I20260709 12:58:08.455001  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1968) took 2638 ms. Trace:
I20260709 12:58:08.566350  1719 rpcz_store.cc:276] 0709 12:58:05.816872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.463396 (+646524us) service_pool.cc:224] Handling call
0709 12:58:06.465676 (+  2280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:06.758602 (+292926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.454701 (+1696099us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400175cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:08.454919 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612899712}
W20260709 12:58:08.450706  1715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 1955) took 5025 ms (client timeout 1804 ms). Trace:
W20260709 12:58:08.567976  1715 rpcz_store.cc:269] 0709 12:58:03.425409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.425536 (+   127us) service_pool.cc:224] Handling call
0709 12:58:08.450460 (+5024924us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54001757d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.450620 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727116544}
W20260709 12:58:08.450161  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1639) took 1485 ms (client timeout 1844 ms). Trace:
W20260709 12:58:08.569628  1645 rpcz_store.cc:269] 0709 12:58:06.964615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.658747 (+694132us) service_pool.cc:224] Handling call
0709 12:58:08.449956 (+791209us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54001d29d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.450086 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325932416}
I20260709 12:58:08.571046  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:08.572018  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1626) took 1639 ms (client timeout 2108 ms). Trace:
W20260709 12:58:08.445922  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1538) took 4365 ms (client timeout 1888 ms). Trace:
I20260709 12:58:08.111759  4575 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:58:08.573308  1721 rpcz_store.cc:269] 0709 12:58:04.080182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.257390 (+177208us) service_pool.cc:224] Handling call
0709 12:58:08.445609 (+4188219us) spinlock_profiling.cc:243] Waited 2.56 s on lock 0x7b5400213254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.445791 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5885822336}
W20260709 12:58:08.477617  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1625) took 5679 ms (client timeout 1906 ms). Trace:
I20260709 12:58:08.573979  4575 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:08.574637  1642 rpcz_store.cc:269] 0709 12:58:02.798187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:02.906549 (+108362us) service_pool.cc:224] Handling call
0709 12:58:08.477349 (+5570800us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54000f82d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.477526 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4145381760}
I20260709 12:58:08.575819  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.576046  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:08.370818  4519 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 3.297s	user 0.025s	sys 0.015s
W20260709 12:58:08.352670  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.577248  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.528417  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1821) took 1791 ms. Trace:
W20260709 12:58:08.473346  4485 consensus_meta.cc:287] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 12:58:08.578298  4485 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.273658  2341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 540) took 4236 ms. Trace:
I20260709 12:58:08.595237  4485 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:08.239985  4566 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.451s	user 0.000s	sys 0.001s
W20260709 12:58:08.596428  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 482134us
W20260709 12:58:08.444787  4450 consensus_meta.cc:287] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.473s	user 0.006s	sys 0.007s
I20260709 12:58:08.598951  4450 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.600265  1646 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:08.602635  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:08.603022  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:08.603538  2347 raft_consensus.cc:2410] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:08.605072  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:08.606987  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1824) took 1869 ms. Trace:
I20260709 12:58:08.607383  1563 rpcz_store.cc:276] 0709 12:58:06.738013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.547175 (+1809162us) service_pool.cc:224] Handling call
0709 12:58:08.592680 (+ 45505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:08.593315 (+   635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:08.593347 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:08.593799 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:58:08.606635 (+ 12836us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:08.606697 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.606771 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.606817 (+    46us) raft_consensus.cc:1685] finished
0709 12:58:08.606828 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.606935 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":12469,"threads_started":1,"wal-append.queue_time_us":10816}
W20260709 12:58:08.608610  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1632) took 1645 ms (client timeout 1606 ms). Trace:
I20260709 12:58:08.609192  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:08.609091  1646 rpcz_store.cc:269] 0709 12:58:06.962999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.010197 (+ 47198us) service_pool.cc:224] Handling call
0709 12:58:08.608422 (+1598225us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54001c4654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.608541 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264556928}
I20260709 12:58:08.610388  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.601661  4450 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:08.611312  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1637) took 1647 ms (client timeout 2124 ms). Trace:
W20260709 12:58:08.611770  1646 rpcz_store.cc:269] 0709 12:58:06.964191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.610116 (+1645925us) service_pool.cc:224] Handling call
0709 12:58:08.611255 (+  1139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.613056  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:08.614076  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1651) took 1535 ms (client timeout 2012 ms). Trace:
I20260709 12:58:08.608441  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:08.614562  1646 rpcz_store.cc:269] 0709 12:58:07.078831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.612701 (+1533870us) service_pool.cc:224] Handling call
0709 12:58:08.614004 (+  1303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.615558  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.420542  4572 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.657843  4572 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:08.112455  4550 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:08.659662  1644 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:08.109791  4584 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:08.660979  1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 352) took 1731 ms (client timeout 2096 ms). Trace:
I20260709 12:58:08.660936  4584 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:08.661584  1644 rpcz_store.cc:269] 0709 12:58:06.929098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.545295 (+1616197us) service_pool.cc:224] Handling call
0709 12:58:08.660734 (+115439us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001b5dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.660906 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260445952}
I20260709 12:58:08.663106  4584 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.107388  4564 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:08.525182  1640 rpcz_store.cc:269] 0709 12:58:06.906811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.506310 (+1599499us) service_pool.cc:224] Handling call
0709 12:58:08.524802 (+ 18492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.664489  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.665261  1640 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
W20260709 12:58:08.665827  1640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1633) took 1702 ms (client timeout 2228 ms). Trace:
W20260709 12:58:08.666236  1640 rpcz_store.cc:269] 0709 12:58:06.963204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.664193 (+1700989us) service_pool.cc:224] Handling call
0709 12:58:08.665752 (+  1559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.667285  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.668004  1640 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:08.669588  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:08.385666  1569 consensus_meta.cc:287] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.000s
I20260709 12:58:08.671150  1569 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
W20260709 12:58:08.215092  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.300614  1567 consensus_meta.cc:287] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.001s
I20260709 12:58:08.673662  1567 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
W20260709 12:58:08.673921  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.674198  1567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1836) took 1763 ms (client timeout 2051 ms). Trace:
W20260709 12:58:08.674569  1567 rpcz_store.cc:269] 0709 12:58:06.911256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.645747 (+734491us) service_pool.cc:224] Handling call
0709 12:58:08.674145 (+1028398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.112799  4563 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.577836  1564 rpcz_store.cc:276] 0709 12:58:06.737070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.515860 (+1778790us) service_pool.cc:224] Handling call
0709 12:58:08.516242 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.528197 (+ 11955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.528357 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.107656  4574 raft_consensus.cc:2764] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:58:08.433588  4580 log.cc:927] Time spent T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:58:08.371258  4438 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.143447  4573 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.447s
W20260709 12:58:08.449156  4553 consensus_meta.cc:287] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.794s	user 0.009s	sys 0.011s
I20260709 12:58:08.403296  4206 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.702848  4206 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.526919  1565 rpcz_store.cc:276] 0709 12:58:06.688297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.507316 (+1819019us) service_pool.cc:224] Handling call
0709 12:58:08.507692 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.526309 (+ 18617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.526525 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.704756  4563 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:08.435127  4585 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:58:08.321789  4583 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.586187  4199 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:08.705415  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 369) took 1019 ms. Trace:
I20260709 12:58:08.117040  4410 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.705811  1565 rpcz_store.cc:276] 0709 12:58:07.686499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.704534 (+1018035us) service_pool.cc:224] Handling call
0709 12:58:08.704894 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.705082 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:08.705105 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:08.705152 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:08.705186 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.705239 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.705357 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:08.483006  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1624) took 2136 ms (client timeout 1638 ms). Trace:
W20260709 12:58:08.688380  4453 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.021s	sys 0.049s
I20260709 12:58:08.588622  4481 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.586215  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1622) took 2382 ms. Trace:
I20260709 12:58:08.712885  4481 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.713168  1570 rpcz_store.cc:276] 0709 12:58:06.204365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.967166 (+1762801us) service_pool.cc:224] Handling call
0709 12:58:07.967590 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:07.982371 (+ 14781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:07.982400 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:08.044957 (+ 62557us) log.cc:844] Serialized 52 byte log entry
0709 12:58:08.345815 (+300858us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:08.415987 (+ 70172us) log.cc:844] Serialized 14 byte log entry
0709 12:58:08.416746 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.416860 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.545519 (+128659us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b180009b9e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:08.585930 (+ 40411us) raft_consensus.cc:1685] finished
0709 12:58:08.586021 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.586156 (+   135us) inbound_call.cc:177] Queueing success response
0709 12:58:08.591434 (+  5278us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b180009b9e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
Metrics: {"mutex_wait_us":5652,"prepare.queue_time_us":71741,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":14760,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":57341,"spinlock_wait_cycles":133334144,"thread_start_us":252416,"threads_started":1,"wal-append.queue_time_us":366674}
I20260709 12:58:08.715111  4481 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:08.589298  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.590478  4312 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.590369  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.580354  4449 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.687212  4584 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:08.591478  4589 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.732533  4589 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:08.591919  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 351) took 1674 ms (client timeout 1993 ms). Trace:
W20260709 12:58:08.733951  1647 rpcz_store.cc:269] 0709 12:58:06.917724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.539403 (+1621679us) service_pool.cc:224] Handling call
0709 12:58:08.591856 (+ 52453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.734889  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.578308  4527 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:08.592195  1639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1527) took 3536 ms (client timeout 1505 ms). Trace:
I20260709 12:58:08.522394  1572 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:08.274798  4511 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:08.352752  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:08.735646  1639 rpcz_store.cc:269] 0709 12:58:05.055483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.073050 (+ 17567us) service_pool.cc:224] Handling call
0709 12:58:08.591956 (+3518906us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54001b62d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.592097 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459657088}
W20260709 12:58:08.736477  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 383890us
I20260709 12:58:08.736810  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.738492  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:08.200620  4147 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:08.602450  4342 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:08.739670  4147 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.603580  1612 leader_election.cc:400] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:58:08.740856  1612 leader_election.cc:403] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:58:08.741303  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 137885us
I20260709 12:58:08.742801  4452 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:08.112306  4576 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.743398  4576 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:08.289891  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.744807  4342 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:08.745141  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.456430  4545 consensus_meta.cc:287] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.631s	user 0.014s	sys 0.003s
I20260709 12:58:08.617077  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1831) took 1872 ms. Trace:
I20260709 12:58:08.747200  1563 rpcz_store.cc:276] 0709 12:58:06.745286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.609078 (+1863792us) service_pool.cc:224] Handling call
0709 12:58:08.609399 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:08.609980 (+   581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:08.610012 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:08.610457 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:58:08.614797 (+  4340us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:08.614841 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.614910 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.616868 (+  1958us) raft_consensus.cc:1685] finished
0709 12:58:08.616885 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.617021 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":3870,"threads_started":1,"wal-append.queue_time_us":4673}
I20260709 12:58:08.618171  1467 catalog_manager.cc:5697] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 2 to 5, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:08.748864  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.749617  1717 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:08.749910  1467 catalog_manager.cc:5697] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
W20260709 12:58:08.579401  2312 leader_election.cc:336] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.946s (SENT)
I20260709 12:58:08.594715  2341 rpcz_store.cc:276] 0709 12:58:04.037350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.082165 (+ 44815us) service_pool.cc:224] Handling call
0709 12:58:04.209199 (+127034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:04.929667 (+720468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:04.936086 (+  6419us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:05.033913 (+ 97827us) log.cc:844] Serialized 26 byte log entry
0709 12:58:05.563956 (+530043us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:05.570650 (+  6694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.273237 (+2702587us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b540007e9d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:08.273292 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.273342 (+    50us) raft_consensus.cc:1685] finished
0709 12:58:08.273352 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.273564 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8957,"raft.queue_time_us":13059,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9884,"spinlock_wait_cycles":1192506240,"thread_start_us":395322,"threads_started":1,"wal-append.queue_time_us":825693,"wal-append.run_cpu_time_us":2071,"wal-append.run_wall_time_us":1113173}
I20260709 12:58:08.503218  4341 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:08.534269  1566 rpcz_store.cc:269] 0709 12:58:06.316966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.609751 (+292785us) service_pool.cc:224] Handling call
0709 12:58:08.490271 (+1880520us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400312ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.490412 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157397248}
W20260709 12:58:08.572460  1645 rpcz_store.cc:269] 0709 12:58:06.932413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.570682 (+1638269us) service_pool.cc:224] Handling call
0709 12:58:08.571924 (+  1242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.637969  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.640144  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:08.641369  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.645031  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.645463  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:08.532119  1537 connection.cc:256] RPC call timeout handler was delayed by -1.666878392000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 12:58:08.650308  4336 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:08.767259  1537 connection.cc:256] RPC call timeout handler was delayed by -1.5993783920000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 12:58:08.757196  1720 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:08.418519  2348 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:08.265843  1712 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:58:08.768347  1712 pending_rounds.cc:85] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 7
I20260709 12:58:08.768604  1712 pending_rounds.cc:107] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:58:08.768913  1712 raft_consensus.cc:2889] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:08.769085  1721 raft_consensus.cc:2410] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:58:08.653479  1535 connection.cc:256] RPC call timeout handler was delayed by -2.0135081480000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 12:58:08.245434  1568 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:08.769858  1718 raft_consensus.cc:2393] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 4: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:58:08.654173  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.042s
W20260709 12:58:08.770325  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.000s	sys 0.042s
W20260709 12:58:08.769681  1535 connection.cc:256] RPC call timeout handler was delayed by -1.8704081480000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 12:58:08.655467  4505 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:08.656080  4276 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.801891  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.656594  4461 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:08.519143  4499 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:08.676034  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:08.668525  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1642) took 1614 ms. Trace:
I20260709 12:58:08.809755  1640 rpcz_store.cc:276] 0709 12:58:07.054682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.667009 (+1612327us) service_pool.cc:224] Handling call
0709 12:58:08.668465 (+  1456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.810915  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.680897  1646 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:08.114952  4565 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:08.276918  4522 consensus_meta.cc:287] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.584s	user 0.000s	sys 0.011s
W20260709 12:58:08.274793  4552 consensus_meta.cc:287] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.262s	user 0.009s	sys 0.000s
W20260709 12:58:08.817373  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1649) took 1739 ms (client timeout 2026 ms). Trace:
I20260709 12:58:08.272784  4582 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:08.694501  1564 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:08.696576  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:08.697078  4553 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.698753  2346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 549) took 1047 ms. Trace:
I20260709 12:58:08.700289  4572 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.707576  1644 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
W20260709 12:58:08.455809  1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1620) took 5674 ms (client timeout 2955 ms). Trace:
W20260709 12:58:08.706951  1571 rpcz_store.cc:269] 0709 12:58:06.346292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.454401 (+108109us) service_pool.cc:224] Handling call
0709 12:58:08.482772 (+2028371us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b5400134554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.482910 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115053312}
I20260709 12:58:08.710906  4410 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.705780  4583 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.716004  1713 raft_consensus.cc:2410] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:58:08.831701  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.278010  4480 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:08.832376  1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1630) took 1869 ms (client timeout 2204 ms). Trace:
W20260709 12:58:08.590524  1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1641) took 1574 ms (client timeout 2056 ms). Trace:
W20260709 12:58:08.832839  1641 rpcz_store.cc:269] 0709 12:58:07.016519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.575817 (+1559298us) service_pool.cc:224] Handling call
0709 12:58:08.590461 (+ 14644us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:08.832738  1644 rpcz_store.cc:269] 0709 12:58:06.962531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.663410 (+1700879us) service_pool.cc:224] Handling call
0709 12:58:08.832224 (+168814us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b5400209ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.832322 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84734848}
I20260709 12:58:08.125456  4457 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:08.709971  4453 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.021s	sys 0.049s
I20260709 12:58:08.723050  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 371) took 1034 ms. Trace:
W20260709 12:58:08.726745  1470 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 234) took 28397 ms (client timeout 15000 ms). Trace:
I20260709 12:58:08.730752  1638 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:08.750422  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.712796  4540 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:08.751471  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 172100us
I20260709 12:58:08.625481  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:08.735666  4527 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.754238  4575 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:58:08.722990  4543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.006s	sys 0.012s
W20260709 12:58:08.852835  4543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.007s	sys 0.013s
I20260709 12:58:08.853113  4543 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:08.853294  1638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1653) took 1774 ms (client timeout 1545 ms). Trace:
I20260709 12:58:08.853991  4543 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.856259  1720 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:08.856868  4575 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:08.857195  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.857849  1720 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:58:08.857800  4575 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.812567  4505 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.861903  4457 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.863644  4527 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.864025  4505 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:08.800400  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.864530  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:08.865111  1720 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:08.865345  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.865720  4147 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:08.866048  1712 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:08.866888  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.867801  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.867882  4589 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:08.770789  1535 connection.cc:256] RPC call timeout handler was delayed by -1.8389081479999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:58:08.868810  1535 connection.cc:256] RPC call timeout handler was delayed by -1.6688081479999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 12:58:08.869150  1535 connection.cc:256] RPC call timeout handler was delayed by -1.6175081480000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:58:08.869422  1535 connection.cc:256] RPC call timeout handler was delayed by -1.5914081480000277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 12:58:08.869678  1535 connection.cc:256] RPC call timeout handler was delayed by -1.4195081479999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
I20260709 12:58:08.870522  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:08.871703  1720 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:08.802971  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.803781  1467 catalog_manager.cc:5697] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 4, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:08.805778  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.807307  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:08.777230  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:08.773263  4336 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.823167  4552 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.814005  1640 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:08.815950  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:08.884807  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:08.884517  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:08.817227  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1647) took 1739 ms. Trace:
I20260709 12:58:08.900384  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1659) took 1061 ms. Trace:
I20260709 12:58:08.818230  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1839) took 1838 ms. Trace:
W20260709 12:58:08.818858  1646 rpcz_store.cc:269] 0709 12:58:07.078266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.615269 (+1537003us) service_pool.cc:224] Handling call
0709 12:58:08.817310 (+202041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.821765  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.901289  1564 rpcz_store.cc:276] 0709 12:58:06.991745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.688750 (+1697005us) service_pool.cc:224] Handling call
0709 12:58:08.694180 (+  5430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.817965 (+123785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.818171 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.901942  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1658) took 1063 ms. Trace:
I20260709 12:58:08.822587  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:08.823734  1610 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59258 dropped due to backpressure: service queue is full with 50 items [suppressed 6 similar messages]
I20260709 12:58:08.902367  1721 raft_consensus.cc:2368] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4.
I20260709 12:58:08.902292  1717 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:08.773526  4574 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:08.900729  1611 rpcz_store.cc:276] 0709 12:58:07.077738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.817168 (+1739430us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:58:08.767622  4438 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:08.774904  4312 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:08.758826  4341 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.823570  2346 rpcz_store.cc:276] 0709 12:58:07.651193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.651325 (+   132us) service_pool.cc:224] Handling call
0709 12:58:07.675670 (+ 24345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:07.782037 (+106367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:07.782070 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:07.829532 (+ 47462us) log.cc:844] Serialized 52 byte log entry
0709 12:58:08.093031 (+263499us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:08.093073 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.093142 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.698519 (+605377us) raft_consensus.cc:1685] finished
0709 12:58:08.698543 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.698681 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43600,"raft.queue_time_us":158756,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":53165,"thread_start_us":356327,"threads_started":2,"wal-append.queue_time_us":358819}
W20260709 12:58:08.826264  1643 rpcz_store.cc:269] 0709 12:58:02.781301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:02.795396 (+ 14095us) service_pool.cc:224] Handling call
0709 12:58:08.455534 (+5660138us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540040c9d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.455676 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3342594432}
I20260709 12:58:08.825799  4590 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:08.913946  1467 catalog_manager.cc:5697] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 6, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:08.915928  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.917338  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.918090  1721 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:58:08.759148  4563 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:58:08.839725  1565 rpcz_store.cc:276] 0709 12:58:07.688258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.706857 (+1018599us) service_pool.cc:224] Handling call
0709 12:58:08.722608 (+ 15751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.722770 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:08.722796 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:08.722833 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:08.722863 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.722913 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.723000 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.841092  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:08.920482  1641 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:08.808727  4276 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.842235  1647 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:08.843885  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:08.842896  4453 raft_consensus.cc:697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:08.817939  4551 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:08.820407  4522 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:08.813422  4461 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:08.899987  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 84125.3us
I20260709 12:58:08.902311  1645 rpcz_store.cc:276] 0709 12:58:07.838589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.806657 (+968068us) service_pool.cc:224] Handling call
0709 12:58:08.901886 (+ 95229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:08.903792  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 131593us
I20260709 12:58:08.902568  1718 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:08.906445  4589 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:08.900802  1640 rpcz_store.cc:276] 0709 12:58:07.838892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.810614 (+971722us) service_pool.cc:224] Handling call
0709 12:58:08.900324 (+ 89710us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:08.839828  1470 rpcz_store.cc:269] 0709 12:57:40.338264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.345765 (+  7501us) service_pool.cc:224] Handling call
0709 12:58:08.726532 (+28380767us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:59.422956 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:59.488018 (+ 65062us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:59.489869 (+  1851us) write_op.cc:435] Acquired schema lock
0709 12:57:59.491480 (+  1611us) tablet.cc:662] Decoding operations
0709 12:57:59.527589 (+ 36109us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:59.527665 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:59.527704 (+    39us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:57:59.528551 (+   847us) tablet.cc:701] Row locks acquired
0709 12:57:59.528570 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:57:59.528771 (+   201us) write_op.cc:270] Start()
0709 12:57:59.528904 (+   133us) write_op.cc:276] Timestamp: P: 1783601879528714 usec, L: 0
0709 12:57:59.528927 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:57:59.529776 (+   849us) log.cc:844] Serialized 3238 byte log entry
0709 12:58:00.077734 (+547958us) op_driver.cc:464] REPLICATION: finished
0709 12:58:00.210290 (+132556us) write_op.cc:301] APPLY: starting
0709 12:58:00.210438 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:00.210747 (+   309us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:00.216032 (+  5285us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:00.217409 (+  1377us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:00.217765 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:58:00.217822 (+    57us) write_op.cc:312] APPLY: finished
0709 12:58:00.218287 (+   465us) log.cc:844] Serialized 65 byte log entry
0709 12:58:00.235583 (+ 17296us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:00.235878 (+   295us) write_op.cc:454] Released schema lock
0709 12:58:00.235961 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:00.236570 (+   609us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:00.236606 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42485,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":132209,"apply.run_cpu_time_us":4393,"apply.run_wall_time_us":26250,"num_ops":8,"prepare.queue_time_us":375475,"prepare.run_cpu_time_us":12061,"prepare.run_wall_time_us":448077,"raft.queue_time_us":145894,"raft.run_cpu_time_us":20235,"raft.run_wall_time_us":79015,"replication_time_us":548535,"thread_start_us":503686,"threads_started":4,"wal-append.queue_time_us":295805,"wal-append.run_cpu_time_us":26155,"wal-append.run_wall_time_us":1385263}]]}
I20260709 12:58:08.905678  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:08.912421  4544 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:08.883589  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:08.940964  2343 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:08.653386  2345 rpcz_store.cc:276] 0709 12:58:06.909960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:06.914205 (+  4245us) service_pool.cc:224] Handling call
0709 12:58:06.917411 (+  3206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:06.941012 (+ 23601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:06.941051 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:06.941600 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:58:07.085108 (+143508us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:07.085160 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.085230 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.053347 (+968117us) raft_consensus.cc:1685] finished
0709 12:58:08.060854 (+  7507us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.100935 (+ 40081us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29143,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":124409,"threads_started":1,"wal-append.queue_time_us":734488}
W20260709 12:58:08.853708  1638 rpcz_store.cc:269] 0709 12:58:07.079335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.613850 (+534515us) service_pool.cc:224] Handling call
0709 12:58:08.853116 (+1239266us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001d33d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:08.853229 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2566329088}
I20260709 12:58:08.832271  1713 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:08.941741  1717 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
W20260709 12:58:08.920946  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 152450us
I20260709 12:58:08.942860  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:08.943161  1537 connection.cc:256] RPC call timeout handler was delayed by -1.3509783920000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.231s for a response
W20260709 12:58:08.943689  1537 connection.cc:256] RPC call timeout handler was delayed by -1.2688301349999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 12:58:08.921216  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:08.944082  1537 connection.cc:256] RPC call timeout handler was delayed by -1.2130301349999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 12:58:08.872498  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:08.885262  4601 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:58:08.753023  4584 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.923280  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:08.947486  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1638) took 1983 ms (client timeout 2640 ms). Trace:
W20260709 12:58:08.947871  1646 rpcz_store.cc:269] 0709 12:58:06.964387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.901524 (+1937137us) service_pool.cc:224] Handling call
0709 12:58:08.947430 (+ 45906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:08.873931  4527 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.925911  1467 catalog_manager.cc:5697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:08.923724  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:08.924160  1716 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:08.951673  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.952309  1718 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:58:08.883431  4553 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.935029  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:08.872552  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:08.754637  4511 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.937268  1712 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:08.902506  1610 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59258 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1652)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1662)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1657)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1640)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1648)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672)
W20260709 12:58:08.944499  1537 connection.cc:256] RPC call timeout handler was delayed by -1.1673783919999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2514s for a response
I20260709 12:58:08.842020  4550 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:08.957926  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 85415.7us
I20260709 12:58:08.966012  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:08.961969  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:08.962505  1714 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:58:08.966814  1537 connection.cc:256] RPC call timeout handler was delayed by -1.0557838670000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 12:58:08.969416  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:08.970713  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:08.971765  4410 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:08.972838  1467 catalog_manager.cc:5697] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:08.974241  1467 catalog_manager.cc:5697] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 3 to 5, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 5 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:08.975662  1467 catalog_manager.cc:5697] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 4 to 5, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:08.978538  4550 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:08.941071  4551 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.980325  4336 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.969066  4511 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.981114  4336 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:08.981603  4336 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.982002  4336 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.982798  4511 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:08.989151  1715 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:08.989224  4461 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:08.990752  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:08.921667  4590 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.920369  4438 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:08.993202  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:08.998915  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.009724  1571 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:08.999188  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.010383  1572 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.024670   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:09.000877  1712 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:09.004189  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.033216  1641 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:09.033895  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1664) took 1189 ms. Trace:
I20260709 12:58:08.947239  4589 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:09.034196  1641 rpcz_store.cc:276] 0709 12:58:07.844543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.840844 (+996301us) service_pool.cc:224] Handling call
0709 12:58:09.033835 (+192991us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:09.034724  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1644) took 1957 ms (client timeout 2179 ms). Trace:
I20260709 12:58:09.042717  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.046340  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.046957  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.047032  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.047288  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.047806  1564 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:09.048353  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:09.047065  1720 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:09.049556  1563 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:09.042991  1647 rpcz_store.cc:269] 0709 12:58:07.076938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.734659 (+1657721us) service_pool.cc:224] Handling call
0709 12:58:09.034546 (+299887us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540028ffd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:09.034666 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245178240}
I20260709 12:58:09.037016  1713 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:09.037792  1467 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:09.040802  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 71444.3us
I20260709 12:58:09.063838  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:08.956279  4544 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:09.066144  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.067088  1643 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:58:08.923306  4574 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.001840  4505 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:09.072407  1467 catalog_manager.cc:5697] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.057197  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.077677  1714 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:08.962378  4582 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:09.054811  1566 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:09.047863  1570 raft_consensus.cc:2393] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:09.065201  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.069342  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.079277  1718 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:09.056708  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:09.032931  4461 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:09.080212  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.080859  1716 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:09.079334  1721 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
W20260709 12:58:09.083310  1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1652) took 2004 ms (client timeout 2535 ms). Trace:
I20260709 12:58:09.083447  2314 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:09.083693  1643 rpcz_store.cc:269] 0709 12:58:07.079086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.003467 (+1924381us) service_pool.cc:224] Handling call
0709 12:58:09.083253 (+ 79786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.091110  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.091531  1720 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:09.080440  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:09.092823  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.093529  1563 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:09.093613  1612 leader_election.cc:400] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 3. Current term is 4.
I20260709 12:58:09.094445  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:08.992712  4540 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:58:09.099041  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:09.055299  4514 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:09.056088  4342 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:58:09.099881  1721 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:09.122663  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.121199  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.101471  1467 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 4 to 6, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:09.001335  4457 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
W20260709 12:58:09.114392  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.114627  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.124922  1568 raft_consensus.cc:2376] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7. Re-sending same reply.
I20260709 12:58:09.125154  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1835) took 2227 ms. Trace:
I20260709 12:58:09.120455  1572 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:09.123047  1564 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:09.125524  1567 rpcz_store.cc:276] 0709 12:58:06.897596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.675191 (+1777595us) service_pool.cc:224] Handling call
0709 12:58:08.675437 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.675609 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:08.675858 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 12:58:09.124845 (+448987us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:09.124894 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:09.124944 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:09.125007 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:09.125105 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":105693,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":442863,"threads_started":2,"wal-append.queue_time_us":160277}
I20260709 12:58:09.127209  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.128837  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:09.129386  1718 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:09.123960  1571 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:09.076481  4505 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:09.136863  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.099817  4553 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:09.135283  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.141647  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.142704  1571 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:09.134943  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.104547  4386 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEARNER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:09.092211  4461 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:09.033246  4564 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.144409  1572 raft_consensus.cc:2393] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:08.990746  4453 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.145779  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.115196  4572 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:09.069496  4423 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:58:09.100492  4206 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:09.148854  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:09.115028  4583 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:09.152951  1537 leader_election.cc:336] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.505s (SENT)
I20260709 12:58:09.122560  4582 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:09.202155  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 48367us
W20260709 12:58:09.278338  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 125425us
W20260709 12:58:09.155164  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:09.168721  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:09.254155  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.284351  2314 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:09.279680  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 130890us
I20260709 12:58:09.286281  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:09.286463  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:09.149523  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:09.270483  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 267203us
I20260709 12:58:09.277948  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:09.290001  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.296936  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.297721  1570 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:09.140699  4505 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:09.341961  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44017.8us
I20260709 12:58:09.340248  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.155063  4461 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:09.156399  4342 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:09.262398  4522 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:09.139652  4547 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:09.140170  4551 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:09.249025  4276 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:09.149531  1467 catalog_manager.cc:5697] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 3 to 5, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:09.289695  4543 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:09.248605  4552 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:09.268446  4584 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:09.372313  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:09.373060  1718 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:09.228132  4341 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:09.294044  4386 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:09.369061  4547 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:09.382164  4386 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:09.382696  4386 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:09.382920  4547 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:09.294379  4507 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:58:09.384596  1467 catalog_manager.cc:5697] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 4 to 7, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.146158  4553 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:09.154781  4480 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.210s
I20260709 12:58:09.371236  1717 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:09.282681  4582 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:09.339591  4337 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:09.179158  4457 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:09.365379  4590 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:09.213209  4544 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.376184  4438 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:09.377779  4564 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:09.381054  4522 consensus_queue.cc:1059] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:09.213011  4589 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.385818  4507 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:09.435448  1718 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:09.140100  2345 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:09.225630  4575 consensus_queue.cc:1059] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
I20260709 12:58:09.353085  4583 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:09.413762  4574 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:09.357657  4342 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:09.390969  4553 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:09.416929  2343 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 4.
I20260709 12:58:09.370157  4540 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:58:09.409408  4582 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:09.394805  4543 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:09.436729  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:09.439371  1684 leader_election.cc:336] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.518s (SENT)
I20260709 12:58:09.416186  4457 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.413025  4337 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:09.469970  4605 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:09.471627  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1833) took 2628 ms. Trace:
I20260709 12:58:09.473667  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.474771  1718 raft_consensus.cc:2393] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 5: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:09.471987  1569 rpcz_store.cc:276] 0709 12:58:06.843232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.672240 (+1829008us) service_pool.cc:224] Handling call
0709 12:58:08.672932 (+   692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:08.879463 (+206531us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:08.879890 (+   427us) log.cc:844] Serialized 14 byte log entry
0709 12:58:08.947534 (+ 67644us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:08.955192 (+  7658us) log.cc:844] Serialized 26 byte log entry
0709 12:58:08.955339 (+   147us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:08.955371 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:09.033987 (+ 78616us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400113d54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:09.034033 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:09.471357 (+437324us) raft_consensus.cc:1685] finished
0709 12:58:09.471450 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:09.471570 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":850,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":32774,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":18669,"spinlock_wait_cycles":473963776,"thread_start_us":66768,"threads_started":1,"wal-append.queue_time_us":460550}
I20260709 12:58:09.398763  1467 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 4 to 6, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:09.427830  4612 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.432884  4507 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:09.449471  4449 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:09.458442  4312 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.410296  4608 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:58:09.441978  4583 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:09.439764  4410 raft_consensus.cc:3055] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:09.461568  1684 leader_election.cc:336] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.606s (SENT)
I20260709 12:58:09.489166  1684 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:08.907310  1611 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59258 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1662)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1657)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1640)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1648)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672)
I20260709 12:58:09.469296  4337 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:09.446097  4575 raft_consensus.cc:3055] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:09.495620  1467 catalog_manager.cc:5697] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.497404  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.473073  4457 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:09.500530  1467 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 5 to 7, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 7 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:09.485666  4449 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:09.493060  4583 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:09.519174  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:09.519964  1647 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.485868  4312 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.511938  1467 catalog_manager.cc:5697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 3 to 4, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:09.495589  4574 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:09.494560  4410 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:09.505658  4336 consensus_meta.cc:287] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 12:58:09.497359  4575 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:09.533650  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.534860  1718 raft_consensus.cc:2410] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:09.542141  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.542898  1645 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:09.536886  1611 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59258 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1648)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1677)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1680)
I20260709 12:58:09.544102  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:09.527558  4576 consensus_meta.cc:287] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.784s	user 0.010s	sys 0.003s
I20260709 12:58:09.545441  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.547142  1646 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
W20260709 12:58:09.547377  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1657) took 1709 ms (client timeout 1906 ms). Trace:
I20260709 12:58:09.549280  1718 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:58:09.549527  1645 rpcz_store.cc:269] 0709 12:58:07.838256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.514072 (+1675816us) service_pool.cc:224] Handling call
0709 12:58:09.547306 (+ 33234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:09.549284  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1661) took 1705 ms (client timeout 1804 ms). Trace:
W20260709 12:58:09.550977  1646 rpcz_store.cc:269] 0709 12:58:07.843683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.518580 (+1674897us) service_pool.cc:224] Handling call
0709 12:58:09.549214 (+ 30634us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.555665  1647 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
W20260709 12:58:09.556335  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1660) took 1713 ms (client timeout 1816 ms). Trace:
W20260709 12:58:09.556766  1647 rpcz_store.cc:269] 0709 12:58:07.843401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.518853 (+1675452us) service_pool.cc:224] Handling call
0709 12:58:09.556270 (+ 37417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.557811  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.573283  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.486117  4612 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:09.579574  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 227316us
I20260709 12:58:09.576025  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:58:09.579663  1467 catalog_manager.cc:5697] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 4, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.580804  1718 raft_consensus.cc:606] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:09.581143  1718 raft_consensus.cc:614] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:09.575913  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 287846us
I20260709 12:58:09.584507  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:09.588564  1535 connection.cc:256] RPC call timeout handler was delayed by -1.2075371369999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 12:58:09.591144  1535 connection.cc:256] RPC call timeout handler was delayed by -1.2075371369999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 12:58:09.591960  1535 connection.cc:256] RPC call timeout handler was delayed by -1.1922371370000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:58:09.592667  1535 connection.cc:256] RPC call timeout handler was delayed by -1.1634371370000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:58:09.593315  1535 connection.cc:256] RPC call timeout handler was delayed by -1.1517371369999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 12:58:09.594000  1535 connection.cc:256] RPC call timeout handler was delayed by -1.1508371369999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 12:58:09.590157  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:09.597213  4514 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:09.595594  1535 connection.cc:256] RPC call timeout handler was delayed by -1.1202371370000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:58:09.597324  1684 leader_election.cc:336] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59258 dropped due to backpressure: service queue is full with 50 items
I20260709 12:58:09.597818  4514 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:58:09.597924  1535 connection.cc:256] RPC call timeout handler was delayed by -1.1202371370000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:58:09.598315  1535 connection.cc:256] RPC call timeout handler was delayed by -1.1202371370000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:58:09.598714  1535 connection.cc:256] RPC call timeout handler was delayed by -1.0707371369999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 12:58:09.598747  4514 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.599785  4514 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.601284  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.602029  1638 raft_consensus.cc:2376] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8. Re-sending same reply.
W20260709 12:58:09.602443  1638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1662) took 1758 ms (client timeout 1839 ms). Trace:
W20260709 12:58:09.602768  1638 rpcz_store.cc:269] 0709 12:58:07.843948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.600977 (+1757029us) service_pool.cc:224] Handling call
0709 12:58:09.602390 (+  1413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.603660  1684 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:09.604595  4574 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:09.604698  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.605273  4574 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:09.605548  1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1640) took 2614 ms (client timeout 2778 ms). Trace:
W20260709 12:58:09.605954  1641 rpcz_store.cc:269] 0709 12:58:06.991215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.604468 (+2613253us) service_pool.cc:224] Handling call
0709 12:58:09.605493 (+  1025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.606446  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.606228  4574 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.607015  1572 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:09.607061  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.607501  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.607699  1641 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:09.608009  1563 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.608497  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.609205  1571 raft_consensus.cc:2368] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:58:09.603850  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.604912  1569 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:09.611801  1720 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:09.612927  4545 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.613044  1720 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:09.613421  4545 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.614789  4552 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:09.615257  1686 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:09.615494  4545 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:09.612658  1638 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:09.615641  4410 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.616739  4410 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:09.616925  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:09.617586  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.617513  1638 raft_consensus.cc:2376] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8. Re-sending same reply.
I20260709 12:58:09.617933  1563 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:09.618287  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 353) took 1158 ms. Trace:
I20260709 12:58:09.619750  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.618775  1638 rpcz_store.cc:276] 0709 12:58:08.460416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.616678 (+1156262us) service_pool.cc:224] Handling call
0709 12:58:09.618224 (+  1546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.621387  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.621589  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:09.622077  1638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1648) took 2544 ms (client timeout 3350 ms). Trace:
I20260709 12:58:09.622301  1563 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:09.622465  1638 rpcz_store.cc:269] 0709 12:58:07.077999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.621152 (+2543153us) service_pool.cc:224] Handling call
0709 12:58:09.622023 (+   871us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.623986  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.624776  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.625378  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:09.625547  1563 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:09.626523  1714 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:09.627291  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.627903  1571 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:09.627969  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.626622  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.623401  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.629724  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.630203  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.630791  1638 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:09.631217  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 356) took 1165 ms. Trace:
I20260709 12:58:09.632092  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.573441  4576 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.633379  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.633635  1715 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:09.634250  1564 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:09.634332  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.634593  4576 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:09.635092  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.635566  4551 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:09.635637  1569 raft_consensus.cc:2376] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7. Re-sending same reply.
I20260709 12:58:09.616559  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:09.637303  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.574028  4543 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.586529  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.637627  1566 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:09.640974  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:09.594247  4606 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.346s	user 0.000s	sys 0.004s
I20260709 12:58:09.631649  1638 rpcz_store.cc:276] 0709 12:58:08.465652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.630001 (+1164349us) service_pool.cc:224] Handling call
0709 12:58:09.631162 (+  1161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.652045  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.652801  1638 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:09.653666  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 357) took 1059 ms. Trace:
I20260709 12:58:09.654031  1638 rpcz_store.cc:276] 0709 12:58:08.594373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.651795 (+1057422us) service_pool.cc:224] Handling call
0709 12:58:09.653620 (+  1825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.657891  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.658453  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.658725  1571 raft_consensus.cc:2410] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:09.658994  1569 raft_consensus.cc:2376] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9. Re-sending same reply.
I20260709 12:58:09.659766  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.660007  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.660465  1570 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:09.661049  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.661239  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.661355  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.662513  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.662580  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.663220  1568 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:09.663766  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.664049  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.664343  1569 raft_consensus.cc:2376] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8. Re-sending same reply.
I20260709 12:58:09.583436  4449 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.542634  4336 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.661163  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.664630  1568 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:09.681546  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.694136  1570 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:09.694635  1643 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:09.651834  1641 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:09.684930  1567 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:09.665482  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.664892  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:09.671517  1639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1654) took 2591 ms (client timeout 2237 ms). Trace:
W20260709 12:58:09.700861  1639 rpcz_store.cc:269] 0709 12:58:07.079593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.736541 (+1656948us) service_pool.cc:224] Handling call
0709 12:58:09.671327 (+934786us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002a94d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:09.671452 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002681216}
I20260709 12:58:09.701400  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:09.665256  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:09.679382  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:09.682984  1684 leader_election.cc:336] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.844s (SENT)
I20260709 12:58:09.687059  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:09.704070  1684 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:09.673411  1610 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59258 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 364)
W20260709 12:58:09.695144  1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1656) took 2615 ms (client timeout 2709 ms). Trace:
W20260709 12:58:09.708766  1643 rpcz_store.cc:269] 0709 12:58:07.080051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.681258 (+2601207us) service_pool.cc:224] Handling call
0709 12:58:09.695091 (+ 13833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.695730  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.665175  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.690023  1467 catalog_manager.cc:5697] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.710970  1563 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:58:09.712136  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.677574  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.713403  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:09.720499  1563 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:09.721506  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.714701  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.723528  1570 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:09.533075  4342 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.711896  1467 catalog_manager.cc:5697] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 3, term changed from 2 to 5, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193), NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 5 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:58:09.734120  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:09.726737  1611 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59258 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 364)
I20260709 12:58:09.735140  1568 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:09.535847  4507 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.736263  1611 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59270 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 364)
I20260709 12:58:09.725257  4547 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.717612  1638 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:58:09.737742  4522 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.742915  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.743144  4522 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.743526  1639 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:09.744045  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1541) took 1036 ms. Trace:
I20260709 12:58:09.744372  1639 rpcz_store.cc:276] 0709 12:58:08.707399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.726426 (+1019027us) service_pool.cc:224] Handling call
0709 12:58:09.743995 (+ 17569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.744872  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.745122  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:58:09.745276  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.745394  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.745680  1720 raft_consensus.cc:606] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:09.742594  1647 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:09.746469  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.747192  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1543) took 1028 ms. Trace:
W20260709 12:58:09.747360  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1668) took 1776 ms (client timeout 2228 ms). Trace:
I20260709 12:58:09.747547  1643 rpcz_store.cc:276] 0709 12:58:08.719221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.746206 (+1026985us) service_pool.cc:224] Handling call
0709 12:58:09.747139 (+   933us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:09.747772  1647 rpcz_store.cc:269] 0709 12:58:07.971174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.557512 (+1586338us) service_pool.cc:224] Handling call
0709 12:58:09.747194 (+189682us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540020a3d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:09.747308 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423125888}
I20260709 12:58:09.748221  4553 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.743243  4337 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.748610  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.685120  4336 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:09.749452  1646 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:09.740546  1611 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59258 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 364)
I20260709 12:58:09.750387  4337 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:09.750478  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1667) took 1808 ms (client timeout 2204 ms). Trace:
W20260709 12:58:09.750903  1646 rpcz_store.cc:269] 0709 12:58:07.941648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.551540 (+1609892us) service_pool.cc:224] Handling call
0709 12:58:09.750314 (+198774us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b5400209ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:09.750430 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226598144}
I20260709 12:58:09.751601  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.751881  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:09.752178  1647 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:09.749523  1643 raft_consensus.cc:2393] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:09.745819  1638 raft_consensus.cc:2410] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:09.753052  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1537) took 1075 ms. Trace:
I20260709 12:58:09.753268  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1544) took 1001 ms. Trace:
I20260709 12:58:09.753517  1643 rpcz_store.cc:276] 0709 12:58:08.677768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.748342 (+1070574us) service_pool.cc:224] Handling call
0709 12:58:09.753003 (+  4661us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.753880  1638 rpcz_store.cc:276] 0709 12:58:08.752109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.744545 (+992436us) service_pool.cc:224] Handling call
0709 12:58:09.753220 (+  8675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.742421  1571 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:09.755009  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.756112  1638 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:09.752933  1639 raft_consensus.cc:2376] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8. Re-sending same reply.
I20260709 12:58:09.758456  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1669) took 1783 ms. Trace:
I20260709 12:58:09.758742  1639 rpcz_store.cc:276] 0709 12:58:07.974766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.745030 (+1770264us) service_pool.cc:224] Handling call
0709 12:58:09.758064 (+ 13034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.757072  1611 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59258 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 364)
I20260709 12:58:09.725631  4423 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.781515  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1540) took 1091 ms. Trace:
I20260709 12:58:09.782032  1638 rpcz_store.cc:276] 0709 12:58:08.689786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.754714 (+1064928us) service_pool.cc:224] Handling call
0709 12:58:09.781460 (+ 26746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.781838  1467 catalog_manager.cc:5697] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:09.733683  4590 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.787165  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:09.787593  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:09.788934  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:09.791625  1684 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:09.793061  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:09.796345  1684 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:09.786185  4342 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:09.805474  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:09.794381  4527 consensus_meta.cc:287] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.003s
I20260709 12:58:09.779783  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:09.733634  4550 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:09.806327  1715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:58:09.812813  1715 raft_consensus.cc:606] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:09.813172  1715 raft_consensus.cc:614] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:09.783838  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.669124  4575 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.816143  1638 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:09.809062  1611 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58328 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1682)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1680)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1688)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 364)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1558)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 366)
I20260709 12:58:09.806262  1467 catalog_manager.cc:5697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 1 to 2, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 2 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:09.842532  1563 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:58:09.795965  4563 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:09.795387  4545 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:09.864717  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:09.850255  1721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.018s	sys 0.022s
I20260709 12:58:09.850795  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:09.801015  4147 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:09.804766  4552 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:09.790930  4423 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.791092  4386 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.808009  4572 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:09.880713  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:09.881520  2343 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:09.871309  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.882440  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 348) took 3014 ms. Trace:
I20260709 12:58:09.882864  1639 rpcz_store.cc:276] 0709 12:58:06.868311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.841812 (+2973501us) service_pool.cc:224] Handling call
0709 12:58:09.882366 (+ 40554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.883984  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:09.874383  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:09.792119  4590 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.889062  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:09.890023  1639 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:09.803838  3973 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
W20260709 12:58:09.867895  1721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.018s	sys 0.022s
I20260709 12:58:09.804541  4505 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:09.815907  4527 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:09.879819  4552 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.870018  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:09.874099  4438 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:09.898298  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 346) took 3030 ms (client timeout 2191 ms). Trace:
I20260709 12:58:09.899207  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.880589  4563 raft_consensus.cc:697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:09.900796  1647 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:09.908218  1642 rpcz_store.cc:269] 0709 12:58:06.867789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.575527 (+1707738us) service_pool.cc:224] Handling call
0709 12:58:09.898128 (+1322601us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002666d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:09.898238 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2829278592}
I20260709 12:58:09.906327  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.912310  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1546) took 1154 ms. Trace:
I20260709 12:58:09.912791  1643 rpcz_store.cc:276] 0709 12:58:08.758143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.898996 (+1140853us) service_pool.cc:224] Handling call
0709 12:58:09.912235 (+ 13239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:09.913879  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:09.914654  1643 raft_consensus.cc:2376] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8. Re-sending same reply.
I20260709 12:58:09.916752  1639 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:09.918882  1684 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:09.923959  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.893774  4499 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:58:09.911126  4552 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:09.908247  4565 consensus_meta.cc:287] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.084s	user 0.005s	sys 0.007s
I20260709 12:58:09.908385  4550 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:09.909536  4438 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.939388  4550 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:09.942134  4438 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.945027  4619 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:09.950892  4522 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:09.953029  4547 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:09.970696  4505 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:09.972218  4423 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:09.941772  4565 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:09.963708  4553 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:09.951470  4572 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:09.981493  4625 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:58:09.965185  4619 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:09.986451  4614 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.141s	user 0.001s	sys 0.001s
I20260709 12:58:09.986613  4619 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:09.919700  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 324652us
I20260709 12:58:10.033697  1565 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
W20260709 12:58:10.035458  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 316852us
I20260709 12:58:09.892086  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:10.037618  1570 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:10.039006  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:10.039268  1537 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:10.042151  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.043982  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.924952  1642 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:10.046614  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.046802  1641 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:09.925669  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:10.026757  1467 catalog_manager.cc:5697] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 3 to 6, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:10.049795  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.050981  1643 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:10.050475  1467 catalog_manager.cc:5697] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 5 to 6, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:10.052002  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.052790  1467 catalog_manager.cc:5697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:10.057055  1610 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:10.059600  1610 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:10.065964  1647 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:10.070724  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 2004) took 1231 ms. Trace:
W20260709 12:58:10.070874  1684 leader_election.cc:336] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 2.108s (SENT)
I20260709 12:58:10.073434  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1553) took 1430 ms. Trace:
I20260709 12:58:10.075996  1719 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:09.935992  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 66029.1us
W20260709 12:58:10.091432  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 52865us
I20260709 12:58:10.093084  4386 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:10.093009  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.094689  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.927436  3973 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:10.097245  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:10.097384  4453 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:10.098241  4473 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:10.099186  4461 consensus_meta.cc:287] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.001s
I20260709 12:58:10.100272  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:10.100768  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:10.124723  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 85676.8us
W20260709 12:58:10.132063  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.133484  3973 raft_consensus.cc:697] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:10.135080  3973 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.149757  1639 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:09.994184  4590 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:09.987200  4550 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.165498  4540 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:10.173728  4553 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:10.174355  4553 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:10.174651  4565 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:10.175784  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.175657  4553 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.181770  1646 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:10.182471  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1665) took 2337 ms. Trace:
I20260709 12:58:10.182864  1646 rpcz_store.cc:276] 0709 12:58:07.845043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.751662 (+1906619us) service_pool.cc:224] Handling call
0709 12:58:10.182367 (+430705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.183991  4618 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:10.156111  4461 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.187458  4461 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:10.188088  1569 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:10.158309  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.191038  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.192876  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:10.193372  1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1538) took 1515 ms (client timeout 1959 ms). Trace:
I20260709 12:58:10.193703  1639 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
W20260709 12:58:10.193881  1641 rpcz_store.cc:269] 0709 12:58:08.678106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.695432 (+1017326us) service_pool.cc:224] Handling call
0709 12:58:10.193187 (+497755us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54001e37d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:10.193317 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773187968}
I20260709 12:58:10.194868  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.195164  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.195693  1639 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:58:10.197490  1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1636) took 3233 ms (client timeout 2613 ms). Trace:
W20260709 12:58:10.197861  1644 rpcz_store.cc:269] 0709 12:58:06.963978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.843679 (+1879701us) service_pool.cc:224] Handling call
0709 12:58:10.197150 (+1353471us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001b62d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:10.197293 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585474944}
I20260709 12:58:10.198931  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.200095  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.204530  1712 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:10.206915  1714 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:10.208822  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:10.209928  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.211130  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.196429  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:10.214143  1715 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:10.229889  4457 consensus_meta.cc:287] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.007s
I20260709 12:58:10.230155  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:10.230466  4457 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.231791  4612 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:10.232512  1643 raft_consensus.cc:2368] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:58:10.235973  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:09.974896  4563 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.236779  4550 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:10.241356  1641 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:10.242972  4522 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:10.243918  4582 consensus_meta.cc:287] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.759s	user 0.006s	sys 0.006s
I20260709 12:58:10.240579  4551 raft_consensus.cc:1064] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
W20260709 12:58:10.246228  4551 raft_consensus.cc:1068] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Unable to promote non-voter c05ea12435084ad9b281ed3a0a2ecebe: Service unavailable: leader transfer in progress
I20260709 12:58:10.247895  1564 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
W20260709 12:58:10.250433  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 179916us
I20260709 12:58:10.263391  1570 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:10.265070  1642 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:10.265023  1572 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:10.274055  4438 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:10.275872  4312 consensus_meta.cc:287] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.734s	user 0.014s	sys 0.000s
I20260709 12:58:10.103688  1721 rpcz_store.cc:276] 0709 12:58:08.838911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.123351 (+284440us) service_pool.cc:224] Handling call
0709 12:58:09.123638 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:09.133983 (+ 10345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:09.134013 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:09.144029 (+ 10016us) log.cc:844] Serialized 52 byte log entry
0709 12:58:09.424087 (+280058us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b48001b0258. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
0709 12:58:09.894782 (+470695us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:09.894851 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:09.894938 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:10.069992 (+175054us) raft_consensus.cc:1685] finished
0709 12:58:10.070042 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.070462 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9983,"raft.queue_time_us":10498,"raft.run_cpu_time_us":3138,"raft.run_wall_time_us":287406,"spinlock_wait_cycles":12754688,"thread_start_us":648909,"threads_started":1,"wal-append.queue_time_us":747830}
I20260709 12:58:10.335597  1715 raft_consensus.cc:2410] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:10.262560  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:10.265182  1565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1639) took 1265 ms (client timeout 1545 ms). Trace:
I20260709 12:58:10.367280  1720 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:10.280349  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.375041  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 1988) took 1625 ms. Trace:
W20260709 12:58:10.325121  1686 leader_election.cc:336] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.545s (SENT)
I20260709 12:58:10.361021  4147 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:10.309307  4312 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.104206  1713 rpcz_store.cc:276] 0709 12:58:08.642811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.093617 (+450806us) service_pool.cc:224] Handling call
0709 12:58:09.122395 (+ 28778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:09.122766 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:09.122804 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:09.123220 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:58:09.554935 (+431715us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:09.554990 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:09.555077 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:09.678831 (+123754us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b48001b0258. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
0709 12:58:10.072839 (+394008us) raft_consensus.cc:1685] finished
0709 12:58:10.072882 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.073245 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13432,"raft.queue_time_us":5612,"raft.run_cpu_time_us":3012,"raft.run_wall_time_us":546373,"spinlock_wait_cycles":2880768,"thread_start_us":323117,"threads_started":1,"wal-append.queue_time_us":605427}
W20260709 12:58:10.377172  1565 rpcz_store.cc:269] 0709 12:58:08.999613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.054810 (+ 55197us) service_pool.cc:224] Handling call
0709 12:58:10.264309 (+1209499us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b5400133b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:10.264523 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2165009664}
I20260709 12:58:10.279244  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.366124  4576 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:10.366379  4514 consensus_meta.cc:287] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.007s
W20260709 12:58:10.365403  4342 consensus_meta.cc:287] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.003s
I20260709 12:58:10.350329  4457 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:10.396147  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 71081.9us
W20260709 12:58:10.397473  1686 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.638s (SENT)
I20260709 12:58:10.398077  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:10.399781  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 174426us
I20260709 12:58:10.403230  2312 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:10.404536  4147 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:10.406853  4312 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:10.378302  1716 rpcz_store.cc:276] 0709 12:58:08.748991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.100194 (+351203us) service_pool.cc:224] Handling call
0709 12:58:09.130588 (+ 30394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:09.130790 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:09.501888 (+371098us) log.cc:844] Serialized 14 byte log entry
0709 12:58:10.365435 (+863547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.365565 (+   130us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:10.365740 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.369268 (+  3528us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.374829 (+  5561us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19023,"prepare.queue_time_us":312048,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":6069,"raft.queue_time_us":28583,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":6850,"thread_start_us":986863,"threads_started":3,"wal-append.queue_time_us":455781}
I20260709 12:58:10.408828  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.409739  1642 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:10.410012  1643 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:10.411181  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:10.412832  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 255953us
I20260709 12:58:10.414592  4461 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:10.414835  1537 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:10.415158  4461 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:10.418720  4611 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:10.419135  4611 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:10.419024  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 162074us
I20260709 12:58:10.419661  4611 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:10.420213  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:10.421459  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:10.422346  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:10.422959  4644 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:10.244490  4582 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.425860  4582 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:10.429168  1639 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:58:10.430578  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.431838  4438 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:10.416356  4461 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.412554  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.442953  1642 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:10.443621  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1627) took 3506 ms. Trace:
I20260709 12:58:10.443994  1642 rpcz_store.cc:276] 0709 12:58:06.937708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.442100 (+3504392us) service_pool.cc:224] Handling call
0709 12:58:10.442505 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.443380 (+   875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.443546 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.451130  4449 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.457378  1645 raft_consensus.cc:2410] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:10.465945  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 330) took 1827 ms. Trace:
W20260709 12:58:10.466528  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1666) took 2555 ms (client timeout 2108 ms). Trace:
W20260709 12:58:10.466972  1645 rpcz_store.cc:269] 0709 12:58:07.911050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.550431 (+1639381us) service_pool.cc:224] Handling call
0709 12:58:10.466318 (+915887us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54001937d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:10.466458 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030773504}
I20260709 12:58:10.363121  4619 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.469287  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1635) took 3505 ms. Trace:
I20260709 12:58:10.469707  1645 rpcz_store.cc:276] 0709 12:58:06.963782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.467843 (+3504061us) service_pool.cc:224] Handling call
0709 12:58:10.468539 (+   696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.468901 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.468933 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.469008 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:10.469050 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.469106 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.469222 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.470907  4619 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:10.466346  1719 rpcz_store.cc:276] 0709 12:58:08.638914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.645924 (+  7010us) service_pool.cc:224] Handling call
0709 12:58:08.646295 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.130366 (+1484071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.465628 (+335262us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400320854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:10.465867 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3286562176}
I20260709 12:58:10.457988  4276 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.473771  4276 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.474498  2348 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:10.463275  1647 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:10.477165  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1634) took 3513 ms. Trace:
I20260709 12:58:10.477409  4619 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:10.477924  4619 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:10.478183  4276 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:10.478415  4619 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.479620  1642 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:10.480320  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1646) took 3402 ms. Trace:
I20260709 12:58:10.480893  4575 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:10.483471  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.484375  1644 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:58:10.477581  1647 rpcz_store.cc:276] 0709 12:58:06.963422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.462712 (+3499290us) service_pool.cc:224] Handling call
0709 12:58:10.463043 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.476872 (+ 13829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.477080 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.485847  4507 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.485975  1647 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:10.486589  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1655) took 3406 ms. Trace:
I20260709 12:58:10.486893  1647 rpcz_store.cc:276] 0709 12:58:07.079842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.485180 (+3405338us) service_pool.cc:224] Handling call
0709 12:58:10.485550 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.486371 (+   821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.486539 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:10.477162  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 74124.4us
I20260709 12:58:10.489861  2312 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:10.463894  4552 consensus_meta.cc:287] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 12:58:10.497110  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 354) took 2027 ms. Trace:
I20260709 12:58:10.505102  1641 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:10.506223  2312 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:10.382035  4622 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.262s	user 0.000s	sys 0.002s
I20260709 12:58:10.480880  1642 rpcz_store.cc:276] 0709 12:58:07.077498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.479009 (+3401511us) service_pool.cc:224] Handling call
0709 12:58:10.479423 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.480065 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.480257 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.504895  1647 rpcz_store.cc:276] 0709 12:58:08.464962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.487565 (+2022603us) service_pool.cc:224] Handling call
0709 12:58:10.487928 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.488362 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.488387 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.488429 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:10.488471 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.488523 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.488619 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.416342  1537 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:10.513005  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 355) took 2047 ms. Trace:
I20260709 12:58:10.513441  1644 rpcz_store.cc:276] 0709 12:58:08.465348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.504402 (+2039054us) service_pool.cc:224] Handling call
0709 12:58:10.512352 (+  7950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.512598 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.512632 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.512713 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:10.512773 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.512847 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.512950 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.515141  1644 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:10.515946  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:10.516193  1684 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:10.516223  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 347) took 3648 ms. Trace:
I20260709 12:58:10.517112  4550 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.517026  1643 rpcz_store.cc:276] 0709 12:58:06.868055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.412374 (+3544319us) service_pool.cc:224] Handling call
0709 12:58:10.506652 (+ 94278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.515817 (+  9165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.515851 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.515892 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:10.515937 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.516003 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.516133 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.517764  4550 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.518515  1643 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:10.519065  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1670) took 1743 ms. Trace:
I20260709 12:58:10.519347  1643 rpcz_store.cc:276] 0709 12:58:08.776130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.518043 (+1741913us) service_pool.cc:224] Handling call
0709 12:58:10.518344 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.518846 (+   502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.518998 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.519764  4550 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:10.520696  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 112890us
W20260709 12:58:10.522432  4583 consensus_meta.cc:287] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.980s	user 0.007s	sys 0.007s
I20260709 12:58:10.522890  4583 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.524175  1640 raft_consensus.cc:2393] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:58:10.524953  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 108801us
I20260709 12:58:10.525910  4612 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:10.526280  4612 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:10.526537  1640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1663) took 2682 ms (client timeout 1844 ms). Trace:
I20260709 12:58:10.526607  4612 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:10.527002  1640 rpcz_store.cc:269] 0709 12:58:07.844244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.617352 (+1773108us) service_pool.cc:224] Handling call
0709 12:58:10.526286 (+908934us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54001d29d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:10.526475 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082901760}
I20260709 12:58:10.530573  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1548) took 1757 ms. Trace:
I20260709 12:58:10.533578  1645 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:10.535261  1644 rpcz_store.cc:276] 0709 12:58:08.771753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.514477 (+1742724us) service_pool.cc:224] Handling call
0709 12:58:10.514877 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.515507 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.529306 (+ 13799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.539175  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1672) took 1762 ms. Trace:
I20260709 12:58:10.539602  1643 rpcz_store.cc:276] 0709 12:58:08.776756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.520009 (+1743253us) service_pool.cc:224] Handling call
0709 12:58:10.520376 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.528362 (+  7986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.528398 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.538887 (+ 10489us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:10.538936 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.538993 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.539098 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.541213  1643 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:10.542461  1643 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:10.543721  1643 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:10.545010  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.528550  4644 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:10.557178  1643 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:58:10.558157  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.558421  4492 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:10.558158  4337 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:10.561316  1719 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:10.564960  1646 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
W20260709 12:58:10.565099  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 142955us
I20260709 12:58:10.566217  1646 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:10.566826  4583 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:10.567503  4643 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:10.568161  4643 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.568467  2348 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:10.568560  4643 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:10.573129  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:10.573303  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 75713.8us
I20260709 12:58:10.573931  1564 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.574182  2312 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:10.573330  1642 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:10.575804  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1539) took 1897 ms. Trace:
I20260709 12:58:10.576172  1642 rpcz_store.cc:276] 0709 12:58:08.678435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.528681 (+1850246us) service_pool.cc:224] Handling call
0709 12:58:10.572983 (+ 44302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.575464 (+  2481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.575743 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.577138  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:10.580832  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:10.581504  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.582389  4507 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:10.585427  2312 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:10.558211  4511 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:58:10.566128  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:10.556344  4576 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:10.589064  4576 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:10.589442  4576 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:10.593489  1647 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:10.594183  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1542) took 1877 ms. Trace:
I20260709 12:58:10.594528  1647 rpcz_store.cc:276] 0709 12:58:08.716800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.537707 (+1820907us) service_pool.cc:224] Handling call
0709 12:58:10.593107 (+ 55400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.593891 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.594128 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.595420  2348 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:10.596789  4507 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:10.597397  4507 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:10.598554  4507 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:10.599707  4545 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.002s
I20260709 12:58:10.600208  4545 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:10.549997  4438 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:58:10.602835  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 47452.5us
I20260709 12:58:10.603116  1537 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:10.604151  4617 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:10.605111  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 54672us
I20260709 12:58:10.605722  4457 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:10.605999  1537 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:10.606189  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:10.607095  4492 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:10.567580  1646 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:58:10.554136  1721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:37874
I20260709 12:58:10.607569  4511 consensus_queue.cc:1059] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:10.617009  1721 raft_consensus.cc:606] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:10.605432  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:10.621145  2346 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:10.623697  1721 raft_consensus.cc:614] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:10.624226  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 358) took 2029 ms. Trace:
I20260709 12:58:10.624750  1641 rpcz_store.cc:276] 0709 12:58:08.594674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.534362 (+1939688us) service_pool.cc:224] Handling call
0709 12:58:10.549909 (+ 15547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.623794 (+ 73885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.623832 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.623892 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:10.623944 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.624019 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.624143 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:10.631287  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:10.626571  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:10.640923  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.617019  4336 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:10.653493  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1688) took 1056 ms. Trace:
I20260709 12:58:10.653879  1644 rpcz_store.cc:276] 0709 12:58:09.596690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.545060 (+948370us) service_pool.cc:224] Handling call
0709 12:58:10.622337 (+ 77277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.649993 (+ 27656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.650021 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.653259 (+  3238us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:10.653298 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.653350 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.653444 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:10.655300  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 49423us
I20260709 12:58:10.533610  4552 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.657284  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1680) took 1161 ms. Trace:
I20260709 12:58:10.658787  1640 rpcz_store.cc:276] 0709 12:58:09.495935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.544952 (+1049017us) service_pool.cc:224] Handling call
0709 12:58:10.625159 (+ 80207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.651121 (+ 25962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.651146 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:10.657010 (+  5864us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:10.657056 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.657113 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.657235 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:10.662644  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.649780  4457 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:10.649333  4550 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.660181  1643 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:10.645074  4514 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 12:58:10.671276  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 85959us
I20260709 12:58:10.671723  4514 raft_consensus.cc:3055] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:10.672232  4514 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:10.666961  1638 raft_consensus.cc:2410] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:10.667965   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:58:10.658443  4312 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:10.640302  4611 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.673341  4514 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.692620  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:10.691516  4550 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.695050  4550 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:10.695933  4480 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:10.697378  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1552) took 1025 ms. Trace:
I20260709 12:58:10.697742  1638 rpcz_store.cc:276] 0709 12:58:09.672089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.864348 (+192259us) service_pool.cc:224] Handling call
0709 12:58:10.697161 (+832813us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54001e32d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:10.697319 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832473344}
I20260709 12:58:10.700954  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:10.702044  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1643) took 3636 ms. Trace:
I20260709 12:58:10.702526  1645 rpcz_store.cc:276] 0709 12:58:07.065999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.470848 (+3404849us) service_pool.cc:224] Handling call
0709 12:58:10.508289 (+ 37441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:10.538077 (+ 29788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.701810 (+163733us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b54001b5dd0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:10.701942 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85172096}
I20260709 12:58:10.708316   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:58:10.708662  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 192584us
I20260709 12:58:10.709511  1684 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:10.709915  4312 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:10.711237  4312 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.713183  4564 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:10.713744  4564 raft_consensus.cc:697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:10.714651  4564 consensus_queue.cc:237] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.712492  1684 leader_election.cc:400] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:58:10.718046  1684 leader_election.cc:403] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:10.696379  4480 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:58:10.720482  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 115134us
I20260709 12:58:10.724252  1564 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:10.730014  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:10.741108  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:10.739724  4617 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:58:10.744210  4617 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:10.744549  4617 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:10.745476  4617 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.746752  4617 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:10.736218  4550 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:58:10.755568  4612 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.757205  3973 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:10.758069  4611 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:10.757841  3973 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.758574  4612 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:10.759339  1686 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.012s (SENT)
I20260709 12:58:10.759433  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:10.759811  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:10.760849  4545 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:10.759840  3973 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:10.738713  4337 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:10.770717  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:10.773442  1642 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:10.742674  4619 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.784579  2348 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:10.782271  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 50372.2us
W20260709 12:58:10.790059  1686 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.026s (SENT)
I20260709 12:58:10.780200  4337 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:10.793835  4337 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.753340  4461 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:58:10.805028  4461 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:10.805503  4461 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:10.806531  4461 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.780251  4618 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:58:10.807736  4461 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.809173  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1645) took 3732 ms. Trace:
I20260709 12:58:10.809648  1639 rpcz_store.cc:276] 0709 12:58:07.077232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.478518 (+3401286us) service_pool.cc:224] Handling call
0709 12:58:10.478981 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.597046 (+118065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.597084 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.597696 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 12:58:10.674568 (+ 76872us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:10.674604 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.674670 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:10.808902 (+134232us) raft_consensus.cc:1685] finished
0709 12:58:10.808928 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:10.809085 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70633,"raft.queue_time_us":117359,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":76476,"threads_started":1,"wal-append.queue_time_us":94238}
I20260709 12:58:10.811331  4449 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.811833  4449 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.772459  4480 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.813898  4449 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:10.814073  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:10.814424  4492 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:10.816218  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:10.822387  4480 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:10.824954  4589 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:10.825932  4608 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:10.826092  4576 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:10.827078  4608 raft_consensus.cc:3055] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:10.827554  4608 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:10.833859  4449 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:10.873632  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.834685  4552 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:10.876037  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 96685.6us
I20260709 12:58:10.877005  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:10.877697  2340 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:10.878489  4552 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:10.880040  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:10.880621  4576 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:10.881642  4656 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:58:10.881873  4552 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:10.883406  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:10.883688  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:10.884898  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 100691us
I20260709 12:58:10.886036  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.886188  4550 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6.
I20260709 12:58:10.886257  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:10.887931  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:10.888975  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 72859.2us
I20260709 12:58:10.889348  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:10.889426  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.889791  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:10.890908  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.891644  1719 raft_consensus.cc:2393] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:10.892552  4612 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:10.892970  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.893350  4612 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.893627  1715 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:10.895908  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.896593  1713 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:10.897529  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.897861  4514 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:10.898303  1715 raft_consensus.cc:2410] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:10.898007  4611 consensus_queue.cc:1059] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:10.891820  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:10.889041  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.904209  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.904937  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.907522  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:10.908551  1640 raft_consensus.cc:2410] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:10.902524  4449 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:10.909487  4449 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:10.909688  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.910552  1645 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:10.911621  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.912424  1643 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:10.916152  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.918279  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.899247  4438 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:10.916345  4147 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:10.912000  4550 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:10.913697  4576 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:10.926023  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.923655  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.902874  4619 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:10.926023  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:10.927966  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.910703  4449 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.932009  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.932195  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:10.933102  1713 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:10.828619  4608 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.935264  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:10.934566  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 121999us
I20260709 12:58:10.938258  4336 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:10.938979  4336 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:10.914702  4643 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:10.926154  4552 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:10.941486  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 49045.3us
I20260709 12:58:10.942477  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.959451  1643 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:10.960821  1715 raft_consensus.cc:2393] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:10.967855  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.968513  1643 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:10.973887  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:10.986630  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.987298  1640 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
W20260709 12:58:10.988543  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 89797.4us
I20260709 12:58:10.991468  2340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 417) took 1188 ms. Trace:
I20260709 12:58:10.991992  2340 rpcz_store.cc:276] 0709 12:58:09.802894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.843079 (+ 40185us) service_pool.cc:224] Handling call
0709 12:58:10.991207 (+1148128us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54006469d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:10.991374 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718939520}
I20260709 12:58:10.999140  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:10.957572  4438 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:11.020110  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 136763us
I20260709 12:58:11.022143  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:11.022490  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:11.025141  1640 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:11.029453  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:58:11.041003  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.043247  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:11.044920  4545 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:11.045686  4147 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:11.044832  4550 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:11.052734  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 90382.1us
I20260709 12:58:11.053679  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:11.055480  4611 consensus_queue.cc:1059] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:11.055732  4438 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:11.056799  4276 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:11.057188  4276 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:11.057324  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:11.058609  4550 consensus_queue.cc:1059] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:11.059937  4552 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:11.060216  4612 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:11.060354  4552 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:11.060992  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:11.057566  4276 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.062486  4643 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:11.063261  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:11.063908  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:11.079871  1644 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:11.063846  4147 consensus_queue.cc:1059] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:11.064158  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:11.065075  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:11.075974  2312 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:11.082176  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:11.089963  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:11.083494  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:11.093034  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:11.093573  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:11.092482  1712 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:11.101060  1638 raft_consensus.cc:2368] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7.
I20260709 12:58:11.104162  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:11.100662  4438 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.129367  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.128141  4438 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:11.132925  4669 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:11.104315  4575 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:11.145635  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.149789  1720 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:11.191546  1571 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:11.137458  4552 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:11.153054  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 77096.7us
I20260709 12:58:11.198828  1712 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:11.159776  1565 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:11.161538  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:11.216477  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 161310us
W20260709 12:58:11.161928  4663 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.104s	user 0.000s	sys 0.003s
I20260709 12:58:11.164436  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.154848  1643 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:11.122840  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:11.262665  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.201535  4669 consensus_queue.cc:1243] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:11.205406  4550 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:58:11.208866  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.203403  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:11.123620  1567 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:11.264040  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:11.293927  2340 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:11.155853  1715 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:11.267334  2346 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:11.298139  1569 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:11.299875  1568 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:11.282078  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:11.167575  4618 consensus_queue.cc:1059] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:58:11.298342  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:11.283753  4565 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.345357  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:11.325692  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:11.305963  4550 consensus_queue.cc:1243] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 2af567a273d44ca89d2b3b0f7c815bd1 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:58:11.360037  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 78559.1us
I20260709 12:58:11.368305  1571 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:11.265498  4612 consensus_queue.cc:1059] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:58:11.389591  1712 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:11.336787  4669 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.393786  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.406000  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:11.409605  4612 raft_consensus.cc:3055] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:11.370230  4511 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:11.410347  4612 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:11.411326  4438 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:11.414898  4612 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.443418  4612 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:11.417280  4552 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:11.444891  4461 consensus_meta.cc:287] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.637s	user 0.020s	sys 0.001s
I20260709 12:58:11.343449  4514 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:11.445335  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:11.445684  4514 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:11.418437  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:11.418870  4671 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.003s
I20260709 12:58:11.378295  3973 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.454540  1714 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:11.451117  3973 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.420324  4565 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.389091  4618 raft_consensus.cc:3055] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:11.434267  4575 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:58:11.438349  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.416244  4669 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.473174  1572 raft_consensus.cc:2376] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8. Re-sending same reply.
I20260709 12:58:11.472381  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.478232  1720 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:11.475953  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 106523us
I20260709 12:58:11.462313  1712 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:11.458631  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:11.467846  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 62613.2us
I20260709 12:58:11.466192  4618 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:11.468726  4511 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:11.481171  1568 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:11.487965  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 112187us
I20260709 12:58:11.497037  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.498422  4514 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:11.478839  3973 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:11.500382  1569 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:11.499333  1684 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:11.499614  1571 raft_consensus.cc:2376] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8. Re-sending same reply.
I20260709 12:58:11.507863  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.509083  1565 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:11.510820  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.511615  1566 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:11.512465  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.513111  1563 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:11.520269  1686 leader_election.cc:336] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.587s (SENT)
I20260709 12:58:11.519891  1571 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:11.521085  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.526582  1566 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:11.531997  4661 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.472s	user 0.004s	sys 0.003s
I20260709 12:58:11.532094  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.533010  1567 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:11.534440  1569 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:11.535468  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.537503  4565 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:11.536921  4618 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.538426  1712 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:11.538867  4618 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.549367  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.554021  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:11.555482  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.556032  1563 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:11.519814  4680 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:11.558786  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:11.529623  4686 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:58:11.521060  4669 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:11.562207  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.562752  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:11.563086  1565 raft_consensus.cc:2410] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:11.514153  3973 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:58:11.563380  1712 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:11.568573  4680 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:11.584969  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.590351  1572 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:11.596251  1720 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:11.600322  4669 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:11.601472  4682 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:11.602348  4682 raft_consensus.cc:697] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:11.602834  4608 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.560113  4617 raft_consensus.cc:3055] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:11.562145  4565 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:11.619428  1566 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:11.576531  4680 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:11.620390  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.626842  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:11.627488  1717 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:11.617105  4617 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:11.639345  1716 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:11.643970  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:11.603696  4682 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:11.641908  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 126542us
I20260709 12:58:11.645455  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:11.647318  1715 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:58:11.644671  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:11.651993  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 95716us
I20260709 12:58:11.647789  1715 pending_rounds.cc:85] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 6
I20260709 12:58:11.652609  1537 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:11.651520  4619 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:11.661405  1712 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
W20260709 12:58:11.651815  1686 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.759s (SENT) [suppressed 98 similar messages]
I20260709 12:58:11.663599  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:11.668756  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:11.668857  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.669548  1572 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:11.661559  1715 pending_rounds.cc:107] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:58:11.671591  1715 raft_consensus.cc:2889] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:11.672140  1537 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:11.673506  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.673591  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:11.674227  2346 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:11.675212  4386 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:11.674739  4312 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:58:11.681262  4386 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:11.681700  4386 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.671330  4669 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:11.682832  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:11.685137  1572 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:58:11.690754  1686 leader_election.cc:336] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.625s (SENT)
W20260709 12:58:11.691846  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.692633  4690 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.693363  4690 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:11.694188  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 640590us
I20260709 12:58:11.695045  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:11.696244  4690 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:11.696859  3973 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:11.697180  4643 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:11.697193  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:11.679544  4686 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:11.702360  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 638458us
I20260709 12:58:11.680286  4678 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:11.668497  4619 consensus_queue.cc:1059] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:58:11.717473  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 51356.2us
I20260709 12:58:11.718864  1537 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:11.722265  1535 leader_election.cc:336] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.536s (SENT)
I20260709 12:58:11.696893  4449 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:11.741150  4449 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.741518  4618 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:11.741971  4618 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.741822  4449 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.744764  4666 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:11.745275  4666 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.741200  1537 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:11.745884  4666 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:11.742457  4618 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:11.706570  3973 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:11.710759  4583 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.709129  4643 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:11.751398  4410 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.752002  4410 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.752399  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:11.753718  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:11.754196  4410 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:11.754846  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:11.756147  1535 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.553s (SENT)
I20260709 12:58:11.756723  4669 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:11.757465  4675 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:11.759052  4611 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:11.703254  4617 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.757570  4669 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:11.741146  4619 raft_consensus.cc:3055] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:11.761380  4617 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:11.766074  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:11.768267  1537 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:11.770617  1535 leader_election.cc:336] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.585s (SENT)
I20260709 12:58:11.761817  3973 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:11.761994  4643 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:11.762944  4669 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.735378  4686 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.764079  4449 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:11.736457  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44085us
I20260709 12:58:11.801393  4386 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:11.801946  4608 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:11.804333  4686 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:11.777951  4545 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:11.805054  1535 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.598s (SENT)
I20260709 12:58:11.805169  4545 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:11.805671  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:11.806950  4668 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.615s	user 0.001s	sys 0.005s
I20260709 12:58:11.806524  4545 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.811035  4545 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:11.812498  4670 raft_consensus.cc:3055] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:11.813009  4670 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:11.816001  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 52428.8us
I20260709 12:58:11.816869  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:11.818989  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:11.820092  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:11.771615  4612 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:58:11.821105  4449 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:11.821774  4449 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:11.782994  4410 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:11.767230  4619 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:11.777894  4461 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:11.763156  4583 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.796720  4669 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:11.832825  2346 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:11.832916  4276 consensus_meta.cc:287] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.745s	user 0.022s	sys 0.000s
W20260709 12:58:11.869583  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 49538.7us
I20260709 12:58:11.895923  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:11.862854  4147 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:11.865175  4654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.007s	sys 0.012s
I20260709 12:58:11.917022  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:11.918931  1647 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:58:11.919337  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 148809us
I20260709 12:58:11.884889  4611 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:11.879976  4480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.016s	sys 0.024s
I20260709 12:58:11.927731  1686 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:11.884302  4695 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:11.920231  1537 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:11.886793  4678 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:11.921615  4654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.008s	sys 0.013s
I20260709 12:58:11.936652  1537 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:11.936666  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 259896us
I20260709 12:58:11.901155  4565 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:11.900996  4386 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:11.932031  4480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.016s	sys 0.025s
I20260709 12:58:11.942365  1647 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:11.926872  4564 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.945511  1647 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:11.942260  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:11.899346  4147 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:11.894850  4276 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:11.949891  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:11.946305  1647 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:11.957270  1647 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.916810  4686 consensus_queue.cc:1059] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:58:11.939266  4550 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:58:11.965032  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 159981us
W20260709 12:58:11.966331  1535 leader_election.cc:336] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.633s (SENT)
I20260709 12:58:11.966800  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:11.967654  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:11.968395  1718 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.973119  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.974280  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:11.995628  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:11.997373  1563 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:11.999127  1571 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:11.999166  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 64455.7us
I20260709 12:58:12.001173  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:12.004098  1564 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:12.004980  1565 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:11.963246  4514 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:12.010723  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.011390  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:12.012774  1566 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:58:12.015688  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.011348  1638 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:12.006405  1640 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:11.958389  4564 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:12.008158  1535 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.633s (SENT)
I20260709 12:58:11.959535  4461 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:11.941752  4589 consensus_queue.cc:1059] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:58:12.020597  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:11.962131  4438 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:58:12.000451  4675 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:12.025157  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:12.008702  4612 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:12.051489  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.057050  4673 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:12.020084  4550 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:11.935498  4619 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.062234  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:12.065491  1647 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:58:12.065956  1647 pending_rounds.cc:85] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 6
I20260709 12:58:12.066229  1647 pending_rounds.cc:107] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:58:12.066505  1647 raft_consensus.cc:2889] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:12.018908  4410 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:12.017638  4691 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:12.017613  4708 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:12.074965  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.002779  4666 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.017364  4552 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:58:12.059758  4612 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.082515  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.092069  1718 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
W20260709 12:58:12.092890  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.106407  1647 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:12.081789  4690 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:12.113137  4690 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:12.072988  4545 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:12.075284  4675 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.074710  4691 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:12.116851  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 217300us
W20260709 12:58:12.112498  4698 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:58:12.124786  4704 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:12.125115  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 119853us
I20260709 12:58:12.125068  4410 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.126621  4276 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.107688  4612 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:12.127678  4461 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.086519  4583 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.068601  4147 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:12.133031  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1590) took 1040 ms. Trace:
I20260709 12:58:12.131912  4678 raft_consensus.cc:3055] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:12.136109  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:12.188544  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 131513us
I20260709 12:58:12.194666  1644 raft_consensus.cc:2410] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:12.136932  1646 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:12.142037  1647 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:12.174618  1638 raft_consensus.cc:3055] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:12.137761  4691 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:12.124778  4701 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:12.175458  1643 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:12.178682  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:12.204360  4680 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:12.127089  4564 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:12.181674  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:12.113525  4690 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:12.081743  4511 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:58:12.187667  1640 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:12.107836  4711 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:12.214841  1684 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:12.216024  1684 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:12.117180  4545 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.086597  4708 raft_consensus.cc:697] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:12.191052  1721 rpcz_store.cc:276] 0709 12:58:11.092539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.092775 (+   236us) service_pool.cc:224] Handling call
0709 12:58:11.132380 (+ 39605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.492984 (+360604us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:11.526083 (+ 33099us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.635754 (+109671us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.921505 (+285751us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:11.921576 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:11.921661 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:12.132707 (+211046us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54002c33d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:12.132783 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.132950 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39388,"prepare.queue_time_us":165697,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":31420,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":203,"spinlock_wait_cycles":828695168,"thread_start_us":382078,"threads_started":3,"wal-append.queue_time_us":95305}
W20260709 12:58:12.198191  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 145063us
I20260709 12:58:12.196280  1638 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:12.218487  4708 consensus_queue.cc:237] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.219431  1638 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.221004  1638 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:12.222108  4545 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:12.236783  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 55217.2us
I20260709 12:58:12.217193  4564 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:12.196571  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:12.238783  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 416014us
W20260709 12:58:12.241168  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44704.2us
I20260709 12:58:12.253719  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.254951  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:12.255995  1647 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:12.256271  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.256986  1646 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:12.194010  4678 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:12.144667  4675 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.276628  1638 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 12:58:12.273262  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.279868  1638 pending_rounds.cc:85] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 5
I20260709 12:58:12.280186  1638 pending_rounds.cc:107] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:58:12.239821  4583 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.280459  1638 raft_consensus.cc:2889] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:12.245509  4312 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:12.282246  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.143573  4550 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.287169  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.258363  4147 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:12.284281  4692 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:58:12.285147  1646 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:12.289734  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:12.293624  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 117353us
I20260709 12:58:12.233031  4690 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.281072  4552 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:12.276957  4589 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:12.303601  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:12.297392  4618 consensus_meta.cc:287] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.003s
W20260709 12:58:12.297283  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 81347.9us
I20260709 12:58:12.297279  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.306855  1647 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:12.307327  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.300225  4575 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:12.290659  4711 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:12.295188  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 76160us
W20260709 12:58:12.299950  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.288276  4564 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:58:12.301252  4449 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:12.300822  4680 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:12.300504  4312 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:12.288061  4583 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:12.318064  1535 leader_election.cc:336] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 1.874s (SENT)
I20260709 12:58:12.303846  4701 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.333135  1535 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.348783  4717 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:12.350330  4711 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:12.350950  4711 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:12.353206  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.354498  4709 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:12.355242  4709 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.308705  4552 raft_consensus.cc:697] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:12.359251  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.360539  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.366549  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:12.368397  4697 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
W20260709 12:58:12.370247  4710 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:58:12.371320  4714 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:58:12.374698  4276 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:12.376443  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.378181  1645 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:58:12.378643  1639 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:58:12.385185  1639 pending_rounds.cc:85] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 3
I20260709 12:58:12.385416  1639 pending_rounds.cc:107] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:58:12.385633  1639 raft_consensus.cc:2889] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:12.379387  4312 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.380817  4701 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:12.350958  3973 consensus_meta.cc:287] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.555s	user 0.002s	sys 0.008s
I20260709 12:58:12.318248  4589 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:12.340476  4700 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:58:12.381902  4666 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:12.393841  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 75796.5us
I20260709 12:58:12.396116  1645 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:12.308604  4618 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.400465  1644 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:12.394333  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 60740.9us
I20260709 12:58:12.410521  1686 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.409910  1647 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:12.370275  4438 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.366894  4709 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:12.316962  4703 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.206s
I20260709 12:58:12.331231  4575 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.426613  1639 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:12.435003  1535 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:58:12.418895  4643 consensus_meta.cc:287] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 12:58:12.316040  4678 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.439504  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:12.449541  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.443249  4643 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.450420  4725 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:12.451460  4643 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.454655   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:12.455956  1645 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:12.458424  1535 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:12.400293  4612 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.406301  3973 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.475745  2340 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:12.493463  4552 consensus_queue.cc:237] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.476382  4337 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:12.495014  3973 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:12.476665  4726 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:12.477771  4690 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:12.480116  4618 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:12.473340  4669 consensus_meta.cc:287] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.003s
I20260709 12:58:12.480651  4708 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:12.426030  4438 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.483341  4691 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.484493  4705 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.485373  4589 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.390565  4717 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:58:12.486805  4675 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:12.457337  4564 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:12.491654  4682 raft_consensus.cc:3055] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:12.467020  4729 consensus_queue.cc:1059] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:58:12.492848  4666 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:58:12.441752  4545 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.486334  4701 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:12.497215  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 71505.9us
W20260709 12:58:12.502921  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44591us
I20260709 12:58:12.520803  1535 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.454816  4611 raft_consensus.cc:2764] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:58:12.496534  4702 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.219s	user 0.000s	sys 0.003s
W20260709 12:58:12.497809  4693 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:58:12.518222  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.499800  4583 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:12.524340  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 138953us
I20260709 12:58:12.498884  4575 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:12.510170  4617 consensus_meta.cc:287] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.732s	user 0.006s	sys 0.006s
I20260709 12:58:12.496721  4708 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:12.496629  4669 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.533134  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:12.519325  4682 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:12.536239  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 125814us
I20260709 12:58:12.532907  4576 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.537459  4576 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.537976  1686 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.538427  4691 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:12.539049  4691 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:12.539611  4576 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:12.531049  4564 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:12.540880  4564 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.541796  3973 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:12.542155  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 374) took 1463 ms. Trace:
I20260709 12:58:12.543433  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:12.542562  1641 rpcz_store.cc:276] 0709 12:58:11.078673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.078825 (+   152us) service_pool.cc:224] Handling call
0709 12:58:11.087924 (+  9099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.697739 (+609815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.697777 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.698299 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.940482 (+242183us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:11.960433 (+ 19951us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.960895 (+   462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.961156 (+   261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:12.497048 (+535892us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:12.541837 (+ 44789us) raft_consensus.cc:1685] finished
0709 12:58:12.541942 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:12.542060 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":596586,"prepare.queue_time_us":19269,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":747415,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":185,"spinlock_wait_cycles":11401472,"thread_start_us":241792,"threads_started":1,"wal-append.queue_time_us":499538}
I20260709 12:58:12.541235  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.544416  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:12.544608  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.546167  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:12.547276  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:12.510568  4705 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.533054  4708 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:12.559808  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:12.561563  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:12.544780  4701 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:12.592478  1720 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:12.544549  4617 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.550946  4589 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:12.549467  4611 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.597704  2346 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:12.544126  3973 raft_consensus.cc:2764] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:58:12.551083  4738 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:12.627951  4738 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:12.615185  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:12.629341  1714 raft_consensus.cc:2410] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:12.628377  4738 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:12.631647  4612 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.632978  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:12.633620  1714 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:12.640331  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:12.624217  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 74807us
I20260709 12:58:12.642067  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.568940  4461 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.626608  4611 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.593549  4552 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:12.649662  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 108483us
I20260709 12:58:12.543990  4711 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.614295  4276 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:12.551062  4576 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:58:12.658742  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:12.660910  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:12.637408  4717 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.669234  1686 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.671854  4675 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:12.673758  1535 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.653173  4147 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.652372  4701 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:12.653554  4552 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:12.617600  4617 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.676849  4675 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:12.661613  4550 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.661978  4618 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.661845  4729 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:12.687541  4690 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:12.681205  4680 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:58:12.693229  4618 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:12.693660  4733 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:58:12.695952  4737 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:58:12.677384  4682 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.697145  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.697465  4735 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:12.697999  4701 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:12.698089  4735 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:12.698701  4711 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.699486  1535 leader_election.cc:400] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7.
I20260709 12:58:12.699172  4735 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:12.701470  4739 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:58:12.704926  1566 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:12.686141  4717 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.706873  1563 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:58:12.706805  3973 consensus_queue.cc:1059] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:12.707886  3973 raft_consensus.cc:3055] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:12.708060  4717 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.708491  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:12.709283  1565 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:12.709789  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:12.654218  4461 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.712064  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:12.699787  1535 leader_election.cc:403] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:12.677946  4589 raft_consensus.cc:697] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:12.717271  1570 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:12.707994  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:12.718598  1564 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:12.713173  1717 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:12.715833  1571 raft_consensus.cc:2410] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:12.686759  4552 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:12.708321  3973 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:12.728255  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:12.730376  1564 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:12.717666  4438 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.686601  4147 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.737970  4147 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:12.744108  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:12.697497  4682 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:12.747860  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:12.749140  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:12.750907  1564 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:12.752779  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:12.756507  1569 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:12.749612  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:12.761577  1565 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:12.806915  1564 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:12.735605  4701 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:12.748433  4612 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:58:12.817689  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:12.818145  4461 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:12.822736  4740 consensus_queue.cc:1175] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:58:12.828846  4708 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.802736  4276 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:12.732897  4550 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.710829  4729 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.755811  4147 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 12:58:12.830062  4669 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.854759  1563 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:12.866261  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.846215  4312 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:12.881613  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 132547us
I20260709 12:58:12.890730  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.891496  1647 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:12.892778  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.893424  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.893834  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.894394  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:12.892912  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.894982  1721 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:12.893962  1643 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:12.895013  1646 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:12.905797  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.905956  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:12.906641  1645 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:12.906744  2345 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:12.907510  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.908066  1642 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:12.912894  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.913007  4670 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.914335  4670 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:12.915611  4619 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:12.917634  4749 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:58:12.918305  4729 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:12.919142  4708 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.905892  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.925221  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.925665  4611 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:12.871507  4589 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.926466  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:12.927090  1640 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:12.927182  3973 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.928418  3973 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:12.925254  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:12.930800  4738 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.938001  1642 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:12.939566  1643 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:12.896351  4705 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:12.879896  4312 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.939065  2345 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:12.943671  1714 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
W20260709 12:58:12.948239  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:12.948819  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.949579  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:12.953240  1717 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:12.953966  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:12.956772  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.959419  4312 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.962725  4735 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:12.963559  4276 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.964080  4276 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:12.965117  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.966204  4276 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:12.963286  4735 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:12.968729  4696 raft_consensus.cc:3055] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:12.969122  4696 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:12.969637  4735 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:12.969930  4696 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.970981  4696 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:12.971052  4550 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:12.971385  4690 raft_consensus.cc:3055] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:12.971784  4690 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:12.972623  4690 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:12.973280  2347 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:12.973575  4690 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:12.981391  1565 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:12.942967  4691 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:12.984486  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:12.985183  2347 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:13.031597  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:13.048516  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:13.037818  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.095358  1571 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:13.103547  1642 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:13.056830  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:13.105190  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 48492.5us
I20260709 12:58:12.997788  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:13.106995  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 109285us
I20260709 12:58:13.037117  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:12.992899  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:12.952903  4438 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:12.983321  1612 connection.cc:256] RPC call timeout handler was delayed by -2.0867734010000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 12:58:13.114257  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1436381579999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 12:58:13.115456  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0257381579999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 12:58:13.116708  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:13.116840  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:13.113337  4550 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:13.120221  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:13.120988  1571 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:13.118459  4550 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.121503  4717 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:13.121734  4550 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:13.125464  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:13.126619  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:13.127213  4545 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:13.127597  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:13.128167  1569 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:13.113500  4760 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:13.129153  4760 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.129297  4703 raft_consensus.cc:3055] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:13.129529  4760 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:13.129784  4703 raft_consensus.cc:740] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:13.130743  4703 consensus_queue.cc:260] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.132009  4703 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:12.992151  4618 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:13.038661  4706 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.139524  1565 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:13.136922  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:13.141948  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:13.142603  1568 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:13.145151  4738 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.149649  4701 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7.
I20260709 12:58:13.151968  4552 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.152770  4706 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.157125  1570 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:13.158166  4589 consensus_queue.cc:1059] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:13.159216  4717 raft_consensus.cc:3055] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:13.159616  4717 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:13.159858  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:13.160578  4717 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.161895  4717 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:13.162657  4552 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:13.163760  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.164507  4760 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.166640  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1681) took 1199 ms. Trace:
I20260709 12:58:13.167037  1572 rpcz_store.cc:276] 0709 12:58:11.968104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.972789 (+  4685us) service_pool.cc:224] Handling call
0709 12:58:13.166440 (+1193651us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400184cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:13.166581 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274547456}
I20260709 12:58:13.168296  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:13.182044  1572 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:13.180764  1564 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:13.179942  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:13.189265  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:13.181027  1570 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:13.190006  1571 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:13.185701  1647 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:13.178817  1569 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:13.191869  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:13.197294  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:13.202783  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:13.203059  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.203860  1642 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:13.204806  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.206317  1641 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:13.206765  1641 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:13.118625  4438 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.196835  4670 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:13.223827  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:13.222424  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:13.223801  1641 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.226372  4717 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:13.230736  4715 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:13.240491  4715 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.240675  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:13.232333  4753 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.241640  4753 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.240900  4715 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:13.241845  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.240728  1563 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:13.239518  1686 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:13.252674  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.264180  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:13.225359  4670 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.265199  1566 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:13.208263  4695 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:58:13.270205  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.271092  1642 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:13.272723  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.273972  1641 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:13.277171  1686 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:13.279690  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.269599  4670 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:13.280575  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:13.272471  4724 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:13.272156  4720 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.278199  4741 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:13.287403  4741 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:13.288206  4741 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.289505  4741 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:13.293331  4720 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.295920  4678 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:13.298703  4550 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.282662  4724 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:13.301429  4701 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:13.301501  4724 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:13.302085  4701 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:13.303208  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.304149  4701 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.285082  4740 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:13.306802  1571 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:58:13.307153  1571 pending_rounds.cc:85] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 4
I20260709 12:58:13.307361  1571 pending_rounds.cc:107] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:58:13.307585  1571 raft_consensus.cc:2889] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:13.309273  4720 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:13.309863  4701 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.310420  4701 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.311096  1572 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:58:13.311355  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:13.312330  1572 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:13.314533  4701 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.314831  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:13.315563  1565 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:58:13.316668  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.319854  1571 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:13.334601  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 131919us
W20260709 12:58:13.335187  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 58085us
I20260709 12:58:13.335924  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:13.342478  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.347322  1641 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:13.349304  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:13.351344  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:13.355542  4545 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:13.354995  1686 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:13.362629  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:13.363762  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:13.367161  3973 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:13.339035  4701 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:13.339634  4550 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.427270  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:13.427805  3973 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:13.428201  1641 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:13.352676  4738 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:13.435122  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.440914  4770 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:13.441560  4770 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.444880  4618 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.445425  4618 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.447695  4618 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:13.453059  3973 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:13.454270  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 101236us
I20260709 12:58:13.456612  4701 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.457381  4753 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:13.459510  4701 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.460050  4701 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:13.464421  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 96584.9us
I20260709 12:58:13.465415  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:13.429834  4386 raft_consensus.cc:670] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:13.369083  4545 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:13.472455  1641 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:13.474706  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:13.515245  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:13.518175  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:13.518981  1641 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:58:13.391207  4682 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
W20260709 12:58:13.563845  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 97733.6us
I20260709 12:58:13.578861  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:13.460495  4701 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.589037  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:13.503185  4545 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.591094  4717 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:13.563486  4643 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:13.558137  4589 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:13.569733  4410 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:13.567945  4770 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.571424  4552 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.656536  1641 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
W20260709 12:58:13.674736  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:13.702260  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 123491us
I20260709 12:58:13.625025  4545 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:13.726647  4740 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:13.726981  4724 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.729508  4724 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:13.639992  4410 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.626849  4738 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.625222  4717 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.748466  4717 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:13.748404  4738 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.751081  4738 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.716897  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:13.753230  1641 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:13.754199  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:13.754835  1641 raft_consensus.cc:2376] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6. Re-sending same reply.
I20260709 12:58:13.755725  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.746166  4701 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:13.715682  4770 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:58:13.715430  4552 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:13.758999  4552 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:13.747691  4410 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:13.756215  1641 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:58:13.600765  4695 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 12:58:13.765781  4695 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:13.766108  4695 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:13.766894  4695 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.767961  4695 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:13.774677  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.781469  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.782119  1641 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:13.782647  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.783346  1641 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:13.718437  4589 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:13.784664  4589 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.775569  4670 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:13.788671  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.788844  1641 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:13.777958  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:13.788564  1567 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:13.780117  4717 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:13.802531  4675 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.730106  4724 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:58:13.807726  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.808971  1641 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:13.802007  4670 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.814975  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:13.805894  4337 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:13.816123  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.825575  1638 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:13.808568  4611 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:13.808555  4701 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:58:13.808908  4675 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.867131  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:13.869199  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1718) took 1733 ms. Trace:
I20260709 12:58:13.873021  1644 rpcz_store.cc:276] 0709 12:58:12.135330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.354284 (+218954us) service_pool.cc:224] Handling call
0709 12:58:12.354576 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:12.410130 (+ 55554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.868956 (+1458826us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b5400265cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:13.869138 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74699136}
I20260709 12:58:13.873522  1641 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:13.832583  4337 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:13.887603  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 184316us
W20260709 12:58:13.880378  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 289934us
W20260709 12:58:13.895083  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.895795  4719 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:13.870175  4678 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:13.880797  4741 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.004s
I20260709 12:58:13.902912  1568 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:13.902143  1572 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:13.903741  1641 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:13.904956  1644 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:58:13.905448  1644 pending_rounds.cc:85] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 3
I20260709 12:58:13.905722  1644 pending_rounds.cc:107] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:58:13.906037  1644 raft_consensus.cc:2889] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:13.921062  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:13.925449  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:13.900434  4715 consensus_meta.cc:287] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.003s
I20260709 12:58:13.879349  4611 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.935246  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:13.947211  3973 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:13.947280  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:13.948098  1565 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:13.947979  3973 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:13.954346  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:13.953748  4738 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.957145  1641 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 12:58:14.002151  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:14.003634  1720 raft_consensus.cc:2368] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7.
I20260709 12:58:13.952924  4552 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.005028  4552 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.007486  4552 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.924759  4741 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:58:13.954983  1572 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:14.017685  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.018636  1720 raft_consensus.cc:2368] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:13.993153  3973 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.019372  4337 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:13.954442  4780 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:58:14.020176  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.021144  4780 raft_consensus.cc:3055] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:14.021523  4780 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:14.022294  4780 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.023432  4780 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.026405  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.027007  1572 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:14.028264  1572 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:58:14.029245  4777 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:58:14.030073  4410 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:14.030699  4775 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:58:14.032238  4410 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.033080  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:14.034052  4575 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:14.035327  4611 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.037976  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1887) took 1006 ms. Trace:
I20260709 12:58:14.038348  1563 rpcz_store.cc:276] 0709 12:58:13.031498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.249443 (+217945us) service_pool.cc:224] Handling call
0709 12:58:13.249821 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:13.257763 (+  7942us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:13.257803 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:13.269733 (+ 11930us) log.cc:844] Serialized 26 byte log entry
0709 12:58:13.466453 (+196720us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:13.466489 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.466577 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.037778 (+571201us) raft_consensus.cc:1685] finished
0709 12:58:14.037807 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.037921 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7440,"raft.queue_time_us":8041,"spinlock_wait_cycles":3808512,"thread_start_us":193738,"threads_started":1,"wal-append.queue_time_us":595641}
I20260709 12:58:14.009121  4643 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:14.013671  1565 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:14.015604  1566 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:14.040624  1563 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:14.044967  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.053098  1720 raft_consensus.cc:2410] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:58:14.051352  1718 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:14.056159  1718 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:14.057118  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 243670us
I20260709 12:58:13.959231  4725 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.057950  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:14.059188  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:14.033111  4774 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:58:14.064674  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:14.065461  1714 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:14.061571  1720 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:14.008772  4717 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.036298  4575 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:58:14.018656  4675 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:13.939962  4715 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.107547  1714 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:14.080432  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:14.108865  1718 raft_consensus.cc:2368] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:58:14.058235  4410 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:14.001551  4738 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.041776  4643 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.138702  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:14.132073  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 74173us
I20260709 12:58:14.080221  4780 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:14.132463  4781 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.109946  4611 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:14.142994  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:14.079660  4725 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.096884  4695 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:14.144199  1718 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:14.147668  1714 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:14.135004  4787 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:14.150389  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:14.157133  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:14.133869  4410 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.162592  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:14.165395  1718 raft_consensus.cc:2410] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:14.154024  4675 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:14.174510  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:14.177891  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.160578  4678 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:14.179318  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:14.179721  4701 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:14.181260  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:14.178584  4611 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:14.163290  4695 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.228446  1639 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 12:58:14.230037  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.232257  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 1890) took 1199 ms. Trace:
I20260709 12:58:14.232894  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.243774  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:14.249873  1647 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:14.241117  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.249055  1563 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:14.247503  1570 rpcz_store.cc:276] 0709 12:58:13.032359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.159597 (+127238us) service_pool.cc:224] Handling call
0709 12:58:14.232052 (+1072455us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b5400112954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:14.232182 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19703168}
I20260709 12:58:14.267649  1647 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:14.151232  4780 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.269910  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:14.275817  1563 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.271363  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.272818  2345 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:14.273379  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.244040  4438 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.176834  4675 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.274070  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.146908  4781 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.234463  4704 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:14.281056  2346 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
W20260709 12:58:14.199260  4744 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 1.333s	user 0.003s	sys 0.010s
I20260709 12:58:14.276662  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:14.239718  4725 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:14.158416  4787 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.238425  4738 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.237380  4611 raft_consensus.cc:697] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:14.305389  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.306005  1570 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:58:14.243466  4695 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.287842  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.306921  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.307605  1718 raft_consensus.cc:2410] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:14.307541  1570 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:58:14.243844  4617 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.240178  4715 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:14.283211  4675 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:14.305616  4611 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.286983  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.308355  2314 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:14.286568  4545 consensus_meta.cc:287] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.002s
I20260709 12:58:14.288914  4704 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.312897  2348 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:14.318060  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:14.311194  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.321568  4480 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:14.295171  4438 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:14.330103  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:14.296078  4678 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:14.325480  1718 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:14.334142  1563 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:14.343524  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:14.358677  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 178341us
I20260709 12:58:14.334185  4438 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.361007  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:14.361511  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.365301  1718 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:14.333818  4715 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:14.368899  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 154879us
I20260709 12:58:14.385409  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:14.386205  2348 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.331508  4704 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.357246  4410 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.368379  4708 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:14.357859  4678 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:14.319892  4545 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.397656  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.399039  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.403519  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:14.367934  4438 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:14.409009  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.387620  4715 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:14.386898  4701 raft_consensus.cc:697] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:14.396525  4784 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.397069  4708 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.422529  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:14.418329  4410 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:14.421494  4715 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.452903  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:14.427570  4618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.003s	sys 0.029s
I20260709 12:58:14.457950  4796 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:14.458477  4789 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:58:14.438941  4797 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:14.433957  4784 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.517413  4797 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.461666  4787 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.464990  4410 raft_consensus.cc:697] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:14.428545  4708 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:14.487277  4786 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.453s	user 0.000s	sys 0.002s
I20260709 12:58:14.513762  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:14.514267  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.518936  4675 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.567231  1714 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:14.569667  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.570389  1570 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
I20260709 12:58:14.580469  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:14.480515  4618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.003s	sys 0.029s
I20260709 12:58:14.520071  4589 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:14.591202  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.518955  4796 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.565066  4480 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.593959  4589 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.597162  4410 consensus_queue.cc:237] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.598191  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.598767  2340 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:14.599359  4589 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.593245  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.567456  4799 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:14.565642  4781 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:14.592084  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.570390  4801 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:14.587391  2345 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:14.609617  4438 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.615633  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.620236  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1735) took 1431 ms. Trace:
I20260709 12:58:14.620795  1646 rpcz_store.cc:276] 0709 12:58:13.188438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.783686 (+595248us) service_pool.cc:224] Handling call
0709 12:58:13.784008 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:13.784386 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:13.784413 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:13.784859 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:58:13.905801 (+120942us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:13.905838 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.905903 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.486559 (+580656us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:14.615338 (+128779us) raft_consensus.cc:1685] finished
0709 12:58:14.615361 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.620156 (+  4795us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":48594816,"thread_start_us":120623,"threads_started":1,"wal-append.queue_time_us":231757}
I20260709 12:58:14.623025  4760 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.623713  4760 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.628114  1720 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:14.592370  4735 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:14.624182  4760 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.594192  4701 consensus_queue.cc:237] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.632627  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.633351  1566 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:14.520464  4678 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.636437  2346 raft_consensus.cc:2393] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 11: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:14.638149  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:14.638530  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.639299  2349 raft_consensus.cc:2393] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:14.642813  1720 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:58:14.638701  1566 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:14.645604  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:14.647025  2345 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:14.647897  1684 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:14.649464  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.620775  4784 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.649564  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:14.650219  1570 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:14.651813  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:14.664301  1569 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.631829  4797 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:14.669133  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 207790us
I20260709 12:58:14.665328  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:14.605468  4480 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.683236  1720 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:14.688416  1566 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:14.649370  4738 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:14.650389  4617 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:14.664333  4725 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:14.675005  4724 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:14.664786  4545 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:14.617622  4799 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.697853  2347 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:14.636782  4735 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.698472  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.664389  4781 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:58:14.703655  1569 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:14.705830  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.706087  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:14.629017  4801 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.732615  4337 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:14.733052  4337 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:14.733786  4801 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.734104  4611 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:14.733999  4337 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.734555  4611 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:14.734964  4611 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:14.735121  4337 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.735698  4480 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.736948  4675 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.738828  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:14.740262  1712 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:14.740789  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:14.727335  1720 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:14.684674  4691 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:14.728905  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:14.742522  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.743081  2349 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:14.743172  1719 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:14.731050  1570 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:58:14.725728  2348 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:14.745537  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.745702  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:14.701380  4725 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.687239  4703 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:58:14.687085  4690 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:58:14.691169  4550 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:58:14.749881  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.758113  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.758035  1713 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
W20260709 12:58:14.762475  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 69898.9us
I20260709 12:58:14.701412  4617 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.768321  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:14.751243  4725 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.747164  4545 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.778103  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.786017  1713 raft_consensus.cc:2410] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:14.796617  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.797643  1719 raft_consensus.cc:2410] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:58:14.772420  4809 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:14.809645  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.810449  1720 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
W20260709 12:58:14.815873  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 96830.7us
I20260709 12:58:14.817164  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:14.785892  4801 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:58:14.825367  4802 log.cc:927] Time spent T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:58:14.796036  4770 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.829041  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:14.787530  4545 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.821458  4809 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:14.828152  4618 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:14.839125  4678 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:58:14.852252  4803 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:58:14.838297  4801 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.835983  4438 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.856383  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.841780  4724 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:14.835502  4770 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.874452  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:14.849617  4618 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:14.881230  4809 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.881434  4708 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.876005  4784 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:14.884083  4738 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:14.884910  4804 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:58:14.888505  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:14.968448  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.893484  1646 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:14.893761  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:14.970062  1647 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:14.970923  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.972059  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:14.972132  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.895251  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.972922  1571 raft_consensus.cc:2393] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:14.973188  1645 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:14.903326  4819 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:14.973548  4706 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.973822  4819 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:14.974086  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:14.974635  1645 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.973815  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:14.923465  4735 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.974927  4819 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.975478  1571 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:14.896976  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.976938  1641 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:14.977329  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.977759  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.978343  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:14.978778  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.979159  4801 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.979718  4801 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:14.979857  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.902839  2348 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:14.852818  4799 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:14.981544  4741 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.982064  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:14.982416  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:14.983098  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.983601  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:14.984119  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:14.922348  1567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1697) took 2175 ms (client timeout 2573 ms). Trace:
I20260709 12:58:14.984567  4787 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:14.984804  1567 rpcz_store.cc:269] 0709 12:58:12.727924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.728031 (+   107us) service_pool.cc:224] Handling call
0709 12:58:14.902668 (+2174637us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001a8954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:14.902767 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436650880}
I20260709 12:58:14.985334  4787 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:14.985510  4704 consensus_meta.cc:287] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 12:58:14.985854  4787 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.985941  4704 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.986171  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.943830  4715 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:14.944772  4820 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 12:58:15.015605  2349 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:14.944908  4611 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.946563  4724 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:14.947870  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.950176  4708 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.950686  4784 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.033964  4784 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.997591  4738 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:15.037194  4738 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:15.039700  4780 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:15.031589  1645 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:14.952267  1639 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:14.952934  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:14.957448  4811 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:58:14.960803  1565 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:14.961174  4770 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.904325  4618 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.908447  4701 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:58:14.963975  1563 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:14.964169  4545 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:14.965112  1568 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:14.870431  4760 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.965161  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1614) took 1655 ms. Trace:
I20260709 12:58:15.062196  1644 rpcz_store.cc:276] 0709 12:58:13.309501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.878702 (+569201us) service_pool.cc:224] Handling call
0709 12:58:13.879018 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.941550 (+ 62532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.964865 (+1023315us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5400336154. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:14.965082 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58937216}
I20260709 12:58:15.063519  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:15.064098  1644 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:15.064913  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:15.065421  1644 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.892030  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.985061  4813 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:15.067178  2343 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:14.984637  1646 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:14.937646  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:14.987901  4787 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:14.939175  1638 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:14.867619  4678 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:14.988305  4741 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:14.989101  2314 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:14.909022  4438 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:58:15.078745  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 89712.7us
I20260709 12:58:15.079067  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:14.989696  4706 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:14.990600  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.995532  4725 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.000037  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:15.205606  1564 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:15.000226  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:15.000836  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:15.207419  1569 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:15.004916  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:15.005653  1647 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:15.209250  2312 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:15.006165  1641 raft_consensus.cc:2410] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:15.013407  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:15.013967  1686 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:14.987919  4704 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:15.020992  1642 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:15.027081  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:14.979116  4617 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:15.031678  4715 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:15.041661  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:15.066118  1535 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:15.228996  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 162939us
I20260709 12:58:15.067260  2345 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:14.986203  4740 raft_consensus.cc:3055] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:15.047552  4799 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.073329  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:15.020267  4696 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:58:15.111124  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:15.106570  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.095691  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:15.239255  1719 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:15.239543  1643 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:15.123529  1644 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:15.100358  4813 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.109508  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:15.247145  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.247570  1712 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
W20260709 12:58:15.247797  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 252687us
I20260709 12:58:15.101790  4735 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:15.111892  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.255714  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.256301  1714 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:15.111076  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.102416  4337 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:15.102994  4438 raft_consensus.cc:697] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:15.110452  1721 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:15.273902  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:15.174752  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.195425  1718 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:15.195789  1563 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:15.067806  4708 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:58:15.181468  4796 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:15.053875  4822 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:58:15.190886  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:15.124294  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:15.080886  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:15.100540  4741 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:15.113897  4811 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:58:15.095752  4812 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:15.078380  4545 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.567391  4812 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.567502  4545 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:15.570007  4812 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:15.570165  4480 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:15.075265  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:15.571581  1568 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:15.571710  1717 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:15.055006  4826 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.098266  4678 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.204514  1646 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
W20260709 12:58:15.225569  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 220716us
W20260709 12:58:15.226121  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 212244us
I20260709 12:58:15.602797  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:15.233621  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:15.235759  1569 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:15.227087  4619 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:15.257242  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.258387  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.605475  1712 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:15.231355  4670 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.259620  1716 raft_consensus.cc:2393] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:15.234196  4781 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:15.233175  4738 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:15.260937  1612 leader_election.cc:400] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:15.234274  4740 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:15.253551  4735 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:15.241892  4799 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.635703  4670 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.257769  4813 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.306708  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:15.259574  4337 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.661754  4337 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:15.664897  4670 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:15.437311  4618 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:15.439343  4832 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.670703  4832 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:15.671707  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:15.446964  1719 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:15.596590  4704 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:15.447458  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:15.674273  1720 raft_consensus.cc:2376] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8. Re-sending same reply.
I20260709 12:58:15.240890  4617 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:15.448153  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.232379   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:15.274303  4784 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.531320  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1913) took 1124 ms. Trace:
I20260709 12:58:15.540380  1639 raft_consensus.cc:2410] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:58:15.541132  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 267297us
I20260709 12:58:15.566066  4611 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:15.527334  4819 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.605475  1714 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:15.623142  4822 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:15.623826  1566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.029s	sys 0.016s
I20260709 12:58:15.528575  4703 raft_consensus.cc:3055] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:15.570819  4480 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:15.735414  4480 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:15.694412  4617 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:15.737097  4617 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:15.635016  1612 leader_election.cc:403] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:15.656167  1713 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:15.634825  4738 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:15.677937  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.701609  1570 rpcz_store.cc:276] 0709 12:58:14.407342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.761703 (+354361us) service_pool.cc:224] Handling call
0709 12:58:14.775616 (+ 13913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:14.785539 (+  9923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:14.785573 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:14.786043 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:58:14.937185 (+151142us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:14.937603 (+   418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.937672 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:15.531086 (+593414us) raft_consensus.cc:1685] finished
0709 12:58:15.531113 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:15.531255 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1473,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":9984,"thread_start_us":110861,"threads_started":1,"wal-append.queue_time_us":426029}
W20260709 12:58:15.745002  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 620799us
I20260709 12:58:15.622640  4619 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.531247  4780 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:15.673162  4832 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:15.726389  1566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.029s	sys 0.024s
I20260709 12:58:15.730145  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:15.729537  4703 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:15.695050  4704 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.780596  4619 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:15.803128  4704 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:15.802935  4703 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.803269  1469 catalog_manager.cc:5697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 5, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:15.733070  4438 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:15.807468  4836 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:58:15.806771  4735 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.808218  4735 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:15.810297  4619 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:15.813277  4825 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:58:15.780907  4738 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:15.739601  4819 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.625831  4826 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.812376  4619 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:15.725677  4784 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.780761  4780 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:15.929822  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:15.930474  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.930491  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.932296  1716 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:15.932806  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.933759  1712 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:58:15.934422  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 331558us
I20260709 12:58:15.936278  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.937208  1717 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:15.931663  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:15.941424  1646 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:58:15.941784  1646 pending_rounds.cc:85] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 3
I20260709 12:58:15.942047  1646 pending_rounds.cc:107] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:58:15.942294  1646 raft_consensus.cc:2889] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:15.943028  1684 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:15.945470  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:15.961927  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 130147us
W20260709 12:58:15.962875  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.962942  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.963639  1721 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:15.968096  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.968447  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.968456  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:15.969940  1717 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:15.971156  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.972222  1646 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:58:15.974987  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:15.986145  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:15.987835  1721 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:15.989339  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:15.989950  1646 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:15.991008  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 730181us
I20260709 12:58:15.991691  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:15.992511  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.993124  1720 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:15.994722  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.994972  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:15.995723  4611 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.996191  4611 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:15.997958  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:16.002630  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:15.864425  4808 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:15.825503  4725 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.007557  2346 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:58:15.999773  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:16.015762  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.016589  1717 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:15.863011  4826 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:15.968115  4618 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:15.973212  4822 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:15.979760  4708 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:16.003450  4611 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.042426  4780 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:15.989653  4832 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:58:16.028935  4696 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:58:16.041240  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 70483.7us
W20260709 12:58:16.041805  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 102474us
I20260709 12:58:15.989455  4719 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:16.045823  1717 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:15.989850  4724 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.990458  4690 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:16.025833  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:15.990345  4703 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.042269  4550 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:15.999368  4828 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:16.123785  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 94157us
I20260709 12:58:16.102352  4695 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.140065  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1759) took 1131 ms. Trace:
I20260709 12:58:16.061849  4822 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.154906  1721 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:58:16.164726  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.165391  1717 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:58:16.221869  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1612) took 1035 ms. Trace:
I20260709 12:58:16.020013  4812 consensus_queue.cc:1059] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:58:16.062534  4813 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.035918  1646 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:16.241724  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.124260  4337 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.225816  4690 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.242914  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.104626  4819 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.039264  4808 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.217885  1644 rpcz_store.cc:276] 0709 12:58:15.008480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.527942 (+519462us) service_pool.cc:224] Handling call
0709 12:58:15.528305 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.528561 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:16.030250 (+501689us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.139575 (+109325us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.139648 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:16.139720 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.139812 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.139988 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105718,"raft.queue_time_us":5508,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10214,"thread_start_us":465737,"threads_started":2}
I20260709 12:58:16.222225  1717 rpcz_store.cc:276] 0709 12:58:15.186346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.164593 (+978247us) service_pool.cc:224] Handling call
0709 12:58:16.164941 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:16.221592 (+ 56651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.221808 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:16.139832  4617 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.156327  4550 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:16.238291  4840 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:58:16.124083  4708 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.302390  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1614) took 1115 ms. Trace:
I20260709 12:58:16.302938  1717 rpcz_store.cc:276] 0709 12:58:15.186957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.301266 (+1114309us) service_pool.cc:224] Handling call
0709 12:58:16.301704 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:16.301967 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:16.302003 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.302057 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:16.302112 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.302180 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.302318 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:16.305577  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1616) took 1118 ms. Trace:
I20260709 12:58:16.306015  1717 rpcz_store.cc:276] 0709 12:58:15.187568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.304655 (+1117087us) service_pool.cc:224] Handling call
0709 12:58:16.305004 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:16.305203 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:16.305237 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.305293 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:16.305336 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.305398 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.305516 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:16.307817  1717 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:16.242954  4690 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:16.244379  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.309947  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.310663  1644 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:16.210456  4724 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.221289  4780 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:16.249493  4837 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:58:16.225212  4822 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:16.227576  4781 consensus_queue.cc:1059] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:58:16.326033  1684 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:16.255872  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 230155us
I20260709 12:58:16.225252  4695 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.256443  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:16.308439  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1618) took 1120 ms. Trace:
W20260709 12:58:16.310773  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 160115us
I20260709 12:58:16.315408  2345 raft_consensus.cc:2368] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7.
W20260709 12:58:16.311713  1613 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:43765, user_credentials={real_user=slave}} blocked reactor thread for 53070us
I20260709 12:58:16.210809  4799 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.320806  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1761) took 1301 ms. Trace:
I20260709 12:58:16.301009  4550 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:16.330796  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.341539  1644 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
W20260709 12:58:16.336051  1647 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.021s	sys 0.054s
W20260709 12:58:16.342693  1647 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.022s	sys 0.054s
I20260709 12:58:16.335037  1717 rpcz_store.cc:276] 0709 12:58:15.188150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.307101 (+1118951us) service_pool.cc:224] Handling call
0709 12:58:16.307419 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:16.308193 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.308384 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:16.332056  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:16.226577  4826 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 12:58:16.310981  4696 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:16.323232  4819 raft_consensus.cc:3055] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:16.315982  4843 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:58:16.367174  4838 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 12:58:16.221479  4828 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:16.373739  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 45640.4us
W20260709 12:58:16.368029  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 401521us
I20260709 12:58:16.368259  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:16.375507  1644 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:16.371233  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:16.372725  4842 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:58:16.333524  4812 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:16.373621  1641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.029s	sys 0.024s
W20260709 12:58:16.379184  1641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.029s	sys 0.024s
I20260709 12:58:16.351589  4725 raft_consensus.cc:3055] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:16.354496  4781 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.384956  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1755) took 1486 ms. Trace:
I20260709 12:58:16.385938  1638 rpcz_store.cc:276] 0709 12:58:14.898061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.196982 (+298921us) service_pool.cc:224] Handling call
0709 12:58:15.197418 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:15.197887 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:15.197931 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:15.198609 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 12:58:15.415103 (+216494us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:15.930738 (+515635us) log.cc:844] Serialized 14 byte log entry
0709 12:58:15.938455 (+  7717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.938527 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:16.384706 (+446179us) raft_consensus.cc:1685] finished
0709 12:58:16.384738 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.384886 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7480,"prepare.queue_time_us":833449,"prepare.run_cpu_time_us":252,"prepare.run_wall_time_us":6700,"raft.queue_time_us":15233,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":29959,"thread_start_us":575924,"threads_started":2,"wal-append.queue_time_us":653105}
I20260709 12:58:16.368968  4819 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:16.380105  4812 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.410689  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.412108  1644 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:16.413318  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.414076  1638 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:16.414789  1644 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:16.417814  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1629) took 1183 ms. Trace:
I20260709 12:58:16.418488  1717 rpcz_store.cc:276] 0709 12:58:15.234685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.344633 (+1109948us) service_pool.cc:224] Handling call
0709 12:58:16.344967 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:16.345173 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:16.397030 (+ 51857us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.417024 (+ 19994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.417149 (+   125us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:16.417273 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.417412 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.417679 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1298,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87,"thread_start_us":50101,"threads_started":2}
I20260709 12:58:16.416164  1638 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:16.383078  4725 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:16.430820  4337 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.430997  4828 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:16.438634  4704 consensus_meta.cc:287] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
I20260709 12:58:16.449561  4617 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.439379  4704 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.422497  4812 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:16.453924  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 379) took 1346 ms. Trace:
I20260709 12:58:16.454828  1715 rpcz_store.cc:276] 0709 12:58:15.107362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.111599 (+  4237us) service_pool.cc:224] Handling call
0709 12:58:15.130785 (+ 19186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:15.131215 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:15.131264 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:15.131844 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:58:15.602018 (+470174us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:15.602061 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.602139 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:16.453668 (+851529us) raft_consensus.cc:1685] finished
0709 12:58:16.453688 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.453833 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1425,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12233,"thread_start_us":469734,"threads_started":1,"wal-append.queue_time_us":930194}
I20260709 12:58:16.461035  1638 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:16.428284  4784 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.398770  4781 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.463688  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:16.464519  4852 log.cc:927] Time spent T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:58:16.464587  4696 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.475881  2343 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:16.453662  4846 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:16.460781  4851 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:58:16.477308  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 542066us
I20260709 12:58:16.488788  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:16.490686  1686 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:16.491093  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1624) took 1521 ms. Trace:
I20260709 12:58:16.491014  4725 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.492097  4828 raft_consensus.cc:2764] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:16.492347  4725 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:16.491571  1642 rpcz_store.cc:276] 0709 12:58:14.969663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.237181 (+267518us) service_pool.cc:224] Handling call
0709 12:58:15.257037 (+ 19856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:15.528913 (+271876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:15.528946 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:15.970533 (+441587us) log.cc:844] Serialized 26 byte log entry
0709 12:58:16.258588 (+288055us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:16.258622 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.258688 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:16.490889 (+232201us) raft_consensus.cc:1685] finished
0709 12:58:16.490911 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.491036 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185776,"raft.queue_time_us":200316,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":221370,"threads_started":1,"wal-append.queue_time_us":425195}
I20260709 12:58:16.492797  4826 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:16.494184  4826 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:16.494647  4826 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:16.494930  4812 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.492522  4550 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.495750  4826 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.497290  4724 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.497985  4808 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.499325  4550 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:16.498039  1686 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:16.501200  4704 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.468336  1638 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:16.478797  4708 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.486148  4781 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:16.487584  4735 consensus_meta.cc:287] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
I20260709 12:58:16.487411  4822 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:58:16.501961  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 169976us
I20260709 12:58:16.511955  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:16.513870  1638 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:16.510394  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:16.518445  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:16.508750  4738 consensus_meta.cc:287] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.003s
I20260709 12:58:16.521859  1720 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:16.508451  4724 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:16.515945  4735 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.530203  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:16.538123  1719 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:16.524286  4813 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:58:16.531298  1469 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:16.532295  4550 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:16.524297  4859 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:16.527544  4695 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.518471  4846 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:16.547075  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1637) took 1315 ms. Trace:
I20260709 12:58:16.546700  4846 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.547683  4855 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.548296  4855 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.537997  4724 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:16.541045  4545 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:16.547461  1639 rpcz_store.cc:276] 0709 12:58:15.231424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.716997 (+485573us) service_pool.cc:224] Handling call
0709 12:58:15.726024 (+  9027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:16.038585 (+312561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:16.038632 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:16.039216 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 12:58:16.322246 (+283030us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:16.322284 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.322349 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:16.546871 (+224522us) raft_consensus.cc:1685] finished
0709 12:58:16.546894 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.547020 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":289799,"raft.queue_time_us":316963,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":43748,"thread_start_us":177020,"threads_started":1,"wal-append.queue_time_us":443143}
I20260709 12:58:16.466980  4819 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.554978  1719 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:16.556510  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1635) took 1115 ms. Trace:
I20260709 12:58:16.556861  1719 rpcz_store.cc:276] 0709 12:58:15.441182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.529929 (+1088747us) service_pool.cc:224] Handling call
0709 12:58:16.556456 (+ 26527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:16.558924  4822 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.559268  4855 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.559747  4869 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:16.559646  4740 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.561008  4819 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:16.561085  4740 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:16.563594  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1914) took 2150 ms. Trace:
I20260709 12:58:16.563957  1566 rpcz_store.cc:276] 0709 12:58:14.407615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.792543 (+384928us) service_pool.cc:224] Handling call
0709 12:58:14.793104 (+   561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:14.794811 (+  1707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:14.794840 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:14.795275 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:58:15.047703 (+252428us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b180035d880. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1 00007f6a426efa0f
0709 12:58:15.781259 (+733556us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:15.781314 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.781389 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:16.549871 (+768482us) raft_consensus.cc:1685] finished
0709 12:58:16.549894 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.557672 (+  7778us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4296,"raft.queue_time_us":1480,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3948,"spinlock_wait_cycles":9332608,"thread_start_us":733355,"threads_started":1,"wal-append.queue_time_us":1743222}
I20260709 12:58:16.560276  4869 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.542498  4735 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.567359  4869 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.568082  4735 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.568946  4724 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:16.565002  4703 consensus_queue.cc:1175] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" responder_term: 7 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:16.521996  4738 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.580861  4740 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.558317  4812 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.581665  4740 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:16.576942  4870 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:58:16.585374  1712 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:58:16.587472  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.588608  4740 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.595705  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1619) took 1407 ms. Trace:
I20260709 12:58:16.596221  1720 rpcz_store.cc:276] 0709 12:58:15.188438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.002381 (+813943us) service_pool.cc:224] Handling call
0709 12:58:16.595464 (+593083us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54002c42d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:16.595629 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189105408}
I20260709 12:58:16.610033  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:16.610596  1720 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.611435  1642 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:58:16.611824  1642 pending_rounds.cc:85] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 7
I20260709 12:58:16.612033  1642 pending_rounds.cc:107] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:58:16.612251  1642 raft_consensus.cc:2889] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:16.623240  4833 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 1.037s	user 0.013s	sys 0.000s
I20260709 12:58:16.630035  1720 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
W20260709 12:58:16.631441  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.631629  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1627) took 1661 ms. Trace:
W20260709 12:58:16.640259  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 265339us
I20260709 12:58:16.641197  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:16.642467  4843 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.644668  4843 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:16.645149  4843 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:16.645610  4843 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.641314  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:16.648838  4695 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.649415  4695 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.650791  4740 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:16.651535  4695 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:16.648834  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:16.652819  4869 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:16.652978  4862 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:16.654031  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:16.654579  1639 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.661523  4862 consensus_queue.cc:1059] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:16.663077  4855 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:16.663565  4855 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:16.664731  4855 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.666630  4738 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:16.668829  1639 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
W20260709 12:58:16.669513  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.670720  2314 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:16.653347  4869 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.672019  4869 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:16.672176  4846 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.678858  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:16.676461  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 155524us
I20260709 12:58:16.681537  1720 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:16.682127  1639 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:16.683192  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:16.683422  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:16.683764  1639 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:16.613798  4690 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.682221  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:16.686717  1715 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:16.686920  1686 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:16.688607  1686 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:16.690328  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1919) took 1687 ms. Trace:
I20260709 12:58:16.690699  1571 rpcz_store.cc:276] 0709 12:58:15.002906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.062827 (+ 59921us) service_pool.cc:224] Handling call
0709 12:58:15.074336 (+ 11509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.074564 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:15.109476 (+ 34912us) log.cc:844] Serialized 14 byte log entry
0709 12:58:15.938409 (+828933us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.590095 (+651686us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b1800406de0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:16.689877 (+ 99782us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b1800406de0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a3f649a40 00007f6a3f6444e4 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287 00007f6a4274f208
0709 12:58:16.690019 (+   142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.690066 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:16.690115 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.690176 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.690277 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":551146,"prepare.queue_time_us":67082,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":76,"raft.queue_time_us":522191,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":23574656,"thread_start_us":335711,"threads_started":1,"wal-append.queue_time_us":525490}
I20260709 12:58:16.692978  1569 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:16.694110  1570 raft_consensus.cc:3055] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:16.694283  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:16.694489  1570 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:16.694928  1566 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:16.334486  1645 rpcz_store.cc:276] 0709 12:58:15.013320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.531857 (+518537us) service_pool.cc:224] Handling call
0709 12:58:15.532162 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.532413 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:15.978938 (+446525us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.313571 (+334633us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.313798 (+   227us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:16.314081 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.314229 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.314644 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147590,"prepare.queue_time_us":796925,"raft.queue_time_us":10332,"raft.run_wall_time_us":4512,"spinlock_wait_cycles":9262336,"thread_start_us":591852,"threads_started":2}
I20260709 12:58:16.696784  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:16.697644  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:16.699043  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 704089us
I20260709 12:58:16.699568  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:16.703537  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:16.704839  2346 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:16.713471  1537 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:16.716114  4822 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.717042  1566 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:16.717144  4822 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.716172  2345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 429) took 1012 ms. Trace:
I20260709 12:58:16.718111  2345 rpcz_store.cc:276] 0709 12:58:15.704172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.704718 (+   546us) service_pool.cc:224] Handling call
0709 12:58:16.715949 (+1011231us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b540057bcd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:16.716103 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1226938112}
I20260709 12:58:16.721818  1570 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.724237  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:16.687956  4738 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:16.728190  1720 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:16.728571  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.729262  1645 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:16.729367  2349 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:16.724675  1570 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.729439  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:16.726830  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:16.722203  4706 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.722564  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:16.725287  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:16.728040  1572 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:16.730372  1720 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:16.743629  1639 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:16.713517  4703 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:16.710309  4884 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.688114  4337 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:58:16.730469  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:16.745188  1568 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.750669  1715 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:16.720752  4611 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:16.713117  4809 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:16.709839  4812 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:16.803052  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.709625  4735 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:16.687449  4871 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:58:16.721959  4799 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.722487  4617 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:16.731539  4738 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.719398  4822 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:16.781304  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 67909us
I20260709 12:58:16.781910  4787 raft_consensus.cc:2764] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:16.780592  4796 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:16.782878  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.752385  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1756) took 1744 ms. Trace:
I20260709 12:58:16.756017  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:16.752977  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:16.763459  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.764696  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1620) took 1576 ms. Trace:
I20260709 12:58:16.767377  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:16.760588  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 382) took 1575 ms. Trace:
I20260709 12:58:16.772825  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:16.784020  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 80451.1us
I20260709 12:58:16.774062  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:16.762220  4703 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.791394  4846 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:16.746060  4828 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.792183  2345 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:16.745379  4706 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.769271  4855 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:16.793968  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 152820us
I20260709 12:58:16.778368  1717 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:16.800837  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:16.775863  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:16.804864  4770 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:16.989090  4724 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:16.980813  1568 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:16.916261  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:16.990300  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 216312us
I20260709 12:58:16.929235  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.990877  1638 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:16.637027  1640 rpcz_store.cc:276] 0709 12:58:14.970408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.238954 (+268546us) service_pool.cc:224] Handling call
0709 12:58:15.256937 (+ 17983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.257119 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:15.968610 (+711491us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.261079 (+292469us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.630971 (+369892us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18003fdc00. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a3f649a40 00007f6a3f6444e4 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287 00007f6a4274f208
0709 12:58:16.631183 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.631249 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:16.631310 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.631412 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.631556 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100134,"prepare.queue_time_us":1145588,"prepare.run_cpu_time_us":1308,"prepare.run_wall_time_us":34496,"raft.queue_time_us":321776,"spinlock_wait_cycles":3289856,"thread_start_us":666753,"threads_started":2,"wal-append.queue_time_us":348848}
I20260709 12:58:16.854833  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:16.991852  2312 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:16.845805  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:16.848696  1571 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
W20260709 12:58:16.947750  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.993333  1639 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.992331  1537 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:16.994040  1714 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:16.861392  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 410) took 1892 ms. Trace:
I20260709 12:58:16.948478  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1758) took 1940 ms. Trace:
I20260709 12:58:16.994876  1537 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:16.995340  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:16.996083  1537 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:16.838608  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.989315  4770 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:16.998883  1714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1617) took 1811 ms (client timeout 2122 ms). Trace:
I20260709 12:58:16.999648  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:16.994388  1643 rpcz_store.cc:276] 0709 12:58:15.007633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.258335 (+250702us) service_pool.cc:224] Handling call
0709 12:58:15.443960 (+185625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:16.014564 (+570604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:16.014609 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:16.015210 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:58:16.254675 (+239465us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:16.255124 (+   449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.751846 (+496722us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54002a6cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:16.751910 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:16.751969 (+    59us) raft_consensus.cc:1685] finished
0709 12:58:16.751989 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.752309 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12559,"raft.queue_time_us":13657,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":16431,"spinlock_wait_cycles":1282304256,"thread_start_us":209558,"threads_started":1,"wal-append.queue_time_us":441618}
I20260709 12:58:17.001389  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:17.001557  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:17.002982  4480 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:58:17.003870  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 250991us
I20260709 12:58:16.997177  1712 rpcz_store.cc:276] 0709 12:58:15.184932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.967880 (+782948us) service_pool.cc:224] Handling call
0709 12:58:16.760414 (+792534us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54000eecd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:16.760525 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417590016}
W20260709 12:58:16.999210  1714 rpcz_store.cc:269] 0709 12:58:15.187855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.755750 (+1567895us) service_pool.cc:224] Handling call
0709 12:58:16.998829 (+243079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:17.001085  2312 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:17.003175  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:16.994498  1641 rpcz_store.cc:276] 0709 12:58:14.969437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.230953 (+261516us) service_pool.cc:224] Handling call
0709 12:58:15.231193 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.231375 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:15.738101 (+506726us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.766707 (+1028606us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b4800112758. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
0709 12:58:16.860982 (+ 94275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.861051 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:16.861113 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.861189 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.861320 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305225,"prepare.queue_time_us":873259,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":267124,"raft.run_cpu_time_us":975,"raft.run_wall_time_us":120021,"spinlock_wait_cycles":13756800,"thread_start_us":1348826,"threads_started":3,"wal-append.queue_time_us":840334}
I20260709 12:58:16.993454  1721 rpcz_store.cc:276] 0709 12:58:15.193911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.997666 (+803755us) service_pool.cc:224] Handling call
0709 12:58:16.764519 (+766853us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54002de954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:16.764624 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358761856}
I20260709 12:58:16.996866  4611 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:17.003695  4724 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:58:17.013876  4869 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:16.758564  4690 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:17.006237  1469 catalog_manager.cc:5697] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:17.006880  1718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1628) took 1780 ms (client timeout 2230 ms). Trace:
I20260709 12:58:17.009744  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:17.010737  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:17.006048  4675 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:58:17.000591  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:17.039295  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:17.008756  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1633) took 1731 ms (client timeout 2000 ms). Trace:
I20260709 12:58:17.026854  1639 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
W20260709 12:58:16.982128  4885 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:58:17.006438  4678 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:17.008456  1537 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:17.009810  1684 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:17.038779  4787 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:16.846058  4735 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.006687  4619 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:17.003899  4670 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:17.003660  4617 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.057087  1641 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:17.057452  1638 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
W20260709 12:58:17.051227  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50675.3us
I20260709 12:58:17.039856  4869 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:16.861260  4696 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:16.805500  4780 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:16.974879  4812 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.001004  4738 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:16.769109  4843 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:17.059202  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 50831.7us
I20260709 12:58:17.098842  1537 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:17.004899  4828 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:17.051883  1716 rpcz_store.cc:269] 0709 12:58:15.319010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.767126 (+1448116us) service_pool.cc:224] Handling call
0709 12:58:17.008681 (+241555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:17.106101  4828 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:16.995182  1647 rpcz_store.cc:276] 0709 12:58:15.008219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.527340 (+519121us) service_pool.cc:224] Handling call
0709 12:58:15.527633 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.527829 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:16.343438 (+815609us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.753558 (+410120us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4800112758. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
0709 12:58:16.948040 (+194482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.948109 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:16.948179 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.948267 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.948408 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":322003,"prepare.queue_time_us":774483,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4163,"raft.queue_time_us":267207,"raft.run_cpu_time_us":1114,"raft.run_wall_time_us":108953,"spinlock_wait_cycles":7687936,"thread_start_us":1048011,"threads_started":3,"wal-append.queue_time_us":98365}
I20260709 12:58:17.003803  4618 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:17.053880  4611 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:17.056835  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.061554  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:17.062271  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52532.7us
I20260709 12:58:17.110671  1640 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:58:17.051940  1718 rpcz_store.cc:269] 0709 12:58:15.229553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.772510 (+1542957us) service_pool.cc:224] Handling call
0709 12:58:17.006820 (+234310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:16.762495  4884 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:16.905026  4809 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:17.123106  4809 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.096498  4780 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.125222  4809 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:17.125739  4780 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:16.997645  4703 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:17.116811  4611 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.071295  4864 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:17.126539  4611 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:17.126896  4864 raft_consensus.cc:697] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:17.055852  4438 consensus_queue.cc:1059] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 12:58:17.065418  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 64407.7us
I20260709 12:58:17.128942  1646 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:17.075699  4670 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:17.057744  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46624.5us
I20260709 12:58:16.859335  4799 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.137586  4843 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:17.057228  4480 raft_consensus.cc:697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:17.080905  1713 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:17.075987  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.056924  4784 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:17.040292  4880 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:17.085008  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.063470  4675 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:17.095821  1641 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:17.120700  1537 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:17.121125  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:17.121353  4787 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:17.121955  4877 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:58:17.062956  4337 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:58:17.125946  4617 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:17.066867  4826 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:17.007169  4796 raft_consensus.cc:697] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:17.118752  1535 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:17.077194  4619 raft_consensus.cc:697] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:17.197680  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:17.138031  1644 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:17.136353  4799 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:17.146371  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 78443.8us
I20260709 12:58:17.198894  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:17.199779  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:17.065608  4881 consensus_queue.cc:1059] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:58:17.195518  4780 consensus_queue.cc:1059] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:58:17.155702  4719 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:58:17.149870  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:17.205615  4670 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.080075  4760 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:58:17.108724  4812 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.148826  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:17.196352  4826 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.155187  4545 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:17.090026  4696 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.193746  4884 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:17.147943  4675 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:17.195593  1469 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:17.209798  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:17.201327  2314 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:17.147580  1713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1624) took 1952 ms (client timeout 2057 ms). Trace:
I20260709 12:58:17.136363  4735 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:17.218034  1713 rpcz_store.cc:269] 0709 12:58:15.198341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.805083 (+1606742us) service_pool.cc:224] Handling call
0709 12:58:17.147408 (+342325us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b54002ddf54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:17.147520 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204226304}
I20260709 12:58:17.224033  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:17.231644  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:17.232425  1718 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:17.233372  1714 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:17.236172  1640 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:17.132484  4690 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 12:58:17.253273  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 104528us
I20260709 12:58:17.257071  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:17.215624  1469 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 2 to 4, term changed from 3 to 5, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to <none>, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:17.258188  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:17.265136  1714 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:17.195359  4843 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:58:17.207581  4787 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:17.229156  4826 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:17.274930  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:17.224834  4701 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:17.224675  4675 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:17.214012  4618 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:17.238893  4871 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:17.207674  4760 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:58:17.208694  4678 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:58:17.272078  4879 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:17.266362  4410 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:17.299196  1467 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58430 (request call id 229) took 23092 ms (client timeout 15000 ms). Trace:
I20260709 12:58:17.266742  4880 raft_consensus.cc:2764] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:17.255020  4545 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:17.271519  4719 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:17.306079  2312 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:17.308590  1469 catalog_manager.cc:5697] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:17.307976  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 156299us
I20260709 12:58:17.282027  4846 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:17.319576  4611 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.320976  4618 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.326573  4619 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.330227  4611 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:17.332737  1684 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:17.333071  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.298952  4879 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:17.338099  4879 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:17.338467  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.339248  1640 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:17.324039  4846 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:17.341214  4846 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:17.341711  1643 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:17.343303  1643 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:17.336553  1646 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
W20260709 12:58:17.333560  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 75461.8us
I20260709 12:58:17.151767  4864 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.340318  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:17.352559  1640 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:58:17.346760  1612 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:17.297626  4812 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:17.336397  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 217620us
W20260709 12:58:17.358948  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53065.4us
I20260709 12:58:17.369519  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.372942  1639 raft_consensus.cc:2410] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:17.308204  4410 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:17.308784  4701 raft_consensus.cc:697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:17.380818  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 183441us
I20260709 12:58:17.348030  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:17.323124  4770 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:17.380575  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:17.395905  1684 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:17.354825  4828 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.355835  4819 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:17.400987  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:17.274672  4796 consensus_queue.cc:237] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.416734  1640 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:17.417848  1469 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 6, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.419994  1535 leader_election.cc:400] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7.
I20260709 12:58:17.436981  1535 leader_election.cc:403] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:58:17.437885  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:17.421229  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:17.430382  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.438993  1639 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:17.283219  4480 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.381918  4880 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:17.377995  4706 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:17.299662  1467 rpcz_store.cc:269] 0709 12:57:54.201625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.206180 (+  4555us) service_pool.cc:224] Handling call
0709 12:58:17.293759 (+23087579us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:10.892703 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:10.893393 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:10.893439 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:58:10.893470 (+    31us) tablet.cc:662] Decoding operations
0709 12:58:11.021779 (+128309us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:11.037423 (+ 15644us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:11.039181 (+  1758us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:58:11.044503 (+  5322us) tablet.cc:701] Row locks acquired
0709 12:58:11.044565 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:58:11.047631 (+  3066us) write_op.cc:270] Start()
0709 12:58:11.047774 (+   143us) write_op.cc:276] Timestamp: P: 1783601891047567 usec, L: 0
0709 12:58:11.047796 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:58:11.182006 (+134210us) log.cc:844] Serialized 9882 byte log entry
0709 12:58:11.746219 (+564213us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a3f62a0ac 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b
0709 12:58:12.538915 (+792696us) op_driver.cc:464] REPLICATION: finished
0709 12:58:12.633473 (+ 94558us) write_op.cc:301] APPLY: starting
0709 12:58:12.633584 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:12.634105 (+   521us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:12.634141 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:12.926206 (+292065us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:12.926641 (+   435us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 12:58:12.926689 (+    48us) write_op.cc:312] APPLY: finished
0709 12:58:12.927285 (+   596us) log.cc:844] Serialized 170 byte log entry
0709 12:58:12.928341 (+  1056us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:12.928550 (+   209us) write_op.cc:454] Released schema lock
0709 12:58:12.928623 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:12.929115 (+   492us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:12.929145 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3043663,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":94259,"apply.run_cpu_time_us":7299,"apply.run_wall_time_us":295619,"num_ops":25,"prepare.queue_time_us":297711,"prepare.run_cpu_time_us":34148,"prepare.run_wall_time_us":1126985,"raft.queue_time_us":224045,"raft.run_cpu_time_us":5859,"raft.run_wall_time_us":20315,"replication_time_us":1490928,"spinlock_wait_cycles":24236288,"thread_start_us":1074383,"threads_started":4,"wal-append.queue_time_us":747369,"wal-append.run_cpu_time_us":35271,"wal-append.run_wall_time_us":2000133}]]}
W20260709 12:58:17.436303  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 76587.7us
I20260709 12:58:17.439625  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.436828  4809 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:58:17.448751  2346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:17.442461  1537 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:17.405385  4884 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:17.449399  2346 raft_consensus.cc:606] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:17.459103  2346 raft_consensus.cc:614] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:17.460321  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.461850  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:17.462494  1639 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:17.450294  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:17.455180  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:17.467794  1712 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:17.456260  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:17.470052  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:17.470901  1720 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:17.418007  4724 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:17.481105  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:17.402707  4611 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:17.435305  4903 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:58:17.384568  4703 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.436038  4670 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:17.509472  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:17.510295  1717 raft_consensus.cc:2368] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7.
I20260709 12:58:17.404546  4812 consensus_queue.cc:1059] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:58:17.468689  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:17.436033  4719 raft_consensus.cc:2764] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:17.458212  4760 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:17.494294  4888 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:58:17.494082  4611 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.459659  4410 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.494724  1469 catalog_manager.cc:5697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.458987  4884 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.496903  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:17.626981  1713 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:17.497905  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:17.499809  4787 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:17.481515  4724 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:17.500617  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52115.3us
I20260709 12:58:17.635638  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:17.502168  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:17.448797  4890 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7.
I20260709 12:58:17.512306  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:17.514302  2312 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:17.638455  4890 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.638628  4900 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.639160  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:17.639101  4890 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.640054  1717 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:17.437618  4897 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:17.640790  4891 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.641317  4897 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.433864  4828 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.641824  4890 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:17.592967  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:17.494801  4889 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:58:17.450115  4545 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:17.496292  4809 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.444165  4819 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:17.639396  4900 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.641618  4891 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.638139  1712 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:17.483045  4799 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:17.670604  1469 catalog_manager.cc:5697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 6, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.631280  4884 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:17.650389  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.633757  4896 raft_consensus.cc:3055] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:17.628010  4883 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:58:17.481300  4706 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.154s
I20260709 12:58:17.659092  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:17.516067  4675 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.703248  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.703775  1565 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:17.706069  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.711836  1566 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:17.714599  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.715365  1566 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:17.723135  1567 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:58:17.662523  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 267635us
I20260709 12:58:17.645505  4724 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:17.666443  1568 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:17.667058  1715 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:58:17.673449  4410 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:17.675640  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.641819  4897 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:17.678720  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.678887  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.679206  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.679888  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.681143  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1785) took 1022 ms. Trace:
I20260709 12:58:17.682178  4891 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:17.682525  4809 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.594544  4770 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.703965  4812 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:17.779904  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 143533us
I20260709 12:58:17.782986  1721 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:17.623885  4701 consensus_queue.cc:237] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.725178  4859 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:17.490024  4826 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.683676  4819 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.642956  1720 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:17.726868  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.846666  1567 raft_consensus.cc:2393] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:17.653761  4890 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:17.727378  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 213165us
I20260709 12:58:17.688176  4799 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:17.748454  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.748662  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:17.730351  1647 rpcz_store.cc:276] 0709 12:58:16.658942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.110145 (+451203us) service_pool.cc:224] Handling call
0709 12:58:17.110570 (+   425us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:58:17.111041 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:17.111344 (+   303us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:58:17.112121 (+   777us) log.cc:844] Serialized 78 byte log entry
0709 12:58:17.212329 (+100208us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:17.303323 (+ 90994us) log.cc:844] Serialized 14 byte log entry
0709 12:58:17.303874 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.304011 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:17.680900 (+376889us) raft_consensus.cc:1685] finished
0709 12:58:17.680923 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:17.681081 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8572,"prepare.queue_time_us":171071,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":19280,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":5175,"thread_start_us":168474,"threads_started":2,"wal-append.queue_time_us":159128}
I20260709 12:58:17.853778  2347 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:17.757572  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:17.854848  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 97358.9us
I20260709 12:58:17.855624  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:17.758625  1563 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:17.696973  1469 catalog_manager.cc:5697] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:17.770684  1565 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:17.700769  1639 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:17.804503  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.810932  4887 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:17.866407  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.758216  4907 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:17.842005  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:17.756034  4900 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:17.850154  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:17.858299  1566 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:17.701968  4896 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:17.756922  4619 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:58:17.841339  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:17.774089  4881 consensus_queue.cc:1059] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:58:17.851768  4725 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.782123  4770 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.858706  4799 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:17.872870  1718 raft_consensus.cc:2393] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:17.793807  4812 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.877218  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:17.865934  4880 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:17.900394  1469 catalog_manager.cc:5697] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 6, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 6 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:17.866524  4894 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:17.862028  4890 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.915426  1469 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 6, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 6 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:17.886754  4675 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:17.884825  4907 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:17.897457  4725 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.933719  4881 consensus_queue.cc:1243] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:17.934401  4881 raft_consensus.cc:3055] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:17.934840  4881 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:17.935056  4923 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:17.935735  4725 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:17.935637  4923 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:17.935998  4881 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:17.937026  4909 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:58:17.908900  4828 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:17.871013  1717 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:17.913049  4894 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:17.964823  4611 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:18.105351  4809 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:18.105589  4812 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:17.986781  4896 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:18.082530  4913 raft_consensus.cc:2764] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:58:18.110234  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1784) took 1454 ms. Trace:
I20260709 12:58:18.113194  1469 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 7, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 7 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:18.164909  1644 rpcz_store.cc:276] 0709 12:58:16.655786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.924312 (+268526us) service_pool.cc:224] Handling call
0709 12:58:18.110065 (+1185753us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001e41d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:18.110176 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336888192}
I20260709 12:58:18.118119  4880 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:18.177487  4880 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:18.177963  4880 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:18.178841  4896 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:18.183820  1642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.000s	sys 0.011s
W20260709 12:58:18.184243  1642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.000s	sys 0.011s
W20260709 12:58:18.190117  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 406327us
I20260709 12:58:17.856634  4859 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:18.194777  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.195302  1714 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:18.201771  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:18.202375  1566 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:18.181982  4881 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:18.205802  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 83204.1us
I20260709 12:58:18.193390  4799 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:18.229568  1566 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
W20260709 12:58:18.242477  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 365344us
I20260709 12:58:18.243799  1572 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:18.212739  4725 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:18.245042  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:18.245236  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.003s	sys 0.014s
W20260709 12:58:18.249696  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.003s	sys 0.014s
I20260709 12:58:18.207705  4724 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:18.264900  1686 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.500s (SENT) [suppressed 23 similar messages]
I20260709 12:58:18.275599  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:18.266472  4898 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.491s	user 0.009s	sys 0.000s
W20260709 12:58:18.267899  4911 log.cc:927] Time spent T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
W20260709 12:58:18.254282  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 778563us
W20260709 12:58:18.288599  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.092s	sys 0.147s
I20260709 12:58:18.245461  4826 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:18.289121  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.092s	sys 0.147s
I20260709 12:58:18.295889  1647 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:18.199004  4907 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:18.296904  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:18.311842  1641 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
W20260709 12:58:18.348402  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.382813  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:18.384210  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:18.384991  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:18.270301  4890 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:18.387746  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:18.406736  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:18.390477  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:18.409154  1570 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:18.410003  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:58:18.411157  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 159126us
I20260709 12:58:18.412009  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:58:18.503295  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:18.525840  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 82415.3us
I20260709 12:58:18.254379  4725 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:18.287876  4770 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:18.311098  4923 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:18.527123  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:18.555481  1565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.006s	sys 0.056s
I20260709 12:58:18.574533  1568 pending_rounds.cc:85] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 6
W20260709 12:58:18.587692  1565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.006s	sys 0.057s
I20260709 12:58:18.587847  1568 pending_rounds.cc:107] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:58:18.588231  1568 raft_consensus.cc:2889] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:18.382028  4917 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.310729  4887 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.585347  1572 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:18.384181  4809 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:18.573309  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1653) took 1185 ms. Trace:
I20260709 12:58:18.600504  1640 rpcz_store.cc:276] 0709 12:58:17.387754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.465832 (+ 78078us) service_pool.cc:224] Handling call
0709 12:58:17.510822 (+ 44990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:17.511050 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:17.633215 (+122165us) log.cc:844] Serialized 14 byte log entry
0709 12:58:18.572915 (+939700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:18.572976 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:18.573032 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.573099 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:18.573241 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39720,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6686,"raft.queue_time_us":109636,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6199,"thread_start_us":939283,"threads_started":2,"wal-append.queue_time_us":771151}
I20260709 12:58:18.604552  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:18.605252  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 78215.9us
I20260709 12:58:18.610029  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:18.412858  4675 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:18.415326  4704 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:18.530305  4928 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:18.596038  4879 consensus_meta.cc:287] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.257s	user 0.012s	sys 0.004s
I20260709 12:58:18.574091  4826 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:18.678442  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 413581us
W20260709 12:58:18.641623  4884 consensus_meta.cc:287] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.929s	user 0.011s	sys 0.001s
W20260709 12:58:18.630378  4410 consensus_meta.cc:287] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.880s	user 0.012s	sys 0.001s
W20260709 12:58:18.665091  4846 consensus_meta.cc:287] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.323s	user 0.000s	sys 0.019s
W20260709 12:58:18.641700  4855 consensus_meta.cc:287] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.637s	user 0.014s	sys 0.003s
W20260709 12:58:18.667512  4738 consensus_meta.cc:287] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.545s	user 0.013s	sys 0.003s
W20260709 12:58:18.668062  4897 consensus_meta.cc:287] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.873s	user 0.012s	sys 0.000s
I20260709 12:58:18.728178  1646 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
W20260709 12:58:18.688753  4670 consensus_meta.cc:287] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.094s	user 0.007s	sys 0.006s
I20260709 12:58:18.788146  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:18.778895  2343 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:18.807996  1564 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:18.809748  1572 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:18.818238  4931 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:18.818955  4931 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:18.821111  4932 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.709525  4740 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.629555  4809 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:18.641196  4887 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:18.845902  2313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.017s	sys 0.059s
W20260709 12:58:18.846331  2313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.017s	sys 0.060s
I20260709 12:58:18.777956  4903 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:18.686107  4704 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:18.676822  4675 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:18.809850  4611 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.909385  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1640) took 1273 ms. Trace:
I20260709 12:58:18.823019  4894 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:18.715718  4826 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:18.729112  4884 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:18.709610  4879 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:18.778509  4846 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:18.641428  4917 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:18.795197  4738 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:18.811695  4897 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:18.820032  4931 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:19.222784  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.046s	sys 0.058s
I20260709 12:58:18.978223  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:18.914399  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:19.232998  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 254867us
W20260709 12:58:19.162648  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.814800  4670 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:19.225977  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.046s	sys 0.059s
I20260709 12:58:19.002276  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1656) took 1613 ms. Trace:
W20260709 12:58:18.931696  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 52765.9us
I20260709 12:58:19.225355  1718 rpcz_store.cc:276] 0709 12:58:17.450528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.450672 (+   144us) service_pool.cc:224] Handling call
0709 12:58:18.723727 (+1273055us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54001caf54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:18.723919 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898977024}
I20260709 12:58:18.973634  1645 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:19.236943  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.002s	sys 0.009s
I20260709 12:58:18.821748  4932 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:19.237406  2314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.000s	sys 0.010s
W20260709 12:58:20.224197  2314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.972s	user 0.000s	sys 0.011s
I20260709 12:58:19.315749  2340 raft_consensus.cc:1240] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:19.257066  1566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.005s
W20260709 12:58:19.602892  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1652) took 2215 ms (client timeout 1822 ms). Trace:
I20260709 12:58:19.381765  2349 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:58:20.226234  1646 rpcz_store.cc:269] 0709 12:58:17.387365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.439402 (+ 52037us) service_pool.cc:224] Handling call
0709 12:58:19.602694 (+2163292us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002661d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:19.602800 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2946322304}
W20260709 12:58:19.683851  1642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.480s	user 0.006s	sys 0.010s
W20260709 12:58:20.227216  1642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.042s	user 0.006s	sys 0.015s
W20260709 12:58:19.669534  1643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.006s	sys 0.010s
I20260709 12:58:19.381760  1716 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:19.606411  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1743) took 1801 ms. Trace:
I20260709 12:58:19.302863  1644 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:20.229702  1566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.498s	user 0.014s	sys 0.017s
W20260709 12:58:19.604084  2343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 453) took 2403 ms (client timeout 1769 ms). Trace:
W20260709 12:58:19.221873  4933 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.397s	user 0.000s	sys 0.001s
W20260709 12:58:20.231102  2343 rpcz_store.cc:269] 0709 12:58:17.200397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.200549 (+   152us) service_pool.cc:224] Handling call
0709 12:58:19.603873 (+2403324us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54004cac54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:19.603981 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3570256768}
W20260709 12:58:19.801501  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:19.673406  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 426408us
I20260709 12:58:20.228430  1564 rpcz_store.cc:276] 0709 12:58:17.805535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.805833 (+   298us) service_pool.cc:224] Handling call
0709 12:58:17.806153 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:18.809710 (+1003557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:19.606152 (+796442us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400093b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:19.606342 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302752512}
I20260709 12:58:19.571275  4675 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:20.233570  4696 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:20.237655  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.648s	user 0.021s	sys 0.075s
I20260709 12:58:18.847486  4855 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.249651  4964 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:20.238282  1639 rpcz_store.cc:276] 0709 12:58:17.388620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.955825 (+567205us) service_pool.cc:224] Handling call
0709 12:58:18.103655 (+147830us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:18.104310 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:18.104367 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:18.105389 (+  1022us) log.cc:844] Serialized 52 byte log entry
0709 12:58:18.581198 (+475809us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:18.581241 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.581306 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:19.001972 (+420666us) raft_consensus.cc:1685] finished
0709 12:58:19.002002 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:19.002191 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109055,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5571,"thread_start_us":475237,"threads_started":1,"wal-append.queue_time_us":725227,"wal-append.run_cpu_time_us":2701,"wal-append.run_wall_time_us":1242264}
I20260709 12:58:20.250763  4937 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:18.865397  4869 raft_consensus.cc:3055] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:20.246344  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 456) took 1840 ms. Trace:
W20260709 12:58:18.998759  4918 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
W20260709 12:58:20.257292  1686 connection.cc:256] RPC call timeout handler was delayed by -1.2701731149999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24150000000000002s for a response
I20260709 12:58:19.064731  4706 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:20.256013  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1792) took 2896 ms. Trace:
W20260709 12:58:19.304178  4926 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:58:18.931915  4914 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.711s	user 0.001s	sys 0.000s
W20260709 12:58:19.303364  4944 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
W20260709 12:58:18.997877  4924 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.728s	user 0.001s	sys 0.000s
W20260709 12:58:19.532613  4950 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:58:19.288144  4942 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
W20260709 12:58:19.236768  4796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.352s	user 0.002s	sys 0.009s
I20260709 12:58:18.997954  4915 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.223203  4724 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:18.998529  4859 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:18.978009  4799 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:19.004577  4887 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:20.166671  4917 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:20.467851  4796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.588s	user 0.012s	sys 0.033s
I20260709 12:58:19.434176  4725 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:18.842226  4740 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:18.938298  4903 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.294088  4946 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:18.999567  4929 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 1.877s
I20260709 12:58:20.464442  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1650) took 3081 ms. Trace:
I20260709 12:58:20.469305  4846 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:19.301591  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:19.630652  4896 consensus_meta.cc:287] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.451s	user 0.009s	sys 0.005s
W20260709 12:58:19.784970  4880 consensus_meta.cc:287] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.606s	user 0.010s	sys 0.004s
W20260709 12:58:20.422770  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 196174us
I20260709 12:58:19.256480  4770 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:18.998106  4941 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:19.277294  4890 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.525342  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:20.528385  1715 raft_consensus.cc:2368] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:58:20.165848  4931 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.256191  4894 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.308751  4879 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:19.603288  4784 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.301791  4919 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:19.555371  4704 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.519174  4678 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.591049  4703 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:19.306237  4826 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:19.064445  4701 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.283604  4928 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:20.232887  4913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.000s	sys 0.012s
I20260709 12:58:20.503976  4957 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:20.427742  4907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.008s	sys 0.020s
W20260709 12:58:20.424185  4881 consensus_meta.cc:287] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 2.203s	user 0.015s	sys 0.000s
I20260709 12:58:20.166244  4897 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.170843  4738 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:20.298324  4884 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:18.959870  4611 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:20.471637  4869 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:20.478780  4675 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.478601  4696 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:20.505270  4960 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.505544  4724 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.481993  4966 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.318733  4855 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.515028  4799 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:20.543385  4968 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.479166  4915 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.478442  4706 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.755492  4928 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:20.639333  4919 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.757103  4611 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.757288  4706 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:19.491207  4947 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:20.758059  4903 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:20.758194  4947 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.740938  4960 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:20.705633  4957 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.511863  4946 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.507601  4964 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.760596  4960 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.737273  4675 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:20.761648  4932 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.762432  4964 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:20.760600  4957 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:20.697297  4913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.253s	user 0.000s	sys 0.031s
I20260709 12:58:20.534704  4880 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:20.554162  4894 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.683719  4619 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:58:20.545814  4931 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:20.548542  4784 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.683368  4678 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:20.719105  4954 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.758853  4919 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.762928  4740 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:20.705031  4907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.013s	sys 0.020s
I20260709 12:58:20.535071  4890 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.699877  4701 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.740407  4696 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.824173  4954 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:20.828061  4784 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:20.828872  4890 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:20.748410  4724 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:20.814215  4947 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:20.830550  4855 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.763383  4968 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:20.831768  4894 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.802261  4780 raft_consensus.cc:3055] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:20.874329  1535 connection.cc:256] RPC call timeout handler was delayed by -1.5598130249999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2459s for a response
W20260709 12:58:20.908324  1535 connection.cc:256] RPC call timeout handler was delayed by -1.4745445169999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260709 12:58:20.908325  4780 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:20.878832  1641 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:20.910207  2348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 438) took 2520 ms. Trace:
I20260709 12:58:20.911681  1719 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:20.912012  1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1666) took 2327 ms (client timeout 1932 ms). Trace:
W20260709 12:58:20.881348  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.009s	sys 0.008s
I20260709 12:58:20.772433  2341 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:20.469501  1642 rpcz_store.cc:276] 0709 12:58:17.331631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.332429 (+   798us) service_pool.cc:224] Handling call
0709 12:58:17.344138 (+ 11709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:17.344325 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:17.630314 (+285989us) log.cc:844] Serialized 14 byte log entry
0709 12:58:20.227550 (+2597236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:20.227604 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:20.227652 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.227716 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.227828 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39392,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":41,"raft.queue_time_us":63360,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":31397,"thread_start_us":2882445,"threads_started":3,"wal-append.queue_time_us":582475,"wal-append.run_cpu_time_us":1486,"wal-append.run_wall_time_us":1060846}
I20260709 12:58:20.919101  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:20.912509  1641 rpcz_store.cc:269] 0709 12:58:18.584935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.585134 (+   199us) service_pool.cc:224] Handling call
0709 12:58:20.911606 (+2326472us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b540040bfd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:20.911836 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5195207552}
I20260709 12:58:20.887382  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1745) took 3079 ms. Trace:
I20260709 12:58:20.474864  1566 rpcz_store.cc:276] 0709 12:58:18.405804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.407921 (+  2117us) service_pool.cc:224] Handling call
0709 12:58:18.408223 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:18.580482 (+172259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:18.580525 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:18.601066 (+ 20541us) log.cc:844] Serialized 26 byte log entry
0709 12:58:20.230336 (+1629270us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:20.230390 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.230476 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:20.246130 (+ 15654us) raft_consensus.cc:1685] finished
0709 12:58:20.246154 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.246288 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171815,"raft.queue_time_us":172554,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":26131,"thread_start_us":1498332,"threads_started":1,"wal-append.queue_time_us":1564416}
I20260709 12:58:20.515602  1643 rpcz_store.cc:276] 0709 12:58:17.382694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.383320 (+   626us) service_pool.cc:224] Handling call
0709 12:58:17.417150 (+ 33830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:17.435572 (+ 18422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:17.435602 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:17.436082 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:58:18.860237 (+1424155us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b18002f0260. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1 00007f6a426efa0f
0709 12:58:20.228128 (+1367891us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:20.228167 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.228234 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:20.464163 (+235929us) raft_consensus.cc:1685] finished
0709 12:58:20.464181 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.464379 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18034,"raft.queue_time_us":20197,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":6298,"spinlock_wait_cycles":7829888,"thread_start_us":1367724,"threads_started":1,"wal-append.queue_time_us":2800797}
I20260709 12:58:20.889680  1647 raft_consensus.cc:2410] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:58:20.930431  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1662) took 2621 ms (client timeout 2195 ms). Trace:
W20260709 12:58:20.930924  1647 rpcz_store.cc:269] 0709 12:58:18.308720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.390254 (+ 81534us) service_pool.cc:224] Handling call
0709 12:58:20.930061 (+2539807us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b5400209ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:20.930320 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5705627904}
I20260709 12:58:20.890138  1639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:58:20.932502  1639 raft_consensus.cc:606] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:20.526662  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:20.913431  4780 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.535132  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:20.936507  4780 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:20.932971  4724 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:20.938769  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:20.939142  4915 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.532402  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:20.531661  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:20.535573  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:20.536885  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:20.946416  1717 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:20.943760  1715 raft_consensus.cc:2368] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:20.947497  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:20.533135  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:20.943421  4809 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.944281  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:20.945218  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.009s	sys 0.012s
I20260709 12:58:20.830490  4678 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.829018  4696 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:20.482373  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1776) took 3828 ms. Trace:
I20260709 12:58:20.893255  4706 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:20.954372  2346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 455) took 2954 ms. Trace:
I20260709 12:58:20.922817  1565 rpcz_store.cc:276] 0709 12:58:17.808712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.857626 (+ 48914us) service_pool.cc:224] Handling call
0709 12:58:17.857948 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:17.866589 (+  8641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:17.866625 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:17.867108 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:58:18.588119 (+721011us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:18.588161 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.588234 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:20.886907 (+2298673us) raft_consensus.cc:1685] finished
0709 12:58:20.886935 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.887183 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9860,"raft.queue_time_us":696,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12742,"thread_start_us":686225,"threads_started":1,"wal-append.queue_time_us":1140481}
I20260709 12:58:20.946430  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:20.526551  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:20.955045  4706 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.957659  1721 raft_consensus.cc:2368] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8.
I20260709 12:58:20.957885  1564 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:20.954695  1638 rpcz_store.cc:276] 0709 12:58:16.653878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.080720 (+426842us) service_pool.cc:224] Handling call
0709 12:58:17.103975 (+ 23255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:17.130785 (+ 26810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:17.130821 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:17.132315 (+  1494us) log.cc:844] Serialized 26 byte log entry
0709 12:58:18.121152 (+988837us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b18002bad40. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1 00007f6a426efa0f
0709 12:58:18.231037 (+109885us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:18.231075 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.231144 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:20.476397 (+2245253us) raft_consensus.cc:1685] finished
0709 12:58:20.476417 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.482310 (+  5893us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":468,"raft.queue_time_us":21503,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":50396,"spinlock_wait_cycles":3009280,"thread_start_us":109705,"threads_started":1,"wal-append.queue_time_us":1481548}
I20260709 12:58:20.771289  4869 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.973558  4869 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:20.751852  4799 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:20.842767  4931 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:20.840723  4972 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.005s	sys 0.009s
W20260709 12:58:21.017962  4972 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.006s	sys 0.010s
I20260709 12:58:20.899624  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:20.900205  4701 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:20.900601  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 355646us
I20260709 12:58:20.888401  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 459) took 2480 ms. Trace:
I20260709 12:58:20.750814  4966 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:21.025777  1568 rpcz_store.cc:276] 0709 12:58:18.408034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.408168 (+   134us) service_pool.cc:224] Handling call
0709 12:58:18.574301 (+166133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:18.588883 (+ 14582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:18.588926 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:18.589417 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:58:20.293692 (+1704275us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:20.293741 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.293817 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:20.887962 (+594145us) raft_consensus.cc:1685] finished
0709 12:58:20.887992 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.888255 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1703937,"threads_started":1,"wal-append.queue_time_us":817225}
I20260709 12:58:21.028406  4928 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:21.029387  4966 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.843922  4968 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:20.908906  1535 connection.cc:256] RPC call timeout handler was delayed by -1.4646445170000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 12:58:20.300482  1570 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:20.910645  2348 rpcz_store.cc:276] 0709 12:58:18.389901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.392739 (+  2838us) service_pool.cc:224] Handling call
0709 12:58:18.393158 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:19.056990 (+663832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:19.057021 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:19.607799 (+550778us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b2c00021e98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4102da11 00007f6a4103d372 00007f6a4276fa01 00007f6a4273443a 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2
0709 12:58:20.255220 (+647421us) log.cc:844] Serialized 52 byte log entry
0709 12:58:20.534810 (+279590us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:20.534862 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.909352 (+374490us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54004763d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:20.909463 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:20.909556 (+    93us) raft_consensus.cc:1685] finished
0709 12:58:20.909571 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.909931 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85837,"raft.queue_time_us":86542,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8719,"spinlock_wait_cycles":1690351232,"thread_start_us":112319,"threads_started":1,"wal-append.queue_time_us":421465}
I20260709 12:58:20.913821  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:20.919567  4979 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.919054  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:20.918116  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1790) took 3586 ms. Trace:
I20260709 12:58:20.942745  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:20.940605  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:20.894737  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.763010  4675 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:20.840440  4880 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:20.985687  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.987443  4706 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:20.989331  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:20.992523   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:20.955343  2346 rpcz_store.cc:276] 0709 12:58:17.849366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.850796 (+  1430us) service_pool.cc:224] Handling call
0709 12:58:17.851107 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:18.193159 (+342052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:18.193203 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:18.193253 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:18.193302 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.803294 (+2609992us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54004d8ad4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:20.803356 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.803555 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786083584}
I20260709 12:58:21.010726  1712 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
W20260709 12:58:21.011451  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.001016  4696 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.029287  4928 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:21.034734  1535 connection.cc:256] RPC call timeout handler was delayed by -1.2027445169999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 12:58:21.040268  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.049245  1721 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:21.056264  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.040707  1713 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.048555  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.073426  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1643) took 3620 ms. Trace:
I20260709 12:58:21.035741  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1731) took 3360 ms. Trace:
I20260709 12:58:21.063482  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.058657  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.072890   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:21.069658  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.059442  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1659) took 2768 ms. Trace:
I20260709 12:58:21.070946  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1739) took 3300 ms. Trace:
I20260709 12:58:21.063868  2349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 454) took 3211 ms. Trace:
I20260709 12:58:21.115000  1716 rpcz_store.cc:276] 0709 12:58:17.452567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.452717 (+   150us) service_pool.cc:224] Handling call
0709 12:58:17.497565 (+ 44848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.228330 (+2730765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.072998 (+844668us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54001063d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:21.073231 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4332788096}
I20260709 12:58:21.036238  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.092996  1564 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:21.117575  1563 rpcz_store.cc:276] 0709 12:58:17.675114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.675268 (+   154us) service_pool.cc:224] Handling call
0709 12:58:21.035318 (+3360050us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b5400042754. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:21.035562 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68814080}
I20260709 12:58:21.061530  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:21.133675  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.054464  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:21.070096  1571 consensus_meta.cc:287] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.804s	user 0.012s	sys 0.003s
W20260709 12:58:21.067207  1570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1752) took 2476 ms (client timeout 1668 ms). Trace:
I20260709 12:58:21.131153  2349 rpcz_store.cc:276] 0709 12:58:17.849069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.849208 (+   139us) service_pool.cc:224] Handling call
0709 12:58:17.849517 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:20.226633 (+2377116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.060191 (+833558us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54002ec7d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:21.060522 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3523243392}
I20260709 12:58:21.065353  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.074381  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.045471  4880 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.067917  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:21.039420  1645 rpcz_store.cc:276] 0709 12:58:17.331071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.331182 (+   111us) service_pool.cc:224] Handling call
0709 12:58:17.337745 (+  6563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.237408 (+2899663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.917514 (+680106us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400265cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:20.917865 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3693096192}
I20260709 12:58:21.130854  1644 rpcz_store.cc:276] 0709 12:58:18.290528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.290696 (+   168us) service_pool.cc:224] Handling call
0709 12:58:18.388497 (+ 97801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.229436 (+1840939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.058931 (+829495us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54002a8fd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:21.059264 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102263680}
I20260709 12:58:21.072350  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.032608  4799 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:21.150084  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:21.050017  4913 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:21.139166  1570 rpcz_store.cc:269] 0709 12:58:18.590467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.590600 (+   133us) service_pool.cc:224] Handling call
0709 12:58:21.066721 (+2476121us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400113d54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:21.066959 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3848464256}
I20260709 12:58:21.081449  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.155907  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:21.073698  4954 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:21.154318  1719 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:21.050562  4879 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:21.050182  4968 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:21.074918  4735 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:21.085233  4946 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:21.076843  4724 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:21.166505  1721 raft_consensus.cc:2410] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:21.167164  2347 raft_consensus.cc:2393] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:21.074024  4948 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:21.160493  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.172010  1712 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.169921  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.170538  1643 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:21.169051  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.175145  1638 raft_consensus.cc:2410] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:58:21.175865  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:21.161895  2343 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 4.
I20260709 12:58:21.163468  1571 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:21.180562  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.182019  1610 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:21.182204  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.183465  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.184897  4880 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:21.186067  2341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59844 (request call id 584) took 1908 ms (client timeout 1953 ms). Trace:
W20260709 12:58:21.186486  2341 rpcz_store.cc:269] 0709 12:58:19.277799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.301111 (+ 23312us) service_pool.cc:224] Handling call
0709 12:58:21.185709 (+1884598us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54005e0e54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:21.185877 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578387328}
I20260709 12:58:21.187855  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.187472  4880 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:21.195053  2340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 583) took 1967 ms. Trace:
I20260709 12:58:21.195397  2340 rpcz_store.cc:276] 0709 12:58:19.227515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.227647 (+   132us) service_pool.cc:224] Handling call
0709 12:58:19.287598 (+ 59951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:20.228906 (+941308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.194587 (+965681us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b540007e9d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:21.194877 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64136448}
I20260709 12:58:21.196946  4879 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:21.199342  4879 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:21.199944  1644 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:21.201015  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.202355  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.202626  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.203636  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:21.077347  4696 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:21.036751  4979 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:21.130993  1569 rpcz_store.cc:276] 0709 12:58:17.770698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.770874 (+   176us) service_pool.cc:224] Handling call
0709 12:58:17.771188 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:17.771417 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:17.814330 (+ 42913us) log.cc:844] Serialized 14 byte log entry
0709 12:58:21.070023 (+3255693us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b18002ef660. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d423a
0709 12:58:21.070319 (+   296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:21.070390 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:21.070498 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.070595 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:21.070768 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":95138,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":49,"raft.queue_time_us":2304,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":161,"spinlock_wait_cycles":3016576,"thread_start_us":52990,"threads_started":1,"wal-append.queue_time_us":381262}
I20260709 12:58:21.203752  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.204548  1713 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:21.172236  1647 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:58:21.209038  1717 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:21.180579  4973 raft_consensus.cc:3055] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:21.212921  1646 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.212311  4968 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.215291  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.247840  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.233517  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.233206  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.292423  1712 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:21.295147  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.352501  1638 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:21.224658  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:21.333035  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 98196.5us
I20260709 12:58:21.233737  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.373399  1645 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:21.212586  4973 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:21.246555  2349 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:21.232748  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.224339  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.378584  1717 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
W20260709 12:58:21.304376  4989 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:58:21.387252  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:21.381793  1610 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:21.382761  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.233896  4880 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:21.260170  4735 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.389516  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.391464  1713 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:21.392158  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.393894  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.399739  4928 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:21.402833  1719 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:21.400096  4979 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:21.406880  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.416575  1647 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:21.417673  1714 raft_consensus.cc:2410] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:58:21.259934  4724 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.332828  4948 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:21.420537  4979 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:21.391350  4880 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:21.424065  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.426819  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:21.424328  1719 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:21.424607  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:21.420898  4890 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:21.425328  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 64825.5us
W20260709 12:58:21.426012  4992 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:58:21.426083  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.304754  4913 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.432384  1721 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:21.428337  4880 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:21.434965  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.439741  1719 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:21.407588  4973 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:21.441452  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 54453.2us
I20260709 12:58:21.441650  4973 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:21.441890  1564 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:21.443691  1537 leader_election.cc:400] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7.
I20260709 12:58:21.444674  1684 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:21.445482  1563 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:58:21.445551  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 225880us
I20260709 12:58:21.423866  4979 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.438645  1567 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:21.450348  1610 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:21.454118  4738 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:21.453960  4410 consensus_queue.cc:1059] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:21.454566  4738 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.454954  4738 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:21.459653  1566 raft_consensus.cc:1240] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:21.460290  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:21.460608  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:21.461125  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.461519  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:21.461922  2312 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:21.462301  1572 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:21.462639  4902 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:21.463047  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:21.463510  4902 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:21.463578  1572 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:21.463949  2312 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:21.464039  4438 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:21.465062  4963 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:21.465495  4963 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:21.465404  4862 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:21.465966  4963 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.466289  4862 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.466696  4862 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:21.467272  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.467998  1638 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:21.463964  4902 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:21.469447  4902 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:21.469800  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.473240  1715 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:21.461143  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.468945  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:21.462083  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.462119  1570 raft_consensus.cc:2410] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:21.465057  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:21.472483  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.478678  1568 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:21.451325  4979 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:21.482391  1641 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:21.482854  1570 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:21.473623  4735 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:21.483938  1646 raft_consensus.cc:2410] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:58:21.484447  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.484990  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.486105  4879 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:21.486550  4879 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:21.486986  4879 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:21.487006  4968 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:21.490948  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:21.491549  1646 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:21.502683  1563 raft_consensus.cc:2410] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:21.492164  1565 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:21.503643  1638 raft_consensus.cc:2393] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:21.502369  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 49086.8us
I20260709 12:58:21.493255  1566 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
W20260709 12:58:21.508531  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.510257  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.512411  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:21.513274  1566 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:21.514348  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:21.515401  1639 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:21.515914  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:21.517050  1640 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:21.543509  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:21.589186  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.589255  1719 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:21.594215  1570 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:21.590598  1639 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:58:21.593137  1719 pending_rounds.cc:85] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 4
I20260709 12:58:21.596452  4724 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:21.596323  1719 pending_rounds.cc:107] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:21.599385  1719 raft_consensus.cc:2889] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:21.601516  2314 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:21.602542  4808 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:21.603055  4808 raft_consensus.cc:697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:21.604112  1639 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:58:21.604453  1639 pending_rounds.cc:85] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 3
I20260709 12:58:21.604008  4808 consensus_queue.cc:237] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.604728  1639 pending_rounds.cc:107] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:58:21.605013  1639 raft_consensus.cc:2889] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:21.606918  4862 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.594101  1537 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:21.618824  1566 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
W20260709 12:58:21.622895  4994 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:58:21.624321  4995 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:58:21.626119  1566 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:21.629007  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.635641  1639 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:21.640101  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.644300  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.635130  4946 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:21.660442  1647 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:58:21.660943  1647 pending_rounds.cc:85] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 3
W20260709 12:58:21.662176  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 150253us
I20260709 12:58:21.669579  1647 pending_rounds.cc:107] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:58:21.669982  1647 raft_consensus.cc:2889] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:21.677650  1566 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:21.671624  4855 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:21.683048  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.687139  4904 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:21.688726  2345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 436) took 3352 ms. Trace:
I20260709 12:58:21.682102  4855 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.701249  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.701690  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.710374  1646 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:21.710613  1537 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:21.713654  1646 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:21.702240  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.710208  2345 rpcz_store.cc:276] 0709 12:58:18.286711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.286884 (+   173us) service_pool.cc:224] Handling call
0709 12:58:18.287270 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:19.683985 (+1396715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:19.684017 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:21.196570 (+1512553us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b2c00021e98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4102da11 00007f6a4103d372 00007f6a4276fa01 00007f6a4273443a 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2
0709 12:58:21.197226 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 12:58:21.409525 (+212299us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:21.409571 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.455731 (+ 46160us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54004b9454. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:21.455783 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:21.625530 (+169747us) raft_consensus.cc:1685] finished
0709 12:58:21.625547 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:21.639109 (+ 13562us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":369103,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":115,"spinlock_wait_cycles":2559806976,"thread_start_us":494704,"threads_started":2,"wal-append.queue_time_us":279421}
I20260709 12:58:21.715580  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.716075  1720 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:21.716344  1537 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:21.716791  4946 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:21.716907  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.717684  4946 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:21.708520  4963 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.717918  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:21.718560  1715 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:21.719326  1719 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:21.719581  1537 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:21.717711  1720 raft_consensus.cc:2393] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:21.692570  4968 raft_consensus.cc:3055] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:21.701519  4890 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:21.714084  4855 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:21.709908  4410 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.742270  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.710430  4696 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:21.712384  4954 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.744360  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:21.681445  4902 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.733232  4968 raft_consensus.cc:740] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:21.748051  1715 raft_consensus.cc:3055] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:21.729234  4862 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:21.747583  4617 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:21.748534  1715 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:21.754539  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.761070  1712 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:21.739140  4913 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:21.782080  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.782924  1717 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:21.791383  4979 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.792723  1647 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:58:21.793619  1715 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:21.794662  1715 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:21.797005  4968 consensus_queue.cc:260] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.759723  4410 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.806664  4954 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:21.808382  4879 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.809037  4738 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:21.760586  4890 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:58:21.816160  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.843847  1715 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:21.845665  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.804558  4880 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:21.848860  1639 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:21.849783  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:21.851447  1566 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:21.852434  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.852483  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:21.853668  2347 raft_consensus.cc:2393] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:21.854773  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.853602  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.855924  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:21.855937  1566 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:21.857398  1564 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:21.888114  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1737) took 4141 ms (client timeout 1765 ms). Trace:
I20260709 12:58:21.890201  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:21.888509  1571 rpcz_store.cc:269] 0709 12:58:17.747060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.748370 (+  1310us) service_pool.cc:224] Handling call
0709 12:58:21.877526 (+4129156us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b5400165dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:21.888051 (+ 10525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5548461952}
W20260709 12:58:21.895133  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.891007  1563 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:21.887372  4879 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:21.901104  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:21.902956  2347 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:21.876307  4880 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:21.887605  4617 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:21.914180  1563 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:21.915258  1715 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:58:21.915689  1715 pending_rounds.cc:85] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 4
I20260709 12:58:21.916047  1715 pending_rounds.cc:107] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:58:21.916352  1715 raft_consensus.cc:2889] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:21.907677  4902 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:21.936723  4617 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:21.938982  4617 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:21.939522  4617 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:21.939862  4617 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:21.926488  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 479730us
I20260709 12:58:21.963790  1640 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:58:21.966917  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:21.969074  1563 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:21.968400  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:21.985021  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 264552us
I20260709 12:58:21.985827  1537 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:21.986268  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.988379  4954 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:21.992901  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:21.990731  1713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.007s	sys 0.019s
W20260709 12:58:21.995131  1713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.007s	sys 0.019s
W20260709 12:58:21.998652  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.011206  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:22.011860  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:22.011349  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:22.012441  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:22.013052  1714 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
W20260709 12:58:22.013216  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 48045.1us
I20260709 12:58:21.996450  4902 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:21.994139  4946 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:22.017575  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.002144  4855 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.023264  1712 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:22.028064  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:22.031196  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:22.031688  1717 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.018278  4738 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:22.022631  4904 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:58:22.026626  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:21.980612  4617 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.036954  1641 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.035176  1684 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:22.037714  1640 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:22.040369  1714 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:22.046432  4948 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:22.047149  4948 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:22.047415  4948 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.047617  4948 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.039951  4438 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:22.053758  1719 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:22.060093  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:22.061286  1719 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:22.058203  4438 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:22.063308  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 213661us
I20260709 12:58:22.061529  4884 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:22.069125  4963 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:22.069976  4946 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:22.065810  1712 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:58:22.068475  4884 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.066037  4617 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:22.070438  4946 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:22.065909  4438 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:22.080472  4968 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:22.083882  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 434) took 1017 ms. Trace:
I20260709 12:58:22.075459  4884 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:22.089449  1717 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:22.085222  1643 rpcz_store.cc:276] 0709 12:58:21.066392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.276063 (+209671us) service_pool.cc:224] Handling call
0709 12:58:21.397518 (+121455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:21.399794 (+  2276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.399823 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:21.400399 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:58:21.893580 (+493181us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:21.893634 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.893760 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.083638 (+189878us) raft_consensus.cc:1685] finished
0709 12:58:22.083657 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.083811 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":613,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"thread_start_us":486534,"threads_started":1,"wal-append.queue_time_us":601903}
I20260709 12:58:22.092159  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 2073) took 1176 ms. Trace:
I20260709 12:58:22.092556  1713 rpcz_store.cc:276] 0709 12:58:20.915794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.401343 (+485549us) service_pool.cc:224] Handling call
0709 12:58:21.413306 (+ 11963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:21.429523 (+ 16217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.429552 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:21.438416 (+  8864us) log.cc:844] Serialized 26 byte log entry
0709 12:58:22.003555 (+565139us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:22.003600 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.003669 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.091937 (+ 88268us) raft_consensus.cc:1685] finished
0709 12:58:22.091954 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.092104 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6064,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":8371,"thread_start_us":505105,"threads_started":1,"wal-append.queue_time_us":554291}
I20260709 12:58:22.094291  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:22.094601  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 404) took 1018 ms. Trace:
I20260709 12:58:22.095417  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:22.096216  1713 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 7: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:22.095009  1718 rpcz_store.cc:276] 0709 12:58:21.076313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.408342 (+332029us) service_pool.cc:224] Handling call
0709 12:58:21.692746 (+284404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:21.693005 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:21.693307 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 12:58:21.915585 (+222278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:21.915633 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:21.915709 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.915783 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.094325 (+178542us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54002dee50. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:22.094456 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":139,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":105,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":623522560,"thread_start_us":221580,"threads_started":1,"wal-append.queue_time_us":221909}
I20260709 12:58:22.101173  4855 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:22.101199  1720 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:22.107237  2347 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:22.111315  1610 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:22.111445  1641 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:22.114610  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:22.119215  1717 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:22.118979  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:22.123696  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 133395us
I20260709 12:58:22.121636  1716 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:22.090305  5007 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:22.126348  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:22.122640  4973 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.006s
W20260709 12:58:22.120339  4990 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.009s	sys 0.018s
I20260709 12:58:22.142339  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:22.145378  1715 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:22.149533  2349 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
W20260709 12:58:22.153033  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 130129us
I20260709 12:58:22.125075  4890 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:22.141397  4808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.006s
W20260709 12:58:22.148674  4990 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.010s	sys 0.018s
W20260709 12:58:22.153334  5005 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:58:22.168298  1714 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:22.169878  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:22.171527  1640 raft_consensus.cc:2393] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 5: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:22.169656  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:22.167014  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 181296us
W20260709 12:58:22.177878  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 142657us
I20260709 12:58:22.185573  4880 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:22.195286  4880 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.197001  4410 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:22.200316  1537 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:22.200874  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 116404us
I20260709 12:58:22.202127  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1665) took 1117 ms. Trace:
I20260709 12:58:22.202733  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:58:22.166133  4808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.009s	sys 0.007s
I20260709 12:58:22.186085  1612 leader_election.cc:400] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:58:22.204181  1612 leader_election.cc:403] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:58:22.204371  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:22.158594  4890 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:22.212672  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 47388us
I20260709 12:58:22.158006  5007 raft_consensus.cc:697] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:22.215507  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:22.168787  4869 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.024s
I20260709 12:58:22.235215  2345 raft_consensus.cc:1240] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:22.230525  4869 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.007s	sys 0.024s
I20260709 12:58:22.214934  4890 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:22.242167  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:22.235106   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:22.236999  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1668) took 1151 ms. Trace:
I20260709 12:58:22.243316  1638 rpcz_store.cc:276] 0709 12:58:21.086001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.590905 (+504904us) service_pool.cc:224] Handling call
0709 12:58:21.606361 (+ 15456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:21.607087 (+   726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.607127 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:21.607612 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:58:21.877469 (+269857us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:21.877530 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:21.877623 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.236731 (+359108us) raft_consensus.cc:1685] finished
0709 12:58:22.236754 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.236922 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":109,"thread_start_us":269343,"threads_started":1,"wal-append.queue_time_us":441521}
I20260709 12:58:22.202490  1721 rpcz_store.cc:276] 0709 12:58:21.085158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.438013 (+352855us) service_pool.cc:224] Handling call
0709 12:58:21.478311 (+ 40298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:21.596005 (+117694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:21.596041 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:21.620889 (+ 24848us) log.cc:844] Serialized 26 byte log entry
0709 12:58:21.987235 (+366346us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:22.009785 (+ 22550us) log.cc:844] Serialized 14 byte log entry
0709 12:58:22.015744 (+  5959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:22.015842 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:22.098916 (+ 83074us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b1800487f60. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:22.201850 (+102934us) raft_consensus.cc:1685] finished
0709 12:58:22.201945 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:22.202070 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1242,"prepare.queue_time_us":19971,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":98577,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":26295,"spinlock_wait_cycles":5835904,"thread_start_us":311658,"threads_started":1,"wal-append.queue_time_us":391524}
I20260709 12:58:22.231891  4879 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:22.253271  1535 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:22.263019  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:22.263810  2347 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:22.231653  4855 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 12:58:22.275005  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 74791.8us
I20260709 12:58:22.238135  4954 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 5. Current term is 6.
I20260709 12:58:22.251257  4979 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:22.248821  4808 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:58:22.285300  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:22.285676  5023 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:22.285781  4812 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:22.254877  4879 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:22.296119  1642 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:22.294735  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:22.286754  4902 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:58:22.294502  4812 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.308704  5015 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:22.309150  4812 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:22.282861  1537 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:22.278673  5006 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:58:22.318461  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 132562us
W20260709 12:58:22.320430  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 75251.9us
I20260709 12:58:22.296244  4879 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:22.322012  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 86283us
W20260709 12:58:22.324227  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 82362.5us
I20260709 12:58:22.325630  2312 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:22.370733  1535 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:22.293838  5010 consensus_queue.cc:1059] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
W20260709 12:58:22.371788  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 51812.5us
I20260709 12:58:22.326000  4724 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:22.324404  5006 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:22.313431  4946 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.314363  4948 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.327123  4999 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:58:22.443315  4946 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:22.444204  4946 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:22.446065  4946 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:22.446405  4946 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.446678  4438 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.448081  4948 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:22.448861  4438 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:22.373260  4738 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:58:22.478783  4884 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:22.481285  5020 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:58:22.483940  4880 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:22.448792  4948 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:22.484758  4948 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.485157  4948 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.485505  4617 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:58:22.485790  5024 log.cc:927] Time spent T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:58:22.413995  4979 consensus_queue.cc:1059] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:58:22.491606  4979 raft_consensus.cc:3055] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:22.492065  4979 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:22.324074  4973 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:58:22.493113  4979 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.494498  4979 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.434675  4735 consensus_queue.cc:1059] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:58:22.369069  5007 consensus_queue.cc:237] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:22.381217  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.409255  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53517.8us
I20260709 12:58:22.372089  5018 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:22.429806  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.433286  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.409497  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.476262  4808 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:58:22.492175  5021 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:58:22.506227  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.511766  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.512207  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 102358us
I20260709 12:58:22.421491  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:22.508059  1564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.008s	sys 0.001s
W20260709 12:58:22.514416  1564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.008s	sys 0.001s
I20260709 12:58:22.446712  4946 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:22.520658  4808 raft_consensus.cc:697] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:22.497321  5006 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.521853  4808 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.511258  5018 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.508340  5015 raft_consensus.cc:697] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:22.532625  4884 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:22.526211  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 161447us
I20260709 12:58:22.510608  5023 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:22.577363  5023 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.523954  4879 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.583160  4879 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:22.584303  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:22.558300  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:22.559223  5015 consensus_queue.cc:237] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.534988  4890 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.523452  4724 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:22.561662  5026 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:58:22.566253  5018 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:22.569080  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 54788.8us
I20260709 12:58:22.564157  4946 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.569779  4904 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:22.570652  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 161316us
I20260709 12:58:22.571710  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:22.588762  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:22.609315  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 332684us
I20260709 12:58:22.649720  1537 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:22.654991  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 98804.7us
I20260709 12:58:22.656529  2347 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:22.657931  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:22.658982  4879 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:22.659616  4879 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:22.660810  4879 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.598405  5040 raft_consensus.cc:3055] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:22.666596  5007 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:22.666622  5040 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:22.677004  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 105412us
I20260709 12:58:22.678694  4738 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:22.679584  4724 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.680253  1537 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:22.681249  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:22.684859  5036 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:22.686455  5036 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:22.686813  5036 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:22.687182  5036 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:22.687628  5022 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:22.688095  5022 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.688499  5022 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:22.688591  5033 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:58:22.689571  5033 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:22.689914  5033 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:22.690848  5033 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.692152  5033 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:22.695214  5032 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:22.676390  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:22.684911  5028 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:22.653087  4812 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:22.702412  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 354283us
I20260709 12:58:22.771968  4968 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:22.696234  1537 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:22.778460  1535 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:22.677364  5007 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:58:22.789310  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 93126.4us
I20260709 12:58:22.672997  4869 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:58:22.792959  1641 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:58:22.837024  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46588.9us
I20260709 12:58:22.791270  5007 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.696033  4904 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:58:22.879498  4999 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:22.880024  4999 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:22.880995  4999 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.881347  4983 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:58:22.882447  4999 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.885363  4617 raft_consensus.cc:3055] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:22.885067  5037 consensus_queue.cc:1059] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.213s
I20260709 12:58:22.885773  4617 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:22.886759  5037 raft_consensus.cc:3055] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:22.886813  4617 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.887410  5037 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:22.870186  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:22.892913  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.770759  4948 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:22.901531  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 123304us
W20260709 12:58:22.909513  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 236357us
I20260709 12:58:22.909417  4983 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:22.910830  1612 leader_election.cc:400] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:22.911868  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:22.917269  4879 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:22.918741  1612 leader_election.cc:400] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8.
I20260709 12:58:22.919019  1612 leader_election.cc:403] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:58:22.919627  4879 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8.
I20260709 12:58:22.921236  5036 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.924567  1612 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:22.925972  4979 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:22.927627  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:22.839541  5032 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:22.731727  5039 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
I20260709 12:58:22.841022  5010 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:22.935052  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:22.935948  4979 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:22.936152  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:22.936597  4979 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:22.937704  4979 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:22.901152  4617 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:22.955096  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 168782us
I20260709 12:58:22.956044  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:22.957895  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:22.925168  5036 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:22.959219  4738 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:22.959520  5034 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:58:22.959334  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:22.997500  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.942682  4963 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:58:23.021628  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 85604.2us
I20260709 12:58:22.960208  4946 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:22.942039  5010 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.940743  4724 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:22.942543  5032 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:23.025646  5010 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:22.947952  4890 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:23.028172  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 68905.2us
W20260709 12:58:23.027396  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 85581.8us
I20260709 12:58:23.034085  1712 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:23.020669  4880 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:23.029731  5032 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:23.023365  4963 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:23.031618  4738 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:23.035358  4968 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:23.023828  5042 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:23.022760  4884 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:58:23.053532  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:23.051712  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:23.065313  1719 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:23.066020  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:23.066718  2349 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:23.068436  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:23.069694  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:23.070920  1714 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:23.051663  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:23.058049  2345 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEARNER]: Advancing to term 8
I20260709 12:58:23.048971  1535 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:23.074049  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:23.074532  1569 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:23.092872  5043 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:58:23.094120  4738 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:23.094573  5049 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:58:23.095367  4812 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:23.096194  5044 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:58:23.097571  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.098342  1564 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:23.101670  2345 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:58:23.121665  5060 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:23.122347  5060 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:22.888586  5037 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:23.125301  5051 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:58:23.125303  5060 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:22.947847  5040 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:23.131930  5040 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.135711  5022 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:23.075155  4724 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.136916  4724 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:23.139003  4724 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:23.142383  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.130060  4963 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:23.185060  1565 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:23.149513  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.185742  1719 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:23.162349  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:23.065245  5042 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:23.196519  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 138224us
W20260709 12:58:23.199666  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.200948  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:23.203929  1563 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:58:23.204375  1563 pending_rounds.cc:85] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 5
W20260709 12:58:23.204910  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 156010us
W20260709 12:58:23.207724  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 131351us
I20260709 12:58:23.208498  1570 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:23.211874  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.143209  5039 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:23.212532  1568 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:23.215421  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.203789  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:23.219988  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:23.196799  5063 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:23.094748  4738 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:23.214753  4724 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:58:23.200737  5060 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:23.223603  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:23.235770  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.237607  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.239404  1564 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:23.237845  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:23.240170  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.200759  5042 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:23.204619  1563 pending_rounds.cc:107] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
W20260709 12:58:23.239353  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 444579us
W20260709 12:58:23.242678  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44457.3us
I20260709 12:58:23.246289  1563 raft_consensus.cc:2917] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 12:58:23.246675  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:23.246784  1563 raft_consensus.cc:2889] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:23.207571  4880 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:23.143115  4735 consensus_queue.cc:1175] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 12:58:23.222813  4963 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:23.250160  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:23.254019  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:23.254664  1567 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:23.252206  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.238976  5060 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:23.246834  4979 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:23.270484  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:23.272811  4890 consensus_queue.cc:1059] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:23.273784  4890 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:23.274120  4890 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:23.274461  4890 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:23.278105  5022 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:23.278237  4738 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:23.280658  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:23.281795  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.282802  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.283344  1566 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:23.283722  5007 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:23.261806  4979 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.287576  5010 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:23.288244  4979 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:23.254074  5039 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:23.293073  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.248230  4724 consensus_queue.cc:1059] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:58:23.296096  1572 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:58:23.250942  4948 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:23.316470  1569 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
W20260709 12:58:23.343761  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 82425.6us
I20260709 12:58:23.272569  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:23.260932  5060 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:23.350390  1571 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:58:23.353991  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:23.354775  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 82310us
I20260709 12:58:23.349148  5039 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:23.345450  4724 raft_consensus.cc:3055] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:23.356781  4724 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:23.357650  4724 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:23.358829  4724 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:23.361168  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.361991  1566 raft_consensus.cc:2410] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 12:58:23.239468  5063 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:23.363359  5060 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:23.364146  5063 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:23.369071  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:23.369823  2347 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:23.376621  1567 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:23.382613  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:23.349856   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:23.387660  4968 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:23.388334  4968 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:23.391017  1566 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:23.392254  4812 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:23.392690  4812 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:23.393535  4812 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:23.394744  4812 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:23.398043  1569 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:23.388752  5068 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:58:23.406366  1569 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:23.406479  1564 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
W20260709 12:58:23.466727  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:23.475459  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 114186us
I20260709 12:58:23.467096  4948 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:58:23.461236  5015 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:58:23.429590  5032 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:23.595786  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.471488  4880 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:23.600312  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 169272us
I20260709 12:58:23.835606  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:23.679601  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 248852us
I20260709 12:58:23.837692  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:23.740095  5068 raft_consensus.cc:3055] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:58:23.649003  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52089.6us
I20260709 12:58:23.842023  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:23.842636  5028 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.842880  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.844111  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.854314  1564 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 6: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:23.841351  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 242054us
W20260709 12:58:23.844916  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.845719  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.846091  1535 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:23.671079  5007 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:23.847404  4983 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:23.675179  4890 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:23.848762  4902 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:23.855638  1568 raft_consensus.cc:2376] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10. Re-sending same reply.
I20260709 12:58:23.859221  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:23.856411  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:23.615599  5057 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:23.864126  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:23.864241  5007 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:23.674618  5042 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:23.864518  4904 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:23.865500  4890 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:23.861940  4948 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.866035  1563 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:23.857631  5028 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:23.851643  5068 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:23.870607  4902 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.874614  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:23.650005  4979 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:23.876741  4948 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:23.890388  5073 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 12:58:23.893057  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.894456  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:23.895330  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:23.896898  1567 raft_consensus.cc:1240] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:23.872882  5060 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:23.872324  5057 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:23.873724  4983 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:23.877332  4902 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:23.902618  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:23.908336  1716 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:23.908171  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:23.906214  1714 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 5.
I20260709 12:58:23.875185  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.893461  5025 consensus_queue.cc:1059] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:58:23.909780  5028 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:23.911309  1713 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:23.912344  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:23.913022  1715 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:23.909509  1568 raft_consensus.cc:2393] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:23.875054  5069 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:23.907711  1565 raft_consensus.cc:2376] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8. Re-sending same reply.
I20260709 12:58:23.918833  1571 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:23.919878  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.920699  1567 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:23.925091  4963 consensus_meta.cc:287] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.668s	user 0.013s	sys 0.002s
I20260709 12:58:23.940925  1714 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:23.945242  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.946359  1563 raft_consensus.cc:2410] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:58:23.922194  5069 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.950460  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:23.950894  5069 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:23.918272  5010 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:23.998975  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:24.000012  1563 raft_consensus.cc:2410] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
W20260709 12:58:24.000837  5033 consensus_meta.cc:287] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.308s	user 0.008s	sys 0.012s
I20260709 12:58:24.005403  1712 raft_consensus.cc:2410] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:58:24.012575  1612 connection.cc:256] RPC call timeout handler was delayed by -1.6660617420000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 12:58:24.014008  1612 connection.cc:256] RPC call timeout handler was delayed by -1.6165617419999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 12:58:24.017431  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.019207  1563 raft_consensus.cc:2393] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:24.018424  1612 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.803s (SENT) [suppressed 22 similar messages]
I20260709 12:58:24.022606  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:24.023217  1571 raft_consensus.cc:2376] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8. Re-sending same reply.
I20260709 12:58:24.007362  4724 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:24.032806  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 186782us
I20260709 12:58:23.917481  5068 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:24.034217  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 128757us
I20260709 12:58:24.016562  4979 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.038137  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.028985  5037 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:24.048079  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.083068  5074 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.083884  5074 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.086860  5074 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:24.088925  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:24.098968  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 59247.3us
I20260709 12:58:24.105242  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.049546  4948 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.055367  5068 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:24.108196  1563 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:24.050539  5025 consensus_queue.cc:1059] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:58:24.119150  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:24.118750  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 100136us
I20260709 12:58:24.123183  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:24.123967  1563 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:24.125826  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:24.126775  1713 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.153707  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:24.160244  1612 connection.cc:256] RPC call timeout handler was delayed by -1.5949617420000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
I20260709 12:58:24.114787  4904 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:58:24.117682  5082 consensus_queue.cc:1059] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:58:24.285362  1639 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:58:24.291106  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.261484  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:24.187383  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.204063  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:24.180449  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.183317  1713 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:24.325133  1643 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:24.253850  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:24.183363  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:24.173154  1612 connection.cc:256] RPC call timeout handler was delayed by -1.5913617420000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 12:58:24.180683  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.284119  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:24.254271  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:24.324630  1638 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:24.289955  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:24.186980  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.328526  1712 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:24.247314  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.261807  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:24.327675  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4524721440000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 12:58:24.329500  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4492770119999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 12:58:24.329679  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:24.329954  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3966381049999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 12:58:24.330417  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2832721440000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
I20260709 12:58:24.190071  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:24.330796  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2652721439999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 12:58:24.331288  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0609721440000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:58:24.331095  1719 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:24.125782  5042 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:24.183722  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:24.331640  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0534266439999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
I20260709 12:58:24.329675  1641 raft_consensus.cc:2410] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:24.325987  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:24.244122  4968 consensus_meta.cc:287] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.001s
W20260709 12:58:24.189273  5079 log.cc:927] Time spent T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:58:24.346478  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:24.240342  4617 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.349040  1713 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:24.376013  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:24.376413  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:24.377050  1719 raft_consensus.cc:2410] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:24.345448  1718 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:24.151244  4983 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:24.352355  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.379891  1642 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:24.335264  1647 raft_consensus.cc:2410] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:58:24.267022  5018 raft_consensus.cc:3055] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:24.359730  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:24.360030  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:24.360813  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.390807  1638 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:24.361166  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.391851  1643 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:24.361495  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.361656  1639 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:24.362154  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.362463  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.186491  5057 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:24.363078  1644 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:24.363565  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:24.363619  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.395125  1717 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:24.365272  4904 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:24.218920  5017 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.332361  5040 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.378382  1719 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:24.402717  1719 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:24.403977  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:24.211674  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:24.389430  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.394353  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.395632  1641 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 3.
I20260709 12:58:24.392920  1640 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
W20260709 12:58:24.421592  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 49382.3us
I20260709 12:58:24.399106  1712 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:24.400072  5104 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.268541  4902 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.321687  5069 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.400882  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.163154  5076 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.237s
I20260709 12:58:24.397151  4904 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:24.405639  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.462670  1645 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:24.405938  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.404524  5017 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.408380  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.409194  1718 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:24.463682  1638 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.389868  5018 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:24.412961  5040 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.414207  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:24.450752  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 548971us
I20260709 12:58:24.452092  1639 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:24.470952  2347 raft_consensus.cc:2368] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9.
W20260709 12:58:24.455137  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.471814  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:24.472188  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.462024  1563 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:58:24.375547  4968 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.466244  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.382463  4617 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.468863  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.476671  1644 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:24.479060  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.482380  1572 raft_consensus.cc:1240] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:24.489575  1641 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:24.483131  1639 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:58:24.493619  1647 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:24.499204  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.509560  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.476004  5006 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.515935  1647 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:24.517602  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.518256  1644 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:24.520236  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.521020  1639 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:24.481519  4948 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.525355  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.535355  5040 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:24.536487  4904 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.511255  5109 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.538463  5109 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.541836  4983 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.544013  1638 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:24.545684  1684 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:24.546103  5069 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.546522  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:24.547891  4735 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:24.548237  4735 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:24.548594  4735 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.549539  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.550220  1638 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:24.551321  1563 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:24.552821  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.565291  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.553268  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.568619  1564 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
W20260709 12:58:24.570041  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.497375  5096 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.554225  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:24.565644  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:24.571753  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 92840.5us
I20260709 12:58:24.550032  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.574198  1639 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:24.574540  1568 raft_consensus.cc:2410] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
W20260709 12:58:24.574893  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.461476  5104 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.575767  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:24.571949  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.586256  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.587769  1568 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:24.588443  1684 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:24.588943  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:24.590700  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:24.587824  1686 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.592770  1639 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:24.593807  1641 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:24.594290  1639 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:24.594501  1638 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:24.488373  5018 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:24.598639  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 110141us
I20260709 12:58:24.600023  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:24.607578  1568 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.612885  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.613672  1567 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:24.615202  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:24.615760  1713 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.613523  4902 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.578605  5040 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:24.575760  5087 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.625273  1537 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:24.626010  2314 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.627281  1713 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:24.572343  4973 consensus_queue.cc:1059] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:58:24.634907  1686 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.578466  4880 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:58:24.638283  1641 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:24.527765  5006 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.554085  4948 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:24.631417  5040 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.628247  4724 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:24.633479  5018 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:24.628118  5081 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:24.656224  1645 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:24.636474  5105 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:24.649077  5068 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.001s
W20260709 12:58:24.653923  5037 consensus_meta.cc:287] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.000s
I20260709 12:58:24.636754  5095 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:58:24.655707  5040 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.673584  1570 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:24.674391  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.640482  5087 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.675621  1643 raft_consensus.cc:2410] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:24.655284  4724 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:24.662617  4968 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:24.674338  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:24.679899  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:24.671705  5066 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:58:24.686071  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 56979.9us
I20260709 12:58:24.677739  5074 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.677902  5037 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:24.679234  4724 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:24.675529  5105 raft_consensus.cc:697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:24.674793  5110 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.681952  5080 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:24.703575  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:24.675629  5076 consensus_queue.cc:1243] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:24.678831  5068 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:58:24.689992  4808 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:24.710701  5087 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:24.711804  5032 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.712980  5006 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.713317  4948 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.701298  4979 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:24.741097  1686 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.712221  4735 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.704464  5110 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:24.741098  5100 log.cc:927] Time spent T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:58:24.748869  4808 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:24.725962  4617 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.701391  5074 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.716696  5037 raft_consensus.cc:697] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:24.765173  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44863.2us
I20260709 12:58:24.745383  4979 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.741159  5058 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:24.707320  5069 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:58:24.750036  4880 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:24.631295  5106 consensus_queue.cc:1175] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" responder_term: 7 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 6. Current term is 7. Ops: [6.8-6.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:24.753991  5006 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 12:58:24.786069  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 111779us
I20260709 12:58:24.786806  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:24.760362  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.772238  5110 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.773068  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.789619  1647 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:24.790900  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.791633  1647 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.773871  5105 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.775458  5037 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.714224  5081 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:58:24.769589  5017 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:24.778702  4904 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.779875  1568 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:24.767714  4979 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.782191  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.816488  1640 raft_consensus.cc:2410] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:58:24.781952  5096 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:24.783061  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.819718  5096 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:24.819821  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:24.786139  4880 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.821168  1686 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.821563  5066 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:24.822335  5066 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:24.822599  4880 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.759763  5087 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:24.784101  4808 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.820257  5096 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:24.793458  1684 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:24.799446  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.840072  1564 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:24.803579  1567 raft_consensus.cc:1240] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:24.840585  1564 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:24.803442  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:24.805871  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.782119  4735 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:24.843341  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50007.6us
W20260709 12:58:24.833099  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 70050.8us
W20260709 12:58:24.833559  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 204132us
I20260709 12:58:24.836033  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:24.746649  5076 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:58:24.788894  5058 raft_consensus.cc:3055] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:24.784970  5094 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.574s	user 0.002s	sys 0.001s
I20260709 12:58:24.858013  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:24.801867  5109 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.845062  1718 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:24.823978  5110 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:24.849419  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:24.847268  1564 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.864279  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:24.862877  2346 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:24.864688  1537 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:24.856977  1686 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.867755  2344 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:24.843961  5096 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.860621  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:24.856662  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:24.870388  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 64607.2us
I20260709 12:58:24.871883  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.875262  5135 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:24.866184  4617 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.846720  5104 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.879422  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:24.848459  5042 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:24.848744  5058 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:24.885326  5058 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.886601  1641 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:58:24.886606  5058 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.883641  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:24.859763  5119 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:24.866231  5110 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:24.887753  1644 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:24.867178  5074 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.870375  4948 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:24.893579  1641 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:24.846185  5087 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:58:24.895874  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 48970us
I20260709 12:58:24.896245  1537 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:24.888388  5042 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.895795  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:24.892263  2341 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:24.893713  5006 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:58:24.892728  4880 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:24.903846  5113 raft_consensus.cc:670] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } [suppressed 4 similar messages]
I20260709 12:58:24.884461  4617 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.894090  5110 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.895254  5114 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:24.912338  1641 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:24.899529  5074 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:24.901120  5042 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:24.921838  5137 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:24.904199  5126 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:24.930914  5118 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:58:24.910563  5119 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:24.926378  5137 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.949642  5137 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.926152  5074 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.953025  1686 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.955071  4735 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:24.955579  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.956750  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:24.958029  5133 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.958564  5133 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:24.960986  5131 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:24.964839  5042 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.968325  5042 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:24.974483  5096 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:24.975740  4617 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:24.929414  5135 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:58:24.963001  5074 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:24.932312  5114 raft_consensus.cc:697] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:24.965152  5125 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:58:24.985508  1647 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:24.983518  5133 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:24.956262  5119 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:58:24.990939  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:24.976629  5096 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:24.962059  5087 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:24.976548  4617 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:25.009487  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:25.010442  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 122241us
I20260709 12:58:25.019922  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:24.987875  4735 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:58:25.013815  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 142020us
I20260709 12:58:24.982251  4724 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.034113  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:25.022856  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:25.036110  1535 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:25.037760  1684 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:25.038456  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:25.021816  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 100110us
I20260709 12:58:25.006178  4948 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:25.044173  1537 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:25.046016  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:25.009027  4812 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:58:24.990015  5136 consensus_queue.cc:1059] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:58:25.046590  2340 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:25.036924  5096 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:25.041213  5087 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:25.057293  5087 raft_consensus.cc:697] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:25.045601  5015 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:25.060930  5114 consensus_queue.cc:237] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.040614  5037 raft_consensus.cc:2764] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:58:25.054373  5146 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:58:25.021307  4617 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.065864  1610 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:25.037076  5042 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:58:25.050278  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:25.085592  5029 raft_consensus.cc:3055] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:25.086071  5029 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:25.086983  5029 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:25.113019  4963 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.011s	sys 0.006s
I20260709 12:58:25.115913  5141 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:25.116436  5141 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.117061  5141 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:25.120630  2340 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:25.076905  5096 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:25.117269  5015 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:25.122279  5015 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:25.122512  5096 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.123142  5015 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.125937  4617 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:25.127523  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 77346.3us
I20260709 12:58:25.128191  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:58:25.139827  1570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1764) took 1906 ms (client timeout 2232 ms). Trace:
W20260709 12:58:25.140300  1570 rpcz_store.cc:269] 0709 12:58:23.221477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.222153 (+   676us) service_pool.cc:224] Handling call
0709 12:58:25.127280 (+1905127us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400134054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:25.128245 (+   965us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3296809344}
I20260709 12:58:25.142875  5145 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:25.143456  5145 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:25.143172  5156 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:25.143982  5145 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:25.145496  5156 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:58:25.149823  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 70988.3us
I20260709 12:58:25.088104  5029 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.091956  4880 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:25.129029  4963 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.012s	sys 0.006s
I20260709 12:58:25.160542  1686 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:25.138289  5057 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:25.157161  4724 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:25.164930  4617 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:25.165313  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:25.168375  1647 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:25.165123  4948 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.140259  5037 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:25.173751  4812 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:25.196219  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 424) took 1281 ms. Trace:
I20260709 12:58:25.157362  4979 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.180019  5037 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:25.161549  5063 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 12:58:25.211324  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 72123.9us
I20260709 12:58:25.209411  1716 rpcz_store.cc:276] 0709 12:58:23.914923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.915031 (+   108us) service_pool.cc:224] Handling call
0709 12:58:23.915310 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:24.989867 (+1074557us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b180048a840. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4272cbfb 00007f6a4273764b
0709 12:58:24.990034 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:24.990069 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:25.018767 (+ 28698us) log.cc:844] Serialized 26 byte log entry
0709 12:58:25.110531 (+ 91764us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:25.110565 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.110640 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:25.182779 (+ 72139us) raft_consensus.cc:1685] finished
0709 12:58:25.182798 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:25.196137 (+ 13339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31007,"raft.queue_time_us":99834,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7139,"spinlock_wait_cycles":16853248,"thread_start_us":147035,"threads_started":2,"wal-append.queue_time_us":77555}
I20260709 12:58:25.282109  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:25.282306  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.285729  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:25.286435  1716 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:58:25.285218  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 63956.7us
I20260709 12:58:25.289042  1640 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:25.289521  1647 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:25.287870  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:25.290526  1712 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
W20260709 12:58:25.290800  5082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.017s	sys 0.025s
W20260709 12:58:25.291347  5082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.017s	sys 0.025s
I20260709 12:58:25.291503  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:25.293459  1712 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:25.294937  1712 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:25.296428  1684 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:25.163575  5087 consensus_queue.cc:237] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.288585  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:25.274526  5037 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:25.311966  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 151528us
I20260709 12:58:25.312885  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:25.320194  1719 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:25.182682  5040 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.289180  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:25.309653  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:25.330394  5145 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.332638  5145 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:25.343669  5149 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 12:58:25.344496  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.225008  5074 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.310288  5146 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:58:25.365976  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 225430us
I20260709 12:58:25.366772  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:25.368551  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:25.369762  1716 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:25.299367  5135 consensus_queue.cc:1059] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:58:25.364809  4880 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.375258  4880 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.382496  1686 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:25.377801  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:25.399566  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:25.405090  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:25.381101  5039 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:25.411379  4880 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:25.414270  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 429) took 1435 ms. Trace:
I20260709 12:58:25.421868  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:25.414798  1715 rpcz_store.cc:276] 0709 12:58:23.978845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.978967 (+   122us) service_pool.cc:224] Handling call
0709 12:58:24.013080 (+ 34113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:24.013298 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:24.132055 (+118757us) log.cc:844] Serialized 14 byte log entry
0709 12:58:24.377266 (+245211us) log.cc:844] Serialized 14 byte log entry
0709 12:58:24.780586 (+403320us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b1800488860. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:25.409207 (+628621us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b1800488860. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:25.413364 (+  4157us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b1800488860. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a3f649a40 00007f6a3f6444e4 00007f6a3f644455 00007f6a4612c3c7 00007f6a4273e9a7 00007f6a4274e0bf 00007f6a4274e038
0709 12:58:25.413626 (+   262us) log.cc:844] Serialized 14 byte log entry
0709 12:58:25.413835 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:25.413899 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:25.413963 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.414054 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:25.414198 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1031874,"prepare.queue_time_us":1068991,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":104,"raft.queue_time_us":9967,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":293,"spinlock_wait_cycles":153320192,"thread_start_us":345700,"threads_started":2,"wal-append.queue_time_us":338602}
I20260709 12:58:25.381819  5146 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:25.445396  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44721.8us
I20260709 12:58:25.392099  5141 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:25.385681  5081 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:25.447490  5089 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.228s	user 0.004s	sys 0.000s
I20260709 12:58:25.429908  5039 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:25.697656  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1700) took 1284 ms. Trace:
I20260709 12:58:25.546325  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 462) took 1122 ms. Trace:
I20260709 12:58:25.729758  1643 rpcz_store.cc:276] 0709 12:58:24.413393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.465907 (+ 52514us) service_pool.cc:224] Handling call
0709 12:58:25.697369 (+1231462us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540020a3d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:25.697574 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455387008}
W20260709 12:58:25.474682  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:25.475447  1612 leader_election.cc:336] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.556s (SENT)
I20260709 12:58:25.733577  1612 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:25.550724  1644 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:25.728479  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:25.730284  1639 rpcz_store.cc:276] 0709 12:58:24.423405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.595225 (+171820us) service_pool.cc:224] Handling call
0709 12:58:24.598047 (+  2822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:24.598218 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:24.747340 (+149122us) log.cc:844] Serialized 14 byte log entry
0709 12:58:25.545837 (+798497us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b18003bdc40. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287
0709 12:58:25.545945 (+   108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:25.545999 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:25.546049 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.546134 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:25.546262 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7426,"prepare.queue_time_us":143233,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":35044,"raft.run_wall_time_us":17537,"spinlock_wait_cycles":20284032,"thread_start_us":235286,"threads_started":3,"wal-append.queue_time_us":65956}
I20260709 12:58:25.630106  5066 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:25.537406  5159 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:25.558665  5033 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:25.640569  5155 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 12:58:25.544463  5163 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:58:25.424369  5109 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.551972  5129 raft_consensus.cc:3055] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:58:25.751598  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 276177us
I20260709 12:58:25.776141  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1703) took 1141 ms. Trace:
I20260709 12:58:25.549221  5092 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:25.620038  4724 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:25.537333  5165 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:25.548890  4979 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:25.542949  5142 raft_consensus.cc:3055] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:25.686336  5040 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:25.782044  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.782802  5096 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:25.803665  1644 rpcz_store.cc:276] 0709 12:58:24.634295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.892832 (+258537us) service_pool.cc:224] Handling call
0709 12:58:24.893097 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:25.550546 (+657449us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b540043e7a0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426abdc0 00007f6a427361c0 00007f6a42737231 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c
0709 12:58:25.734296 (+183750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.737163 (+  2867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41018240}
I20260709 12:58:25.771389  5133 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:25.785959  5141 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:25.807252  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.787925  5146 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.734967  5082 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.796358  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:25.814371  2343 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:25.803969  5129 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:25.804659  4724 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.807614  5142 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:25.821295  5142 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:25.822082  4724 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:25.819281  5165 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:25.822731  5142 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:25.829468  2343 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:25.833784  1610 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:25.834805  5141 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:25.835664  5141 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:25.837558  5141 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:25.803695  5109 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:25.842784  5109 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:25.843509  1612 leader_election.cc:336] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.582s (SENT)
I20260709 12:58:25.863147  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:25.832917  5165 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:25.733857  5039 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:25.588230  4812 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:25.699770  5053 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:25.733042  5074 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:25.764290  5160 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 12:58:25.790066  5137 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.003s
I20260709 12:58:25.847201  5033 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:25.453100  5110 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:25.799629  5159 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:26.093950  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 250447us
I20260709 12:58:25.814589  5082 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.096627  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 422) took 2192 ms. Trace:
I20260709 12:58:25.950006  5039 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:26.128942  1720 rpcz_store.cc:276] 0709 12:58:23.903992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.904100 (+   108us) service_pool.cc:224] Handling call
0709 12:58:23.911413 (+  7313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:23.931439 (+ 20026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:23.931485 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:23.972435 (+ 40950us) log.cc:844] Serialized 26 byte log entry
0709 12:58:24.106640 (+134205us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:24.106689 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.106762 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:25.446687 (+1339925us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:26.051364 (+604677us) raft_consensus.cc:1685] finished
0709 12:58:26.051394 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.096548 (+ 45154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6445,"raft.queue_time_us":40863,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":17634,"spinlock_wait_cycles":49007360,"thread_start_us":101674,"threads_started":1,"wal-append.queue_time_us":214464}
I20260709 12:58:26.091682  4880 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:26.173614  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 445215us
W20260709 12:58:26.131081  5183 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:58:26.091168  5159 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:26.174981  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:26.007009  5109 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.168553  5144 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.051020  5137 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:26.006186  5129 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.180614  5087 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:26.202497  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:26.204243  1686 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:26.205348  1686 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:26.206683  4724 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:58:26.205325  5088 log.cc:927] Time spent T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.850s	user 0.002s	sys 0.002s
W20260709 12:58:26.212322  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.206692  4812 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:26.211349  5099 log.cc:927] Time spent T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.674s	user 0.004s	sys 0.000s
I20260709 12:58:26.143188  5053 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:26.216445  5169 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 12:58:26.209596  5057 consensus_meta.cc:287] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.034s	user 0.008s	sys 0.005s
I20260709 12:58:26.212625  5129 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:26.193451  5144 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.221870  5087 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:26.219550  5033 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:26.233227  5165 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:26.233969  5110 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:26.236295  5053 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:26.242154  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.187152  5109 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.238188  5057 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:26.248788  5102 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 1.778s	user 0.002s	sys 0.002s
I20260709 12:58:26.250869  2349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 465) took 3011 ms. Trace:
I20260709 12:58:26.242944  5087 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:26.255039  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.255558  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:26.257509  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 162120us
I20260709 12:58:26.251189  2349 rpcz_store.cc:276] 0709 12:58:23.239150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.239262 (+   112us) service_pool.cc:224] Handling call
0709 12:58:23.248045 (+  8783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:23.256218 (+  8173us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:23.256260 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:24.214594 (+958334us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b2c00021e98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4102da11 00007f6a4103d372 00007f6a4276fa01 00007f6a4273443a 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2
0709 12:58:24.215017 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:58:24.345176 (+130159us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:24.345231 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.345322 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.248042 (+1902720us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:26.250644 (+  2602us) raft_consensus.cc:1685] finished
0709 12:58:26.250667 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.250819 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78795,"raft.queue_time_us":3865,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3989,"spinlock_wait_cycles":173991680,"thread_start_us":111794,"threads_started":1,"wal-append.queue_time_us":175389}
I20260709 12:58:26.259929  4979 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:26.260598  5101 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.857s	user 0.003s	sys 0.000s
I20260709 12:58:26.260526  4979 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:26.261577  5138 raft_consensus.cc:2764] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:26.262032  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1688) took 2147 ms. Trace:
I20260709 12:58:26.263036  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 432) took 1474 ms. Trace:
W20260709 12:58:26.263883  5081 consensus_meta.cc:287] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.002s
I20260709 12:58:26.264386  5081 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:26.263399  1713 rpcz_store.cc:276] 0709 12:58:24.788316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.788470 (+   154us) service_pool.cc:224] Handling call
0709 12:58:24.798360 (+  9890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:24.798774 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:25.415351 (+616577us) log.cc:844] Serialized 14 byte log entry
0709 12:58:25.864546 (+449195us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:25.947624 (+ 83078us) log.cc:844] Serialized 26 byte log entry
0709 12:58:25.947838 (+   214us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:25.947904 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.948003 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.262813 (+314810us) raft_consensus.cc:1685] finished
0709 12:58:26.262831 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.262952 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":623374,"prepare.queue_time_us":617679,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":5804,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":17291,"thread_start_us":448643,"threads_started":2,"wal-append.queue_time_us":375826}
I20260709 12:58:26.266160  4979 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:26.268214  4946 raft_consensus.cc:3055] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:26.268775  4946 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:26.269896  4946 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:26.271189  4946 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:26.259274  5037 consensus_meta.cc:287] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.908s	user 0.008s	sys 0.003s
I20260709 12:58:26.273057  5037 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.275177  5037 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:26.276894  5144 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:26.262394  1714 rpcz_store.cc:276] 0709 12:58:24.115109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.115223 (+   114us) service_pool.cc:224] Handling call
0709 12:58:24.115571 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:24.115929 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:24.115955 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:24.116454 (+   499us) log.cc:844] Serialized 52 byte log entry
0709 12:58:24.403090 (+286636us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:25.414167 (+1011077us) log.cc:844] Serialized 14 byte log entry
0709 12:58:25.414358 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.414431 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.251842 (+837411us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:26.261723 (+  9881us) raft_consensus.cc:1685] finished
0709 12:58:26.261830 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.261969 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1010772,"prepare.queue_time_us":1011336,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":2250,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4296,"spinlock_wait_cycles":375515392,"thread_start_us":249335,"threads_started":1,"wal-append.queue_time_us":274880}
I20260709 12:58:26.289448  5137 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:26.298429  5151 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.927s	user 0.004s	sys 0.006s
I20260709 12:58:26.301383  5087 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:26.306679  5170 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 12:58:26.311832  2348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 467) took 2185 ms (client timeout 1918 ms). Trace:
I20260709 12:58:26.314570  1717 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:26.317910  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1707) took 1031 ms. Trace:
W20260709 12:58:26.312348  2348 rpcz_store.cc:269] 0709 12:58:24.126060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.126214 (+   154us) service_pool.cc:224] Handling call
0709 12:58:26.311509 (+2185295us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54004cac54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:26.311704 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181744896}
I20260709 12:58:26.318248  1717 rpcz_store.cc:276] 0709 12:58:25.286370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.288287 (+  1917us) service_pool.cc:224] Handling call
0709 12:58:26.317758 (+1029471us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001063d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:26.317859 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301989760}
I20260709 12:58:26.312631  5159 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.347663  5082 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:26.346547  5109 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:26.361673  5159 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:26.353937  5039 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:26.363859  5107 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 1.847s	user 0.013s	sys 0.008s
I20260709 12:58:26.364754  4880 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:26.365494  5039 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:26.385614  5025 raft_consensus.cc:3055] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:26.386116  5025 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:26.387024  5025 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.388057  5025 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:26.413259  5103 log.cc:927] Time spent T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 1.879s	user 0.011s	sys 0.008s
W20260709 12:58:26.439047  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:26.447192  5187 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 12:58:26.480588  5057 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.481186  5057 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.483158  5057 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:26.651584  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.755571  5135 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.756259  5135 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.758749  5135 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:26.761797  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 506349us
W20260709 12:58:26.765810  1612 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.803s (SENT)
I20260709 12:58:26.820864  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:26.831987  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.849726  5141 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:26.856688  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 90878.1us
I20260709 12:58:26.857417  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.858265  1714 raft_consensus.cc:2410] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:58:26.860105  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.860806  1714 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:26.856083  5066 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:26.862219  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.864225  1721 raft_consensus.cc:2410] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:58:26.864292  5157 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:26.865177  5157 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.868088  5157 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:26.870914  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.862928  5066 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:26.875216  1721 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:26.875391  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.876111  1715 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:26.876820  1714 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:26.879751  1714 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:26.880517  1721 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:26.880620  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.882041  1718 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:26.883440  1716 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:26.883678  1718 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:26.887121  1715 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:26.893013  5066 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:26.893761  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.894582  1715 raft_consensus.cc:2410] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:58:26.887905  5126 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:26.895609  5126 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:26.902568  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.903321  1716 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:26.908515  1721 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:26.912978  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.916990  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.917820  1712 raft_consensus.cc:2410] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:26.918546  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.919301  1712 raft_consensus.cc:2410] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:58:26.919981  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.920691  1721 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:26.921051  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.921646  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.922026  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.922185  1721 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:26.923092  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.923784  1721 raft_consensus.cc:2410] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 12:58:26.923810  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 1.50188e+06us
I20260709 12:58:26.925467  1716 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:26.926925  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.927917  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.928897  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.929472  1716 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:26.930222  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:26.931244  1716 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:26.924597  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.933704  5158 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:26.934074  5175 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.734s	user 0.000s	sys 0.005s
I20260709 12:58:26.923098  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.935007  1712 raft_consensus.cc:2393] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:26.935838  1714 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
W20260709 12:58:26.938004  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 80208.6us
I20260709 12:58:26.942116  5158 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:26.934067  5126 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:26.943178  5156 raft_consensus.cc:3055] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:26.943639  5156 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:26.943970  5092 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:26.935839  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.944473  5156 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:26.945191  5141 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:26.945645  5156 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:26.945703  5141 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.947353  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1821) took 2472 ms. Trace:
I20260709 12:58:26.944475  5092 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:26.947835  5141 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:26.947781  1640 rpcz_store.cc:276] 0709 12:58:24.474818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.863624 (+388806us) service_pool.cc:224] Handling call
0709 12:58:24.882129 (+ 18505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:25.289434 (+407305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.947076 (+1657642us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54000f82d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:26.947293 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935397120}
I20260709 12:58:26.949394  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:26.951009  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:26.952117  1612 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.542s (SENT)
I20260709 12:58:26.952548  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:26.953186  5126 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:26.953224  5141 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:26.954792  1612 leader_election.cc:336] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.646s (SENT)
I20260709 12:58:26.955178  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:26.955703  5167 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.737s	user 0.008s	sys 0.002s
I20260709 12:58:26.960813  5141 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:26.961827  1612 leader_election.cc:336] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.649s (SENT)
W20260709 12:58:26.965576  1612 leader_election.cc:336] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.754s (SENT)
W20260709 12:58:26.966320  1612 leader_election.cc:336] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.911s (SENT)
I20260709 12:58:26.966670  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:26.968324  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:26.968497  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1695) took 2604 ms. Trace:
I20260709 12:58:26.969079  1715 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:26.969017  1646 rpcz_store.cc:276] 0709 12:58:24.364070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.406041 (+ 41971us) service_pool.cc:224] Handling call
0709 12:58:24.406373 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:24.406729 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:24.406759 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:24.407248 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:58:24.462512 (+ 55264us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:24.462570 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.462654 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.356615 (+1893961us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:26.968180 (+611565us) raft_consensus.cc:1685] finished
0709 12:58:26.968201 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.968428 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15176,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8770,"spinlock_wait_cycles":115534720,"thread_start_us":54781,"threads_started":1,"wal-append.queue_time_us":83034}
I20260709 12:58:26.972110  5141 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:26.973188  1612 leader_election.cc:336] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.942s (SENT)
I20260709 12:58:26.973598  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:26.975299  5141 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:26.976420  1612 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.962s (SENT)
I20260709 12:58:26.976853  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:26.977597  5141 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:26.979017  5141 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:26.979723  5141 consensus_queue.cc:1243] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:26.949451  5092 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:26.980096  5126 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:26.980501  5126 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:26.981514  5092 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:26.981344  5126 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:26.981732  5141 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:26.983052  4880 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:26.983464  4880 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:26.983589  5126 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:26.981361  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 45144.3us
I20260709 12:58:26.985319  1535 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:26.986820  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:26.984275  4880 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:26.988723  5136 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:26.988729  5031 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:26.989229  4880 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:26.989324  5136 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:26.990315  5136 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:26.991154  5092 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:26.988143  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:26.997113  5116 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:26.997622  5116 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:26.998411  5116 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.001026  1535 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:27.011519  5032 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:27.012800  5032 raft_consensus.cc:697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:27.018201  1535 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:27.020581  5035 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:27.020637  5032 consensus_queue.cc:237] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.015722  5116 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:58:27.027961  5196 consensus_queue.cc:1059] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:27.033034  5116 consensus_queue.cc:1243] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:58:27.034096  5198 raft_consensus.cc:3055] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:27.034646  5198 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:27.035634  5198 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.027204  5092 consensus_queue.cc:1059] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:58:27.040491  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:27.037458  5201 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.060734  4904 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.061532  4904 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.065155  4904 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:27.073346  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 55259.9us
I20260709 12:58:27.073601  5204 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:27.076231  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:27.079864  5204 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:27.079741  1535 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:27.082293  5136 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.083391  1535 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:27.075666  5092 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:27.084254  5092 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.085162  5092 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.092163  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.078629  5202 raft_consensus.cc:3055] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:27.095120  5202 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:27.096958  5136 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:27.097959  5202 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:27.104009  2347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 466) took 3232 ms (client timeout 1876 ms). Trace:
W20260709 12:58:27.112775  2347 rpcz_store.cc:269] 0709 12:58:23.871621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.871753 (+   132us) service_pool.cc:224] Handling call
0709 12:58:27.103330 (+3231577us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54004ba0d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:27.103914 (+   584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366707072}
I20260709 12:58:27.113425  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:27.113870  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:27.104873  2344 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:27.102005  5202 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.117990  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.112383  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.119587  1639 raft_consensus.cc:2410] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:27.105880  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:27.072734  5201 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.106607  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.120870  1642 raft_consensus.cc:2410] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:58:27.107312  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:27.122942  5206 consensus_queue.cc:1059] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:58:27.107407  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.123816  5204 raft_consensus.cc:3055] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:27.124115  1644 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:27.111457  5203 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.111573  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:27.109711  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:27.105063  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.125483  5201 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.124233  5204 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:27.127301  5204 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:27.117631  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.125926  5203 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.129141  1638 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:27.129734  5203 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.130187  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:27.130618  5201 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.130725  1638 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:27.133265  1643 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:27.134531  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:27.135203  1643 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.136808  5201 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.137212  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:27.137946  1639 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:27.138744  5201 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.139253  5201 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:27.139684  5201 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.125913  1646 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:27.141215  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:27.142004  1646 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:27.144289  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:27.145370  1642 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:27.146986  1644 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:58:27.148273  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.149041  5035 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.149091  1644 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:27.149732  5035 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.150547  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:27.151345  1644 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.152062  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.152501  5203 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:27.152706  1572 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:27.153071  5203 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.153496  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.154047  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.154299  1565 raft_consensus.cc:2393] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 4: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:27.154795  1570 raft_consensus.cc:2410] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:27.165649  5201 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.166200  5201 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:27.166666  5201 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.169363  5203 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.170840  1638 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:27.172930  1638 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
W20260709 12:58:27.175905  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.176756  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.177028  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.177100  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.178143  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.178871  1568 raft_consensus.cc:2410] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:27.178805  1572 raft_consensus.cc:2376] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8. Re-sending same reply.
I20260709 12:58:27.179822  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.180578  1567 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:27.181588  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.182062  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.182796  1565 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:27.183606  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.183761  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:27.184237  1642 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.184612  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.185451  1571 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:58:27.186820  1571 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:27.187482  1564 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.189471  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.190045  1571 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:27.190469  2341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 606) took 1797 ms. Trace:
I20260709 12:58:27.191133  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.192097  1571 raft_consensus.cc:2410] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:27.190824  2341 rpcz_store.cc:276] 0709 12:58:25.393538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.394101 (+   563us) service_pool.cc:224] Handling call
0709 12:58:25.394457 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:25.394801 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.394834 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:25.395296 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:58:25.535883 (+140587us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:25.540169 (+  4286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.548715 (+  8546us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.955159 (+1406444us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:27.190181 (+235022us) raft_consensus.cc:1685] finished
0709 12:58:27.190202 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.190405 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":2521344,"thread_start_us":89036,"threads_started":1,"wal-append.queue_time_us":822945}
I20260709 12:58:27.193374  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.194121  1571 raft_consensus.cc:2410] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:27.189720  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.196239  1720 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:27.196604  1571 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:27.207832  2341 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:58:27.181612  5035 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:27.220893  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.221493  1563 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:27.221576  1565 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:27.223428  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.224365  1563 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:27.231012  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.231782  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:27.232363  1718 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:27.232617  1719 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:27.233539  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:27.235258  1717 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:27.236678  1716 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:58:27.237713  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.238292  1712 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:27.239217  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.239400  1641 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:27.239789  1721 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:27.242132  2314 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:27.244865  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.245586  1567 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:27.244865  4808 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:27.246941  5087 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.247460  5087 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.249738  1718 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:27.195634  5201 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.250736  1568 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:27.251132  5087 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:27.251662  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.251895  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.252599  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.253815  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.254835  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.257542  1572 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:27.258739  1569 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:27.258638  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.259855  1566 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:27.260035  1712 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:27.260804  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.260308  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.261780  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.262145  1720 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:27.262356  1569 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:27.262545  1566 raft_consensus.cc:2410] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:27.263357  1721 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:27.264729  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.265287  1566 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.266661  1565 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:27.267987  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.272217  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.272965  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.274343  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.275312  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.275482  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.275874  1563 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:27.276105  1642 raft_consensus.cc:2410] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:27.276201  1719 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:27.277225  1639 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:27.283815  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.285172  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.285796  1563 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:27.285254  1646 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 4.
I20260709 12:58:27.290838  1567 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:27.287688  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.287379  1569 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:27.273512  1716 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:27.286721  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.287572  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.271878  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.292225  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.294143  1571 raft_consensus.cc:2368] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8.
I20260709 12:58:27.295213  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.296293  1572 raft_consensus.cc:2368] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9.
I20260709 12:58:27.296773  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:27.297097  1563 raft_consensus.cc:2410] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:27.286381  1643 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
W20260709 12:58:27.289492  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.298895  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:27.299099  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.299485  1721 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:27.300935  2349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:27.301651  2349 raft_consensus.cc:606] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:27.300964  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:27.302076  2349 raft_consensus.cc:614] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:27.305351  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.305929  1565 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:27.307889  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.308521  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.310506  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.311045  1720 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:27.312858  1563 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:27.316365  1566 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:27.320215  5208 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:27.323788  1565 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:27.326678  1566 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:58:27.338768  1566 pending_rounds.cc:85] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 3
I20260709 12:58:27.339066  1566 pending_rounds.cc:107] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:58:27.339327  1566 raft_consensus.cc:2889] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:27.333206  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.345237  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.346105  1642 raft_consensus.cc:2410] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:27.347064  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.347694  1639 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:27.348572  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.365290  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.366119  1712 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:27.349166  1641 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:27.368148  1720 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:27.335014  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.371268  1569 raft_consensus.cc:2393] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:27.371572  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:27.371793  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.371991  1563 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:27.372421  1646 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:27.372984  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.379048  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:27.389310  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:27.388772  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 310578us
I20260709 12:58:27.388074  1644 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:27.392421  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.392730  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.392359  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.393307  1644 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:27.393450  1566 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.391003  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:27.400970  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 97665.4us
I20260709 12:58:27.401919  1565 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: [5.4-8.5]
I20260709 12:58:27.403345  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.421764  1569 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:27.410411  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.436866  1563 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:27.436995  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:27.438148  1565 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.439905  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.424625  1647 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:27.422237  1535 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:27.400995  5196 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:27.452365  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:27.454185  1563 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:27.441891  5202 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:27.455163  5202 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:27.455588  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.455896  5202 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:27.456211  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.459401  5032 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:27.460135  1642 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:27.453958  5196 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.460494  5032 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:27.462247  1644 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:27.464391  1642 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:27.464967  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 1961) took 2895 ms. Trace:
I20260709 12:58:27.465378  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.465986  1642 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:27.465314  1564 rpcz_store.cc:276] 0709 12:58:24.569920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.570037 (+   117us) service_pool.cc:224] Handling call
0709 12:58:24.570295 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.187088 (+2616793us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b58007d75d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426900aa 00007f6a42712447 00007f6a4272afe7 00007f6a4272c7de 00007f6a42736b49 00007f6a42737416 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4
0709 12:58:27.215187 (+ 28099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:27.215217 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:27.215253 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:27.215290 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.464766 (+249476us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400093654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:27.464809 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.464915 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6743,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":1891609856}
I20260709 12:58:27.466743  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.467280  1642 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:27.462620  5196 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.405611  5035 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:27.469238  1567 raft_consensus.cc:3055] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:27.483006  1567 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:27.483012  5035 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.483701  5035 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:27.483963  1567 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.485136  1567 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.461428  5032 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:27.467284  1564 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:27.489696  1563 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:27.489784  1564 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:27.435902  5127 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:58:27.490914  1563 raft_consensus.cc:3055] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:27.491272  1563 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:27.423677  5207 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.474879  4808 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:27.475329  5203 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:27.492200  5203 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.492590  5203 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:27.493458  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.494256  1567 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:58:27.480778  5201 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.496196  5201 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.496742  5206 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:27.497195  5202 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.498185  5201 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.492053  1563 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.471889  1644 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:27.474665  1647 pending_rounds.cc:85] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:58:27.500620  1647 pending_rounds.cc:107] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:27.489351  5032 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.501011  1647 raft_consensus.cc:2889] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:27.501642  5208 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.501783  5032 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:27.452111  5214 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:27.502067  5207 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.502570  5214 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.468040  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.503028  5204 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:27.503659  1642 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:27.510468  1563 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.513229  5214 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.505724  5207 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:27.497305  5206 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.499728  5203 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.516930  5180 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.420142  1566 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
W20260709 12:58:27.475703  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53600.1us
I20260709 12:58:27.520866  5206 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:27.517482  5203 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.517480  5180 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.532984  5180 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:27.528779  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:27.534368  5180 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:27.534875  5180 raft_consensus.cc:697] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:27.535774  5180 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.536772  1572 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:27.537762  5035 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.539232  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.543256  1715 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:27.539655  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:27.544715  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:27.545575  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:27.546271  5158 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:27.546736  5158 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:27.547528  5158 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.514153  5202 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.541568  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:27.553587  1712 raft_consensus.cc:2410] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:58:27.560823  5201 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:27.561501  5201 raft_consensus.cc:697] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:27.562743  5035 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.563234  5116 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:27.563851  5116 raft_consensus.cc:697] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:27.564999  5116 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.569185  1565 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:27.502152  5208 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.562403  5201 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.572393  5208 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:27.579363  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:27.579773  5035 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:27.581323  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.581717  5035 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.583642  5035 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:27.581362  1713 raft_consensus.cc:2393] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
W20260709 12:58:27.600850  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 142695us
I20260709 12:58:27.602530  1563 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:58:27.636261  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.584214  5126 raft_consensus.cc:3055] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:27.663080  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:27.653676  2312 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:27.663797  5135 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:58:27.663682  4904 consensus_queue.cc:1059] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:58:27.672668  4904 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:27.663545  5105 consensus_queue.cc:1059] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:58:27.673074  4904 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:27.093676  5156 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:27.674082  5113 raft_consensus.cc:3055] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:27.674515  5113 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:27.674723  1568 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:27.675350  5113 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.676321  5113 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:27.651504  5126 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:27.689148  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:27.693403  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 290860us
I20260709 12:58:27.700145  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:27.705307  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:27.705983  1645 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.707782  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.708874  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.709764  1641 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:27.710772  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.711330  1642 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:27.712353  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.719125  1642 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:27.720675  1684 connection.cc:256] RPC call timeout handler was delayed by -2.1426331320000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 12:58:27.722119  1641 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:27.723384  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.724964  1642 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
W20260709 12:58:27.725930  1684 connection.cc:256] RPC call timeout handler was delayed by -1.8528166379999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 12:58:27.695348  5105 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:27.751618  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:27.752667  1643 raft_consensus.cc:2393] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:27.697597  5135 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:27.762274  1644 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:27.763900  1645 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
W20260709 12:58:27.773903  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 382894us
I20260709 12:58:27.756085  5105 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.787787  5105 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.787600  5224 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:27.790560  5113 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:58:27.778638  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 81984.3us
I20260709 12:58:27.674171  4904 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:27.754560  5135 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.730391  5087 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.796687  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:27.962813  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.909245  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:27.883999  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:27.964797  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.908758  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:27.915894  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:27.965015  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 84867.9us
I20260709 12:58:27.812808  5135 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:27.999821  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 299707us
I20260709 12:58:27.761617  5126 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:27.879958  5222 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:27.884588  4904 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:28.025728  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.009764  5222 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.019600  5223 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:58:28.045106  5222 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:28.049851  5218 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 12:58:28.062484  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.072206  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:28.078145  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.883949  5087 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.080586  1612 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:28.087167  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 326707us
I20260709 12:58:28.110687  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:28.101315  2370 debug-util.cc:398] Leaking SignalData structure 0x7b08002e59e0 after lost signal to thread 434
W20260709 12:58:28.115585  2370 debug-util.cc:398] Leaking SignalData structure 0x7b08002e53c0 after lost signal to thread 1504
I20260709 12:58:28.125677  5198 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.079309  5223 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:28.074739  5126 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:28.139698  2370 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5e00 after lost signal to thread 1596
W20260709 12:58:28.155797  2370 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5de0 after lost signal to thread 1597
W20260709 12:58:28.157629  2370 debug-util.cc:398] Leaking SignalData structure 0x7b0800326a40 after lost signal to thread 1671
I20260709 12:58:28.137570  5219 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:28.173684  5235 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.185878  2370 debug-util.cc:398] Leaking SignalData structure 0x7b0800060740 after lost signal to thread 1745
W20260709 12:58:28.187202  5226 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:58:28.184170  5219 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:28.187774  5238 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.182180  5234 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:28.188740  2370 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3c20 after lost signal to thread 1746
W20260709 12:58:28.201278  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 138425us
W20260709 12:58:28.206964  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 762705us
I20260709 12:58:28.207701  1537 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:28.208469  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:28.210115  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.187678  5225 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:28.166898  5222 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:28.189100  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 93806.8us
W20260709 12:58:28.210696  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.203161  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 90624.5us
I20260709 12:58:28.202487  5135 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.217417  5135 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:28.217964  5135 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:28.220407  4808 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:28.220954  4808 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:28.221223  5066 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.221745  5066 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.223752  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:28.224352  1647 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:28.224189  5219 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.226234  5145 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:28.226635  5145 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:28.226969  5145 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:28.201352  5231 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.206643  5238 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:28.233445  2370 debug-util.cc:398] Leaking SignalData structure 0x7b080036f2a0 after lost signal to thread 2373
I20260709 12:58:28.230914  4880 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:28.143591  5224 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
W20260709 12:58:28.258061  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 50427.8us
I20260709 12:58:28.259716  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:28.220965  5135 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:28.196621  5235 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.263733  1647 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:28.265390  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:28.223735  5066 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:28.234015  5237 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.247448  4880 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:28.221050  5232 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:58:28.268635  1537 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:28.275411  1644 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:28.268316  5135 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.213222  5234 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:28.370121  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 101544us
I20260709 12:58:28.371148  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:28.373220  1537 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:28.377274  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 164189us
I20260709 12:58:28.378223  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:28.273865  5035 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:28.380959  5035 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.381340  5035 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:28.385294  5236 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:58:28.389843  5238 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:28.391340  5087 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:28.394295  5105 consensus_meta.cc:287] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.005s
I20260709 12:58:28.394769  5105 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.397078  4880 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.398222  5244 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:58:28.398779  5228 log.cc:927] Time spent T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 12:58:28.398970  5244 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.278585  5237 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.401767  5244 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:28.402429  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.402743  5237 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:28.249840  5231 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:28.410322  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.414317  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.430469  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52351.5us
W20260709 12:58:28.441900  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.445042  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:28.445883  1644 raft_consensus.cc:2410] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:28.446422  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:28.447090  1643 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:28.449034  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:28.450038  1639 raft_consensus.cc:2410] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:28.451097  1638 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:58:28.452306  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:28.398181  4880 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:28.277513  4904 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:28.461550  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:28.368597  5135 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:28.465410  1647 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:28.465768  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:28.468122  1569 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:28.470628  5105 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:28.473325  5092 consensus_meta.cc:287] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.388s	user 0.010s	sys 0.005s
I20260709 12:58:28.473760  5092 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.474838  1640 raft_consensus.cc:2368] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10.
I20260709 12:58:28.475809  5092 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.477526  5222 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.477777  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:28.443284  5241 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:28.478454  5241 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.478929  5241 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.351866  5066 consensus_queue.cc:1059] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 12:58:28.486192  5234 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:28.416783  5245 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:28.487574  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 114437us
W20260709 12:58:28.488034  1640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1706) took 1385 ms (client timeout 1647 ms). Trace:
W20260709 12:58:28.488480  1640 rpcz_store.cc:269] 0709 12:58:27.102947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.105588 (+  2641us) service_pool.cc:224] Handling call
0709 12:58:28.487849 (+1382261us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002661d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:28.487975 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3114680064}
I20260709 12:58:28.491060  1643 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:28.458019  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:28.497774  1646 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:28.455274  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 240662us
I20260709 12:58:28.462500  5233 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.496313  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 199545us
I20260709 12:58:28.505287  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:28.467270  4904 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:28.513549  1646 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:28.514505  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:28.514838  1569 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:28.517987  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:28.522428  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:28.527496  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 295594us
I20260709 12:58:28.511741  5232 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.528424  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.503723  5255 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:28.529511  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.540334  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:28.540975  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.534935  1714 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:28.543905  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:28.544662  1714 raft_consensus.cc:2368] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:28.545779  1714 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:28.480561  4808 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.511641  5245 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:28.510124  5032 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.551820  5032 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.536859  2345 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:28.553006  4808 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.555058  5032 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:28.555882  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.556277  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:28.555907  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:28.558635  1647 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:28.567513  1640 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:28.546145  1684 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:28.573315  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:28.573058  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:28.573141  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:28.574903  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:28.576488  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:28.519649  5234 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:28.579530  1720 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:28.578270  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:28.555366  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:28.513970  5035 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.573925  1717 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:28.548748  5232 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.578280  5087 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:58:28.583236  5256 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:28.589562  5256 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.589910  5145 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.590550  5240 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:28.591008  5240 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.591405  5240 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:28.591674  5256 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:28.591902  5145 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.519388  5252 consensus_queue.cc:1059] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:58:28.583415  5246 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:58:28.593503  5248 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:58:28.578440  5157 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:28.594635  2341 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
W20260709 12:58:28.581492  1612 connection.cc:256] RPC call timeout handler was delayed by -1.5393986939999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:58:28.601012  1612 connection.cc:256] RPC call timeout handler was delayed by -1.5188555039999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.233s for a response
W20260709 12:58:28.601645  1612 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.026s (SENT)
W20260709 12:58:28.602592  1612 leader_election.cc:336] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.081s (SENT)
I20260709 12:58:28.603049  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:28.585028  1647 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:28.511216  5233 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.589006  5232 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:28.604617  5254 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:58:28.623678  1612 leader_election.cc:336] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.102s (SENT)
I20260709 12:58:28.615885  5256 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:28.578361  5237 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:58:28.628756  5113 raft_consensus.cc:3055] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:28.634408  2343 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:58:28.638757  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.696813  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:28.643251  2346 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:28.646718  5231 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:28.648167  5035 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.592366  5241 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.614324  5242 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:28.648943  5240 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.650206  5233 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.606663  4904 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.585733  5234 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.651844  5244 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:28.718662  5244 consensus_queue.cc:1243] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:58:28.657894  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.719548  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.720122  5237 raft_consensus.cc:3055] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:28.720521  5237 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:28.721585  5237 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:28.727317  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.730600  5235 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:28.734616  5234 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:28.735291  5234 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:28.738547  5241 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.742384  5231 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:28.743113  5231 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.746276  5225 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.746932  5225 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.661823  1640 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:28.663748  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:28.750375  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 126729us
I20260709 12:58:28.698308  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:28.698459  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:28.699105  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:28.699728  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:28.700372  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:28.701614  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:28.753587  1567 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:28.702922  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:28.756299  1570 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:28.703574  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:28.693922  4880 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:28.708902  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 141810us
I20260709 12:58:28.707137  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:28.704111  1464 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:28.757306  1568 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:28.713557  5256 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.716501  5238 raft_consensus.cc:3055] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:28.717389  5157 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:28.697698  1563 raft_consensus.cc:2368] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:28.694092  5113 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:28.753122  1566 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:28.763319  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:28.763842  1720 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:28.757576  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50506.7us
I20260709 12:58:28.735922  5234 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.765390  1567 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:28.765985  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:28.765990  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:28.767066  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 270787us
I20260709 12:58:28.767268  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:28.772521  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:28.759393  5238 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:28.759307  5035 raft_consensus.cc:2764] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:58:28.766382  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 278112us
I20260709 12:58:28.760171  4880 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.708784  5015 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:58:28.760947  5157 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:28.707029  5242 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.760526  5256 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.774307  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:28.775694  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 313058us
I20260709 12:58:28.773079  5116 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:28.881770  5116 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:28.882220  5116 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:28.883466  1645 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:28.819587  5258 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.266s	user 0.000s	sys 0.003s
W20260709 12:58:28.860607  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 109628us
I20260709 12:58:28.799450  5219 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:28.887701  5233 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.888237  5233 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.888809  5263 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:28.889251  5263 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:28.889750  5263 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:28.890357  5233 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:28.891165  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:28.892792  1612 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.146s (SENT)
I20260709 12:58:28.893286  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:28.894078  5269 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:28.894105  4880 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.778064  5201 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:28.895350  1612 leader_election.cc:336] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.189s (SENT)
I20260709 12:58:28.895568  5201 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:28.896201  1612 leader_election.cc:336] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.201s (SENT)
I20260709 12:58:28.889292  5256 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.896788  5201 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.897774  5262 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:28.898332  5262 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:28.770309  5158 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:28.898902  5158 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:28.899422  5158 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:28.899133  5262 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.900251  5240 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:28.902639  5231 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:28.876505  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 105461us
I20260709 12:58:28.878664  5225 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.904978  5135 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.896631  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:28.886580  1640 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:58:28.872918  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 106982us
W20260709 12:58:28.870224  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 264889us
I20260709 12:58:28.915688  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:28.918038  1684 leader_election.cc:400] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9.
I20260709 12:58:28.958330  1684 leader_election.cc:403] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:58:28.885272  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 111044us
I20260709 12:58:28.934000  5263 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.937309  5157 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:28.786494  5126 consensus_meta.cc:287] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.002s
I20260709 12:58:28.939443  1464 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 4 to 2, term changed from 5 to 3, leader changed from <none> to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193), VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194), VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195), VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 3 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:28.942173  5249 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:28.942745  1720 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:28.947086  5180 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.940130  5242 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.949656  2312 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:28.950412  5066 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:28.861789  5235 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:28.803360  5113 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.952826  5116 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:28.953518  5234 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:28.955396  5135 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:28.957199  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:28.960083  1537 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:28.964380  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:28.923238  5231 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:28.984020  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:28.984656  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:28.970551  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:28.985241  1639 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
W20260709 12:58:28.971486  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 75305.4us
W20260709 12:58:28.996132  1612 leader_election.cc:336] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.225s (SENT)
I20260709 12:58:28.998801  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:28.999017  1612 leader_election.cc:336] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 2.229s (SENT)
I20260709 12:58:28.982286  5235 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.000373  1464 catalog_manager.cc:5697] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.001864  5235 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:29.002497  5203 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:29.003110  5234 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:29.003667  5234 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.005604  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:29.006722  5245 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:29.007077  5245 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:29.007444  5245 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:29.007508  1537 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:28.966377  5244 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9.
I20260709 12:58:28.982141  1647 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:58:28.983341  1645 raft_consensus.cc:2410] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:28.969861  5223 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:29.011709  5243 raft_consensus.cc:3055] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:28.969044  1535 leader_election.cc:400] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10.
I20260709 12:58:28.986210  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.012166  5243 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:28.986922  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.013276  1638 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 4.
I20260709 12:58:29.013123  5243 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.014371  5243 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:28.974133  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:28.990630  5237 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:28.976838  5251 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:58:28.991822  5116 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:29.019060  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58424 (request call id 231) took 27807 ms (client timeout 15000 ms). Trace:
I20260709 12:58:29.015661  1535 leader_election.cc:403] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:58:28.969050  5136 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:58:28.968003  5035 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:58:28.983261  5105 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:58:29.026363  5203 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:29.028033  5105 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.975925  5180 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.030375  5180 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:28.993578  5240 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:28.994009  5231 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:28.976735  5261 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:29.032780  5113 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:29.033253  5261 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:29.033481  5231 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.034147  5261 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:28.999909  5263 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:29.005965  5234 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:29.020404  5156 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:28.974180  5066 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:28.994427  5157 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:29.038002  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.041880  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:28.999742  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:28.970762  1610 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:29.046988  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 90617.2us
I20260709 12:58:29.003603  1464 catalog_manager.cc:5697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 1 to 3, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 3 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.070096  5145 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10.
I20260709 12:58:29.049711  5240 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:29.067864  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.118012  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:29.119127  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.119680  1712 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:29.045778  4808 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:29.095857  1640 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:29.045872  5156 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:28.817029  5238 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.121452  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.122076  1719 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:29.122298  2343 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:29.122887  2343 raft_consensus.cc:606] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:29.121806  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:29.123294  2343 raft_consensus.cc:614] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:29.123692  1713 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:29.096781  1644 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:29.124445  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:29.028604  5105 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.097859  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.098706  5157 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:29.129418  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.099592  5223 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:29.135365  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:29.136061  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.106866  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.136837  1715 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.107517  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.137554  1572 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:29.108173  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.108479  1537 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:29.138481  1571 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:29.139515  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.104592  1567 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:29.140197  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:29.102286  5280 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.065s	user 0.000s	sys 0.006s
I20260709 12:58:29.141471  1537 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:29.111451  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:29.101838  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 131325us
I20260709 12:58:29.143172  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:29.145004  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:29.149602  2346 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:29.152586  2345 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:29.115787  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.153985  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:29.126171  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:29.155562  2342 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
W20260709 12:58:29.126497  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.155691  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:29.132931  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:29.099064  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 129756us
I20260709 12:58:29.160279  1535 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:29.134337  1719 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:29.133994  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:29.102766  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 103763us
I20260709 12:58:29.099097  5255 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:29.129985  1647 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
W20260709 12:58:29.170729  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:29.019624  1469 rpcz_store.cc:269] 0709 12:58:01.211564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.220222 (+  8658us) service_pool.cc:224] Handling call
0709 12:58:29.018765 (+27798543us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:18.815708 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:19.226978 (+411270us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:19.237651 (+ 10673us) write_op.cc:435] Acquired schema lock
0709 12:58:19.256194 (+ 18543us) tablet.cc:662] Decoding operations
0709 12:58:19.717407 (+461213us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:19.717480 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:19.717508 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:58:20.639468 (+921960us) tablet.cc:701] Row locks acquired
0709 12:58:20.639501 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:58:20.706682 (+ 67181us) write_op.cc:270] Start()
0709 12:58:20.738646 (+ 31964us) write_op.cc:276] Timestamp: P: 1783601900702862 usec, L: 0
0709 12:58:20.738677 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:58:20.900390 (+161713us) log.cc:844] Serialized 5188 byte log entry
0709 12:58:21.087916 (+187526us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a4272fe28 00007f6a4616a581 00007f6a46169d58 00007f6a4616e9f1 00007f6a4616e9a9 00007f6a4616e939 00007f6a4616e901 00007f6a4616db2d 000000000038f354 000000000038f199
0709 12:58:21.370384 (+282468us) op_driver.cc:464] REPLICATION: finished
0709 12:58:22.091565 (+721181us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a3f62a0ac 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a4616aef0
0709 12:58:22.213285 (+121720us) write_op.cc:301] APPLY: starting
0709 12:58:22.239917 (+ 26632us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:22.265032 (+ 25115us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b18000f9a00. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:22.364812 (+ 99780us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:22.372356 (+  7544us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:22.477475 (+105119us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:22.477863 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:58:22.477911 (+    48us) write_op.cc:312] APPLY: finished
0709 12:58:22.478346 (+   435us) log.cc:844] Serialized 95 byte log entry
0709 12:58:22.584110 (+105764us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a3f62a0ac 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b
0709 12:58:22.792574 (+208464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:22.935407 (+142833us) write_op.cc:454] Released schema lock
0709 12:58:22.935495 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:22.935994 (+   499us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:22.936035 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2219664,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":767637,"apply.run_cpu_time_us":77387,"apply.run_wall_time_us":776841,"num_ops":13,"prepare.queue_time_us":458676,"prepare.run_cpu_time_us":23318,"prepare.run_wall_time_us":2358193,"raft.queue_time_us":379057,"raft.run_cpu_time_us":28421,"raft.run_wall_time_us":802017,"replication_time_us":622456,"spinlock_wait_cycles":422345984,"thread_start_us":1622229,"threads_started":5,"wal-append.queue_time_us":581712,"wal-append.run_cpu_time_us":59942,"wal-append.run_wall_time_us":2237434}]]}
W20260709 12:58:29.172003  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.161206  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.181855  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.182586  1647 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:29.169605  5255 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:29.121361  5242 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:29.191037  1612 connection.cc:256] RPC call timeout handler was delayed by -1.011255503999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28940000000000005s for a response
I20260709 12:58:29.190647  5255 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:29.186025  5236 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:58:29.184963  5145 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:29.191159  5237 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.199244  5237 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:29.191238  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 66865.8us
I20260709 12:58:29.193396  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:29.202544  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:29.203279  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.204188  1719 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:29.204816  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:29.205078  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.205847  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.206477  1714 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:29.207393  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.208070  1721 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:29.206396  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:29.233266  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:29.236452  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.216035  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:29.210631  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 55004.2us
I20260709 12:58:29.170756  5092 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.241326  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:29.249334  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:29.250344  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:29.241231  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:29.187121  5035 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:29.246805  1719 raft_consensus.cc:2410] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:29.227272  1571 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:29.223047  1712 raft_consensus.cc:2410] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:58:29.255897  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:29.261529  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.258560  1713 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:29.259069  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:29.200276  5242 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.262481  5242 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:29.263219  1715 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:29.264055  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.199937  5135 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:29.196769  5269 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.239470  5145 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:29.274674  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:29.275014  1714 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:29.270289  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:29.207711  4904 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:29.275718  4904 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.233126  5272 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:29.177269  5157 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.261739  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.277593  1712 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:29.278379  5246 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:29.278797  5246 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.278869  5157 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:29.279204  5246 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:29.275727  1644 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:29.281143  4904 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:29.289100  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 95785.7us
I20260709 12:58:29.289040  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.290042  1644 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:29.248831  5235 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:29.254258  5217 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:29.254844  5219 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:29.189142  5136 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:58:29.191280  5006 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:58:29.191238  5256 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:58:29.298640  1718 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:29.299057  1686 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:29.299418  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.338758  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.339289  1644 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 7: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:58:29.303221  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 100743us
I20260709 12:58:29.307430  1715 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:58:29.331772  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:29.336455  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:29.334519  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.341454  1684 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:29.273310  5198 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:29.337702  1712 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:29.339529  1646 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:29.342862  5244 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:29.343252  5244 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.343580  5244 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:29.348874  5243 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:29.349377  5243 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.349761  5243 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:29.359349  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:29.360353  5268 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:29.360826  5268 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:29.361330  5268 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:29.362977  1684 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:29.370862  5243 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.371934  5270 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:29.388805  5270 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:29.389369  5270 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:29.376048  5231 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:58:29.390887  5231 consensus_queue.cc:1243] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:58:29.392334  5278 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260709 12:58:29.198674  5245 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.394352  5245 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:29.271287  5264 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:29.254438  5092 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:29.379537  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 89128.6us
I20260709 12:58:29.380096  5237 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:29.265678  5223 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:58:29.298341  5217 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.382480  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:29.412671  1646 raft_consensus.cc:2410] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:29.377269  4880 raft_consensus.cc:3055] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:29.387235  1572 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:29.308678  5219 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:29.388948  5244 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.246657  5156 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.379053  1645 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:58:29.397495  1644 pending_rounds.cc:85] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:58:29.399446  1721 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:29.419190  1644 pending_rounds.cc:107] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 9.5
W20260709 12:58:29.377018  5277 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:58:29.253736  5066 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.376767  5116 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.381714  5235 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:29.276907  5272 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.418802  1645 pending_rounds.cc:85] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 5
I20260709 12:58:29.419523  1644 raft_consensus.cc:2889] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:29.294027  5269 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.386776  5251 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:29.418286  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.430522  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.464847  1570 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:29.431246  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.465364  1569 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:29.431870  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:29.466337  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.466988  1564 raft_consensus.cc:2410] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:58:29.467918  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.432978  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.466328  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.470672  1572 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:29.433609  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.376521  5246 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.415041  5217 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:29.443264  1645 pending_rounds.cc:107] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:58:29.452186  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.476358  1645 raft_consensus.cc:2889] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:29.454144  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.477217  1565 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:29.459251  2341 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:58:29.414289  4880 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:29.418757  5219 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:29.468557  1564 raft_consensus.cc:2376] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10. Re-sending same reply.
I20260709 12:58:29.479609  1643 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:58:29.463774  5156 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:29.464241  5105 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:29.496116  2349 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:58:29.506593  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.513762  5087 raft_consensus.cc:1064] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
W20260709 12:58:29.433532  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 192398us
I20260709 12:58:29.514582  1569 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:29.447754  5275 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:58:29.516785  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:29.448228  5237 consensus_queue.cc:1059] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:58:29.464896  5240 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:58:29.449843  5116 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.555518  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.556509  1564 raft_consensus.cc:2368] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9.
I20260709 12:58:29.475948  5251 raft_consensus.cc:697] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:29.524909  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 271628us
I20260709 12:58:29.558928  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:29.493203  5015 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:29.449349  5158 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.473295  5231 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:58:29.560808  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.562749  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.564038  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:29.582391  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 313277us
I20260709 12:58:29.582880  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.564250  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.584554  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.585134  1572 raft_consensus.cc:2376] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9. Re-sending same reply.
I20260709 12:58:29.585983  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.587107  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.565462  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.587916  1566 raft_consensus.cc:2376] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9. Re-sending same reply.
I20260709 12:58:29.588901  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.589691  1566 raft_consensus.cc:2368] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11.
W20260709 12:58:29.566690  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.566619  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.570519  1712 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:29.575937  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 59688.7us
I20260709 12:58:29.579222  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:29.579730  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.485785  5235 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:58:29.583565  1567 raft_consensus.cc:2376] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10. Re-sending same reply.
I20260709 12:58:29.608546  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:29.606979  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:29.607101  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:29.607172  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.617664  1564 raft_consensus.cc:2393] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:29.618022  1572 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:29.528347  5006 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:29.619670  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.622507  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:29.607551  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 174132us
I20260709 12:58:29.527596  5145 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:29.618609  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:29.646139  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 305900us
W20260709 12:58:29.648201  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.638909  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:29.643791  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:29.644264  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.681000  1564 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:29.685046  1564 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:58:29.644709  5006 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.608457  5113 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:29.698185  1712 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:29.698825  2314 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:29.703497  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 84967.6us
W20260709 12:58:29.683936  5285 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 12:58:29.712224  2341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 469) took 1071 ms. Trace:
I20260709 12:58:29.724490  2341 rpcz_store.cc:276] 0709 12:58:28.641171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:28.641747 (+   576us) service_pool.cc:224] Handling call
0709 12:58:28.642161 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:29.478925 (+836764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:29.712012 (+233087us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54005d0554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:29.712167 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852773248}
I20260709 12:58:29.637339  5256 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:29.639715  5265 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:29.731815  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:29.516114  5087 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.739068  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:29.745704  1641 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 12:58:29.751530  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.688954  5198 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:29.767325  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:29.770716  1537 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:29.578462  4880 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:29.715608  5249 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:29.584900  5295 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:29.716131  5113 raft_consensus.cc:697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:29.697294  5136 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:58:29.737162  5244 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:29.767421  5180 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:29.767712  5135 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:29.712128  4904 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:58:29.729460  5252 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:58:29.764446  5243 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:29.768100  5092 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:29.766779  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.779603  5032 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 12:58:29.814601  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 104986us
I20260709 12:58:29.826293  1571 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:29.777987  1537 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:29.836356  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 58457.5us
I20260709 12:58:29.840936  1612 leader_election.cc:400] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:29.841310  1612 leader_election.cc:403] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:29.855242  1537 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:29.786288  5291 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:29.769060  5293 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:58:29.759805  5299 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.095s
W20260709 12:58:29.861044  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 144240us
W20260709 12:58:29.832031  5287 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 12:58:29.792578  5203 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:29.801577  4880 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:29.806344  5288 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:58:29.754350  5251 consensus_queue.cc:237] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:29.863898  5284 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
I20260709 12:58:29.819057  5145 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.971513  5272 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:29.972924  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:29.973788  5255 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.777s	user 0.000s	sys 0.009s
I20260709 12:58:29.802264  5269 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:29.982946  5297 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 12:58:29.792835  5295 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:29.801370  5249 raft_consensus.cc:697] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:29.985773  1642 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:58:29.914009  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.002095  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:30.117506  1646 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:30.118752  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:30.119371  1646 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:30.007264  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:30.012284  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.123107  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:29.819931  5135 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:30.123974  5135 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:30.018860  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:29.802587  5246 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:30.021636  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:30.129182  1563 raft_consensus.cc:2376] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10. Re-sending same reply.
I20260709 12:58:30.024224  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:30.130091  2341 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:29.965855  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:30.028753  1566 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:30.131158  1721 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:30.131980  1641 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:29.968312  5307 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:58:30.028182  5113 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:30.036043  5015 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:30.137861  5015 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:30.021193  5035 consensus_meta.cc:287] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.749s	user 0.003s	sys 0.007s
I20260709 12:58:30.141601  5035 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:29.857421  5201 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:30.142853  5201 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:30.143908  5201 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:29.794700  5235 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.234s
I20260709 12:58:30.043113  5116 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:30.044886  2343 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:30.099341  5255 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:30.154654  2343 raft_consensus.cc:606] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:30.156708  5255 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:30.157269  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:30.157528  5298 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:58:30.049065  5296 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 12:58:30.053326  5290 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:58:29.864132  5092 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:58:30.068465  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:30.076963  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:30.077767  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:30.082703  5256 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:30.085498  5126 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.019s	sys 0.009s
W20260709 12:58:30.086037  1686 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.554s (SENT) [suppressed 49 similar messages]
I20260709 12:58:30.084195  5006 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:30.103686  2346 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:58:30.123353  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:30.047364  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:29.864305  5180 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:30.157795  5249 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:30.167554  1641 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:30.076340  5233 consensus_queue.cc:1059] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:58:30.071830  5198 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 12:58:30.351539  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:30.168534  5261 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.183s
I20260709 12:58:30.352219  1647 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:30.352679  1638 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:30.352954  5015 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:30.354698  1641 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:30.197050  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:30.390416  1563 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:30.391554  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:30.355553  5015 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:30.392778  5015 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:30.393826  5180 raft_consensus.cc:697] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:30.394351  5015 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:30.284771  1646 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
W20260709 12:58:30.356441  5126 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.209s	user 0.021s	sys 0.018s
I20260709 12:58:30.355283  1638 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:30.395553  5180 consensus_queue.cc:237] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:30.380295  1641 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:58:30.398123  2349 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:30.173506  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:30.276464  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53170.9us
I20260709 12:58:30.173034  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:30.259678  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52980.3us
W20260709 12:58:30.295037  1719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.007s	sys 0.026s
I20260709 12:58:30.340827  1565 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:30.115181  5295 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:30.402130  1719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.007s	sys 0.030s
I20260709 12:58:30.403229  1720 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
W20260709 12:58:30.180445  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 57431.8us
I20260709 12:58:30.403762  1537 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:30.197098  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:30.398561  1638 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:30.404949  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:30.401692  1571 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:30.403702  1720 pending_rounds.cc:85] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 7
I20260709 12:58:30.406665  1720 pending_rounds.cc:107] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:58:30.406658  5272 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:30.407095  1720 raft_consensus.cc:2889] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:30.407181  1563 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:30.270864  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:30.408819  1712 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:30.405659  1716 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:30.189684  1721 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:30.280448  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:30.415066  1571 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:30.416731  1647 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:30.419080  1647 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 12:58:30.357331  5313 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
W20260709 12:58:30.430971  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 353248us
I20260709 12:58:30.432008  1646 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:30.439627  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:30.442647  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 356572us
I20260709 12:58:30.197438  5231 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:30.323623  5325 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.432493  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:30.464483  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:30.464628  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:30.465790  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:30.466466  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:30.467263  1720 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:30.467815  5198 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:30.433910  5314 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
W20260709 12:58:30.441491  5296 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:58:30.323582  5255 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.147s
I20260709 12:58:30.468602  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:30.471361  1566 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:30.480679  1712 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:30.489719  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:30.501554  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:30.481837  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:30.535238  1714 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:30.504216  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:30.502925  1684 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:30.492355  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:30.539942  1712 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
W20260709 12:58:30.538957  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 149407us
I20260709 12:58:30.468175  1647 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:30.553333  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:30.554809  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:30.476243  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:30.559208  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 56396.1us
W20260709 12:58:30.560500  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 156888us
I20260709 12:58:30.561225  1720 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:30.559990  1684 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:30.566906  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 85147.6us
I20260709 12:58:30.736183  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:30.577154  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 101023us
I20260709 12:58:30.738170  1686 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:30.492872  5322 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.488660  5006 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:30.492949  5315 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:58:30.599231  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.533759  5231 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:30.732535  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:30.755028  1647 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:30.489516  5272 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:30.739256  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:30.744233  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 184328us
I20260709 12:58:30.484524  4904 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 12:58:30.485338  5325 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:30.571866  5312 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:30.833881  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1880) took 1437 ms. Trace:
I20260709 12:58:30.573720  5116 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.781126  1647 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:58:30.480947  5135 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:30.840204  1644 rpcz_store.cc:276] 0709 12:58:29.396807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.396963 (+   156us) service_pool.cc:224] Handling call
0709 12:58:29.397297 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:29.463687 (+ 66390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:29.463726 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:29.464278 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 12:58:29.759244 (+294966us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:29.759281 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:29.759366 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:30.833559 (+1074193us) raft_consensus.cc:1685] finished
0709 12:58:30.833590 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:30.833802 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9137,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":1351,"thread_start_us":265517,"threads_started":1,"wal-append.queue_time_us":535620}
I20260709 12:58:30.763588  5006 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:30.496480  5295 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:30.844700  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 457) took 1725 ms. Trace:
I20260709 12:58:30.767378  5087 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:30.899995  1717 rpcz_store.cc:276] 0709 12:58:29.119594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.119713 (+   119us) service_pool.cc:224] Handling call
0709 12:58:29.138018 (+ 18305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:29.396355 (+258337us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:29.405558 (+  9203us) log.cc:844] Serialized 14 byte log entry
0709 12:58:29.712622 (+307064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:29.713384 (+   762us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:29.713435 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:30.844414 (+1130979us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400277ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:30.844463 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:30.844600 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":118,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":3622,"raft.queue_time_us":54235,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"spinlock_wait_cycles":593580800,"thread_start_us":306676,"threads_started":2,"wal-append.queue_time_us":851250}
I20260709 12:58:30.840179  5312 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:30.880553  5113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.003s	sys 0.022s
I20260709 12:58:30.878919  5231 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:30.956067  5113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.008s	sys 0.024s
W20260709 12:58:30.957050  2315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.003s	sys 0.016s
I20260709 12:58:30.735272  5256 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:30.909168  5006 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:30.966678  2315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.003s	sys 0.016s
I20260709 12:58:30.904595  5087 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:30.934041  5223 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.950008  5312 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:30.880517  5116 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:31.016865  1567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.017s	sys 0.017s
W20260709 12:58:31.020747  1567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.018s	sys 0.017s
W20260709 12:58:31.013619  1564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.024s
W20260709 12:58:31.021574  1564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.000s	sys 0.024s
I20260709 12:58:30.904292  5315 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:58:30.933346  5255 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:58:30.971586  5337 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:31.001573  5246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.006s	sys 0.041s
I20260709 12:58:31.032687  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:31.025825  5328 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
I20260709 12:58:31.014816  5087 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:31.049021  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:31.014406  5301 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:31.022842  5310 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:58:31.073009  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 333776us
I20260709 12:58:31.034435  5238 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:31.050510  5270 consensus_meta.cc:287] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.646s	user 0.008s	sys 0.004s
I20260709 12:58:31.048985  5198 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:31.085819  1537 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:31.093302  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 357168us
I20260709 12:58:31.118677  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:31.094084  2312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.019s	sys 0.035s
W20260709 12:58:31.119864  2312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.019s	sys 0.035s
I20260709 12:58:31.119920  2346 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:58:31.059981  5246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.006s	sys 0.042s
W20260709 12:58:31.092902  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 354770us
I20260709 12:58:31.122972  5234 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:31.123826  5234 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.124217  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:31.126930  5231 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:31.127122  5234 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:31.130313  2349 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:58:31.130378  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:31.131507  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:31.129187  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:31.133505  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:31.134981  1686 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:31.074764  5301 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.139174  1612 leader_election.cc:400] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:31.143416  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:31.144516  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:31.145431  1569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.000s	sys 0.023s
W20260709 12:58:31.146747  1569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.000s	sys 0.024s
I20260709 12:58:31.141782  1686 leader_election.cc:400] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9.
I20260709 12:58:31.148051  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:31.153684  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1754) took 1460 ms. Trace:
I20260709 12:58:31.154136  1713 rpcz_store.cc:276] 0709 12:58:29.693475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.695067 (+  1592us) service_pool.cc:224] Handling call
0709 12:58:29.702137 (+  7070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:29.830197 (+128060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:29.830231 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:29.830676 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:58:30.014293 (+183617us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:30.014346 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:30.014449 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.153440 (+1138991us) raft_consensus.cc:1685] finished
0709 12:58:31.153463 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.153607 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104286,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"thread_start_us":310819,"threads_started":2,"wal-append.queue_time_us":674187}
I20260709 12:58:31.142086  5231 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:31.155638  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:31.088387  5342 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:31.077412  5310 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:31.152992  5156 consensus_meta.cc:287] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.633s	user 0.008s	sys 0.005s
W20260709 12:58:31.169710  5242 consensus_meta.cc:287] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.901s	user 0.013s	sys 0.000s
I20260709 12:58:31.077370  5304 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:31.140198  5246 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.137981  5234 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:31.168637  5217 consensus_meta.cc:287] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 1.680s	user 0.012s	sys 0.000s
I20260709 12:58:31.144515  5301 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:31.192039  5135 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:31.193933  5198 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:31.197119  5341 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:31.186272  5264 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:31.196326  5310 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:31.195101  5326 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.435s	user 0.002s	sys 0.002s
I20260709 12:58:31.089355  5270 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.017377  5223 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:30.759346  5322 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.205399  5325 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:31.315274  5325 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:58:31.316009  5338 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:58:31.316145  5325 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:31.051437  5337 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:31.317162  5325 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:31.317721  5321 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.317868  5325 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.318595  5321 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.319630  5337 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:31.210426  5304 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:31.321571  5304 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.322378  5325 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:31.322866  5322 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:31.323701  5322 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:31.324559  5322 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:31.325150  5270 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:31.324563  5325 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:31.229799  5340 consensus_queue.cc:1059] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.292s
W20260709 12:58:31.328050  5292 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:58:31.329043  5333 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.387s	user 0.001s	sys 0.001s
I20260709 12:58:31.330237  5225 raft_consensus.cc:3055] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:31.330681  5225 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:31.308750  5319 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.585s	user 0.001s	sys 0.001s
W20260709 12:58:31.334096  5348 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 12:58:31.337154  5294 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:31.337749  5294 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:31.339072  5294 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.340619  5116 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:31.254905  5264 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.301852  5366 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.345595  5158 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:31.345081  5366 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.234894  5352 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:31.347247  5352 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.347769  5352 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:31.305701  5198 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:58:31.215273  5217 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.205076  5242 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.354974  5242 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:31.241577  5341 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.210779  5246 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.361646  5241 raft_consensus.cc:3055] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:31.362262  5241 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:31.375895  5321 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:31.377642  5268 consensus_meta.cc:287] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 2.016s	user 0.009s	sys 0.007s
I20260709 12:58:31.381470  5223 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:31.382078  5092 consensus_meta.cc:287] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.029s	user 0.007s	sys 0.004s
I20260709 12:58:31.382694  5092 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:58:31.387560  5066 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:31.388204  5294 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:31.390188  5352 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.393451  5352 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:31.397955  5264 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:31.398128  5246 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:31.378242  5268 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.400754  5225 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.226161  5234 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:31.211542  5295 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:31.400300  5231 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:58:31.247215  5345 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.155s	user 0.005s	sys 0.000s
I20260709 12:58:31.402549  5234 raft_consensus.cc:697] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:31.402601  5087 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.405292  5268 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:31.405923  5087 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:31.404217  5234 consensus_queue.cc:237] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.410902  5366 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:31.412700  5341 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:31.413506  5340 raft_consensus.cc:3055] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:31.413653  5217 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:31.419941  5219 consensus_meta.cc:287] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.910s	user 0.011s	sys 0.001s
I20260709 12:58:31.423800  5340 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:31.313979  5335 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.297s	user 0.004s	sys 0.016s
I20260709 12:58:31.425359  5340 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.427335  5340 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:31.363600  5241 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.430516  5241 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:31.208622  5357 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:31.436882  5219 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.435858  5310 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.446019  5310 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:31.458033  5272 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.004s
I20260709 12:58:31.436941  5357 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.473749  5357 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:31.520996  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 434974us
I20260709 12:58:31.530097  1535 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:31.533874  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:31.534472  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.536432  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1855) took 1364 ms. Trace:
I20260709 12:58:31.536484  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:31.537143  1564 rpcz_store.cc:276] 0709 12:58:30.172160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.399883 (+227723us) service_pool.cc:224] Handling call
0709 12:58:30.400224 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:30.400608 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:30.400658 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:30.401315 (+   657us) log.cc:844] Serialized 52 byte log entry
0709 12:58:31.022097 (+620782us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:31.022145 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.022225 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.535747 (+513522us) raft_consensus.cc:1685] finished
0709 12:58:31.535818 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.536175 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70013,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11240,"thread_start_us":620349,"threads_started":1,"wal-append.queue_time_us":952443}
I20260709 12:58:31.539002  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:31.539987  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:31.540524  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:31.541496  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:31.542068  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:31.543471  1564 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:58:31.544371  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:31.545867  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:31.547823  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 533) took 1430 ms. Trace:
I20260709 12:58:31.548326  1567 rpcz_store.cc:276] 0709 12:58:30.116864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.120752 (+  3888us) service_pool.cc:224] Handling call
0709 12:58:30.121103 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.121499 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:30.121817 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 12:58:30.388462 (+266645us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:30.388985 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:58:30.389134 (+   149us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:30.412726 (+ 23592us) log.cc:844] Serialized 14 byte log entry
0709 12:58:31.021205 (+608479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.021300 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.365268 (+343968us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18003db8e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:31.547189 (+181921us) raft_consensus.cc:1685] finished
0709 12:58:31.547248 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.547577 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17372,"prepare.queue_time_us":288,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":99,"raft.queue_time_us":124179,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":39988,"spinlock_wait_cycles":31707904,"thread_start_us":847855,"threads_started":2,"wal-append.queue_time_us":1130051}
I20260709 12:58:31.553014  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 526) took 2446 ms. Trace:
I20260709 12:58:31.553550  1568 rpcz_store.cc:276] 0709 12:58:29.106480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.108581 (+  2101us) service_pool.cc:224] Handling call
0709 12:58:29.108898 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:29.121312 (+ 12414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:29.121341 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:29.175938 (+ 54597us) log.cc:844] Serialized 26 byte log entry
0709 12:58:29.486174 (+310236us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:29.486209 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:29.486271 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.552381 (+2066110us) raft_consensus.cc:1685] finished
0709 12:58:31.552438 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.552790 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14411,"raft.queue_time_us":15728,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":13787,"thread_start_us":232997,"threads_started":1,"wal-append.queue_time_us":1920036}
I20260709 12:58:31.556245  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1853) took 1384 ms. Trace:
I20260709 12:58:31.556712  1569 rpcz_store.cc:276] 0709 12:58:30.171586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.173655 (+  2069us) service_pool.cc:224] Handling call
0709 12:58:30.357405 (+183750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.357764 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.357796 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:30.358321 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.147413 (+789092us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:31.147450 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.147511 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.555770 (+408259us) raft_consensus.cc:1685] finished
0709 12:58:31.555810 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.556068 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1044,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":54705,"thread_start_us":788724,"threads_started":1,"wal-append.queue_time_us":998539}
I20260709 12:58:31.559216  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1858) took 1368 ms. Trace:
I20260709 12:58:31.559635  1571 rpcz_store.cc:276] 0709 12:58:30.190595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.415767 (+225172us) service_pool.cc:224] Handling call
0709 12:58:30.416073 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.847240 (+431167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.847278 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:30.856274 (+  8996us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.105437 (+249163us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:31.105773 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.106069 (+   296us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.558633 (+452564us) raft_consensus.cc:1685] finished
0709 12:58:31.558673 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.559011 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170494,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":60758,"thread_start_us":590320,"threads_started":2,"wal-append.queue_time_us":296149}
I20260709 12:58:31.562727  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:31.568739  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 424070us
I20260709 12:58:31.572672  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:31.573328  1639 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:31.573536  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:31.574926  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1758) took 1548 ms. Trace:
I20260709 12:58:31.575165  1645 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:31.575408  1641 rpcz_store.cc:276] 0709 12:58:30.026540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.399913 (+373373us) service_pool.cc:224] Handling call
0709 12:58:30.400459 (+   546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.433757 (+ 33298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.433787 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:30.434242 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:58:30.846872 (+412630us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:30.846929 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:30.847010 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.574285 (+727275us) raft_consensus.cc:1685] finished
0709 12:58:31.574331 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:31.574655 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32770,"raft.queue_time_us":44341,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":24202,"thread_start_us":412353,"threads_started":1,"wal-append.queue_time_us":786516}
I20260709 12:58:31.578094  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:31.578984  1641 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:31.573802  1640 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:31.581766  1644 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:58:31.582074  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.582213  1644 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:31.582429  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:31.583566  1640 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:31.585022  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:31.586114  1640 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:31.587553  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:31.583804  1644 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.589632  1644 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:31.588515  1640 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:31.591210  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:31.606639  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:31.608758  1718 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:31.609431  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:31.610345  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:31.611479  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:31.613155  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:31.614104  1569 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:31.616344  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:31.616485  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:31.618474  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:31.619628  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:31.301621  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 63594.3us
I20260709 12:58:31.623056  2312 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:31.624933  5249 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:31.625520  5249 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.625989  5249 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:31.630959  5032 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:31.632323  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:31.633513  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.634976  5263 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:31.635367  5035 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:31.636104  5263 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.636945  5263 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.637926  5116 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:31.638273  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:31.638536  5156 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:31.639060  5156 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:31.639268  2346 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:31.639536  5156 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:31.639734  5263 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:31.636114  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:31.641050  5203 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:31.637328  5145 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.641671  5158 consensus_queue.cc:1059] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:31.640511  5136 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:31.642982  5158 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:31.643441  5158 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.440457  5219 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:31.644199  5136 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:31.644662  5180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.016s	sys 0.023s
I20260709 12:58:31.644804  5136 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:31.645375  5180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.016s	sys 0.024s
I20260709 12:58:31.645596  5136 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:31.645880  5225 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:31.646257  5180 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:31.647146  5180 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.647542  1716 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:31.642452  5145 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.638810  5116 consensus_queue.cc:1059] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:31.649811  1713 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:31.643859  5158 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:31.669052  5126 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:31.670287  5126 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.674839  5264 consensus_queue.cc:1059] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:31.677100  5318 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.640367  5263 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.631906  5032 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.700912  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:31.698628  1535 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:31.708892  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 86277.7us
I20260709 12:58:31.709645  5245 raft_consensus.cc:3055] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:31.710196  5245 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:31.711310  5126 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:31.709635  5318 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.472719  5272 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:31.717526  5264 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.718405  5180 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:31.718545  5264 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.721359  5263 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.643700  5203 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:31.725083  5203 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:31.725481  5203 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:31.726034  1716 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:58:31.728885  5263 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:31.731040  5318 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:31.734349  1572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1845) took 2166 ms (client timeout 2155 ms). Trace:
I20260709 12:58:31.734850  5032 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:31.734985  1572 rpcz_store.cc:269] 0709 12:58:29.568102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.586853 (+ 18751us) service_pool.cc:224] Handling call
0709 12:58:31.733792 (+2146939us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b5400043654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:31.734045 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69535488}
I20260709 12:58:31.711786  5245 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.749027  1644 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:31.742304  5264 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:31.762005  1641 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:31.766877  2345 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:58:31.753028  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.013s	sys 0.003s
I20260709 12:58:31.761201  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:31.782373  1647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.004s	sys 0.024s
W20260709 12:58:31.782672  5324 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:58:31.782841  1647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.004s	sys 0.024s
I20260709 12:58:31.782874  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1750) took 2043 ms. Trace:
I20260709 12:58:31.785784  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:31.788007  5006 consensus_meta.cc:287] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.769s	user 0.004s	sys 0.011s
W20260709 12:58:31.791757  5301 consensus_meta.cc:287] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.566s	user 0.013s	sys 0.000s
W20260709 12:58:31.793731  1714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.010s	sys 0.009s
W20260709 12:58:31.794081  1714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.011s	sys 0.009s
I20260709 12:58:31.798753  5368 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:31.801479  5262 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:31.803313  5219 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:58:31.805861  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.013s	sys 0.003s
I20260709 12:58:31.783494  1642 rpcz_store.cc:276] 0709 12:58:29.739300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.739460 (+   160us) service_pool.cc:224] Handling call
0709 12:58:29.739810 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:30.115446 (+375636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.768370 (+1652924us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400335c54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:31.782696 (+ 14326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564655360}
I20260709 12:58:31.808380  5245 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:31.784024  5249 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:31.792207  5301 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:31.897753  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1838) took 2335 ms. Trace:
W20260709 12:58:31.913805  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.818782  2343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58438 (request call id 3) took 1789 ms. Trace:
W20260709 12:58:31.819245  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 198723us
I20260709 12:58:31.812784  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1870) took 2559 ms. Trace:
I20260709 12:58:31.809723  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1748) took 2072 ms. Trace:
W20260709 12:58:31.951313  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.309664  1645 rpcz_store.cc:276] 0709 12:58:29.737544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.737708 (+   164us) service_pool.cc:224] Handling call
0709 12:58:29.779935 (+ 42227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.575873 (+1795938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.809326 (+233453us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54002652d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:31.809650 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4126937984}
I20260709 12:58:31.897663  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:31.821650  1565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1837) took 2259 ms (client timeout 1974 ms). Trace:
W20260709 12:58:32.116250  1613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.021s
I20260709 12:58:31.912600  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 505) took 1886 ms. Trace:
I20260709 12:58:32.311240  1713 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:31.809144  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:31.815586  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:31.761031  5145 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:32.311457  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:32.316956  1716 consensus_meta.cc:287] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.001s
W20260709 12:58:31.876253  1643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.005s	sys 0.016s
I20260709 12:58:32.318681  1716 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:32.306665  1570 rpcz_store.cc:276] 0709 12:58:29.562367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.562492 (+   125us) service_pool.cc:224] Handling call
0709 12:58:31.897329 (+2334837us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400042754. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:31.897528 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3118987520}
W20260709 12:58:32.320309  1613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.004s	sys 0.025s
I20260709 12:58:32.306384  2343 rpcz_store.cc:276] 0709 12:58:30.029436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.044733 (+ 15297us) service_pool.cc:224] Handling call
0709 12:58:31.818029 (+1773296us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b54004ba8a0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426b1520 00007f6a4272e652 00007f6a476fc60a 00007f6a40c827d4 00007f6a40c82762 00007f6a40c82691 00007f6a40c8260c 00007f6a40c818c2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:31.818532 (+   503us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101531008}
I20260709 12:58:32.307724  1639 rpcz_store.cc:276] 0709 12:58:29.253835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.253971 (+   136us) service_pool.cc:224] Handling call
0709 12:58:29.288270 (+ 34299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.573910 (+2285640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.812377 (+238467us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b5400337054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:31.812679 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5253637888}
I20260709 12:58:32.327018  2346 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:32.312340  1565 rpcz_store.cc:269] 0709 12:58:29.562058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.564579 (+  2521us) service_pool.cc:224] Handling call
0709 12:58:31.821319 (+2256740us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54001658d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:31.821468 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219699712}
I20260709 12:58:31.813386  5116 raft_consensus.cc:3055] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:32.358801  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:32.222836  5219 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:32.356297  1643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.458s	user 0.012s	sys 0.027s
I20260709 12:58:31.819509  5180 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:32.313305  1638 rpcz_store.cc:276] 0709 12:58:30.025714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.396906 (+371192us) service_pool.cc:224] Handling call
0709 12:58:30.398270 (+  1364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:30.405203 (+  6933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.899248 (+1494045us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b54000f8cd0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:31.912415 (+ 13167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2549504}
I20260709 12:58:31.896868  5378 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.950779  5126 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.365083  1566 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:31.819149  5035 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:32.369227  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.788451  5006 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:32.192389  5330 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.376425  1721 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
W20260709 12:58:32.359930  4880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.009s	sys 0.009s
I20260709 12:58:32.376430  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:32.068775  5367 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:32.359033  5116 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:31.948608  5203 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:32.392979  5015 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:32.393241  5312 consensus_meta.cc:287] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 1.294s	user 0.012s	sys 0.004s
I20260709 12:58:32.393721  5015 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.393769  5312 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:32.396209  5015 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.397701  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:32.398231  5379 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.398455  1713 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:32.398947  5379 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.371286  5180 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:32.401238  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.380s	user 0.016s	sys 0.016s
I20260709 12:58:32.401410  5180 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:32.401680  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.642s	user 0.016s	sys 0.017s
W20260709 12:58:32.402084  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 1.64263e+06us
I20260709 12:58:32.405855  5318 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:32.405504  5116 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.413950  5116 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:32.416601  5241 consensus_meta.cc:287] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.927s	user 0.011s	sys 0.007s
W20260709 12:58:32.416805  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 1.26112e+06us
I20260709 12:58:32.417949  1686 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:32.419880  5367 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.420462  5310 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:32.426193  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1753) took 2845 ms. Trace:
I20260709 12:58:32.426623  1718 rpcz_store.cc:276] 0709 12:58:29.580584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.580762 (+   178us) service_pool.cc:224] Handling call
0709 12:58:29.619919 (+ 39157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.609412 (+1989493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.425849 (+816437us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54001caf54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:32.426094 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4572217600}
I20260709 12:58:32.427493  5330 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.430545  5264 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.387878  2341 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:32.411350  5318 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.436851  4880 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.437106  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1757) took 2352 ms. Trace:
I20260709 12:58:32.437459  4880 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.438269  5318 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.438582  5301 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.439059  5318 raft_consensus.cc:3055] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:32.439464  5318 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:32.431565  1720 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:32.412834  5234 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.413143  1645 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:32.409745  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:32.434341  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:32.446086  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.439584  4880 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.411938  5126 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:32.450038  5367 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.452733  2345 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:32.437477  1646 rpcz_store.cc:276] 0709 12:58:30.010235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.395725 (+385490us) service_pool.cc:224] Handling call
0709 12:58:30.431753 (+ 36028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.438056 (+  6303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.229138 (+1791082us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54001e37d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:32.362180 (+133042us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81956224}
I20260709 12:58:32.430771  5219 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.469303  5318 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.470417  5145 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.472080  5015 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.472826  5015 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.470444  5318 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:32.475385  5015 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.480790  5035 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.481405  5379 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.396220  5312 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:32.483805  5035 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:32.485477  5225 consensus_meta.cc:287] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.839s	user 0.011s	sys 0.002s
I20260709 12:58:32.491876  1717 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:58:32.496204  5340 consensus_meta.cc:287] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.068s	user 0.011s	sys 0.010s
I20260709 12:58:32.531883  5312 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.532439  5066 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.532760  5312 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.532996  5066 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.533689  5249 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:32.534950  5312 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:32.535060  5066 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:32.496529  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:32.500972  5156 consensus_meta.cc:287] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.861s	user 0.012s	sys 0.002s
I20260709 12:58:32.503371  5126 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:32.504115  5234 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.504629  1565 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:32.505281  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:32.506098  5116 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:32.506865  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:32.439316  5378 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:32.512488  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:32.461578  5006 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:32.513173  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:32.513933  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:32.516438  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:32.516979  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:32.566964  1564 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:32.567548  1721 raft_consensus.cc:2410] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:58:32.568115  1642 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:32.517513  1535 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:32.521155  1563 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:32.471243  5145 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.529264  5201 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:32.530949  5203 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:32.531445  5357 consensus_meta.cc:287] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.046s	user 0.006s	sys 0.005s
I20260709 12:58:32.434439  5264 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:32.531641  5136 consensus_meta.cc:287] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.885s	user 0.010s	sys 0.005s
W20260709 12:58:32.531948  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 112468us
I20260709 12:58:32.498579  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1764) took 1950 ms. Trace:
I20260709 12:58:32.548346  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:32.578158  1638 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:32.585628  1565 raft_consensus.cc:2410] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:32.550684  1640 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:32.562034  5219 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.563715  1572 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:32.542289  1569 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
W20260709 12:58:32.535295  5158 consensus_meta.cc:287] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.000s
I20260709 12:58:32.544724  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:32.565518  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:32.573089  1571 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:32.577754  1568 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:32.546550  5156 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.547206  5180 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.583287  5264 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:32.586333  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53662.1us
W20260709 12:58:32.591982  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 74608.7us
I20260709 12:58:32.594162  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:32.597236  1563 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:32.601243  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:32.601760  5203 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:32.602021  1716 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:32.607743  1721 raft_consensus.cc:2410] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:32.585178  1647 rpcz_store.cc:276] 0709 12:58:30.547938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.849677 (+301739us) service_pool.cc:224] Handling call
0709 12:58:30.858517 (+  8840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.093514 (+234997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.093558 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.121441 (+ 27883us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.783733 (+662292us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:31.783844 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.783968 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:32.498342 (+714374us) raft_consensus.cc:1685] finished
0709 12:58:32.498365 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.498517 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27979,"raft.queue_time_us":211770,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6840,"thread_start_us":820793,"threads_started":2,"wal-append.queue_time_us":1348909}
I20260709 12:58:32.589557  5158 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:32.628055  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:32.629009  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.629756  5245 consensus_queue.cc:1059] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:32.630868  5245 raft_consensus.cc:3055] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:32.631285  5245 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:32.595249  5116 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:32.590394  5136 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:58:32.637200  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 100912us
I20260709 12:58:32.594532  5201 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.591331  5357 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.645309  1537 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:32.622717  5203 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:32.662277  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 50181.5us
I20260709 12:58:32.664243  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1746) took 3382 ms. Trace:
I20260709 12:58:32.665704  5382 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:32.664675  1719 rpcz_store.cc:276] 0709 12:58:29.238331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.282277 (+ 43946us) service_pool.cc:224] Handling call
0709 12:58:29.282531 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:29.478541 (+196010us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:29.494801 (+ 16260us) log.cc:844] Serialized 14 byte log entry
0709 12:58:29.983153 (+488352us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b1800489ca0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:30.402533 (+419380us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:30.402589 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:30.402634 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.598694 (+2196060us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54002ddf54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:32.604827 (+  6133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.620907 (+ 16080us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29674,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":101064,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":2603,"spinlock_wait_cycles":462420480,"thread_start_us":907354,"threads_started":2,"wal-append.queue_time_us":331584,"wal-append.run_cpu_time_us":2747,"wal-append.run_wall_time_us":1894997}
I20260709 12:58:32.667326  1719 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:32.669332  5378 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:32.632625  5015 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:32.665868  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:32.689095  1716 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:32.695894  5367 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:32.696547  5180 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.696024  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1763) took 1055 ms. Trace:
I20260709 12:58:32.633076  5340 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:58:32.632422  5245 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:32.701421  1721 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:32.671375  5156 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.697278  1712 rpcz_store.cc:276] 0709 12:58:31.615951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.621366 (+  5415us) service_pool.cc:224] Handling call
0709 12:58:31.621941 (+   575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.622826 (+   885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.622871 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.623567 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.749613 (+126046us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:31.749645 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.749692 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:32.671282 (+921590us) raft_consensus.cc:1685] finished
0709 12:58:32.671308 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.671440 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6730,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"thread_start_us":116325,"threads_started":1,"wal-append.queue_time_us":962677}
I20260709 12:58:32.648241  5035 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:58:32.708076  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 69656.5us
I20260709 12:58:32.714661  5245 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:32.716274  1568 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:58:32.702875  5310 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:32.744987  1721 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:32.757455  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 48461.7us
I20260709 12:58:32.718806  5201 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.739048  5357 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.748502  5234 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:32.769747  1717 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:32.771746  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 58295.8us
I20260709 12:58:32.773737  1686 leader_election.cc:400] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11.
I20260709 12:58:32.774192  5015 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:32.766860  5145 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.777688  5158 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.779388  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:32.780686  1684 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:32.782254  5310 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:32.782851  5310 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:32.784857  5340 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:32.786087  5340 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:32.786375  5066 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:32.786459  5340 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:32.787020  5066 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:32.787601  5340 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.790623  5136 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.774051  1686 leader_election.cc:403] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:58:32.773865  5203 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.788020  5066 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.749641  5156 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:58:32.799640  1568 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:58:32.799836  5357 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.800143  1568 pending_rounds.cc:85] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 7
I20260709 12:58:32.800503  1568 pending_rounds.cc:107] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:58:32.801065  1568 raft_consensus.cc:2889] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:32.807801  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:32.808873  1647 raft_consensus.cc:2410] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:32.815793  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:32.820343  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:32.821162  1640 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:32.821967  1721 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:32.822407  5249 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:32.822974  5249 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:32.823822  1721 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:58:32.759342  5312 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:58:32.831154  1568 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:32.784083  5310 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:32.800463  5357 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:32.853140  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 60094.4us
I20260709 12:58:32.860005  1640 raft_consensus.cc:2410] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:32.848412  5340 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:32.865319  1565 raft_consensus.cc:2410] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:58:32.866372  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:32.867158  1640 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:32.851974  5249 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:32.871749  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:32.861202  5116 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:32.876358  1537 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:32.878407  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:32.887454  1647 raft_consensus.cc:2410] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:58:32.883733  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 414653us
W20260709 12:58:32.889421  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.882081  5156 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:32.894073  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:32.890264  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:32.877210  5245 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:32.905815  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:32.908771  2312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.018s	sys 0.053s
W20260709 12:58:32.909125  2312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.018s	sys 0.053s
W20260709 12:58:32.909924  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:32.896252  5156 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:32.912850  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:32.916842  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:32.941179  1647 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:32.983079  1643 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.032s	sys 0.067s
W20260709 12:58:32.984683  1643 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.032s	sys 0.067s
I20260709 12:58:32.938439  5156 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:32.958051  5219 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.003334  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:33.003628  5365 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:33.004074  5365 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:33.003911  1640 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:33.004815  5365 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.010993  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:33.012140  1640 raft_consensus.cc:2393] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:33.013360  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:33.014322  1640 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:33.015545  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:33.016245  1640 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:33.017102  5136 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.017627  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:33.018337  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:33.018657  1640 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.023746  5357 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:33.025730  5312 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11.
I20260709 12:58:33.018360  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:33.028816  5378 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:33.028965  5380 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:33.029569  5380 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:33.006142  1566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2007) took 1485 ms (client timeout 1698 ms). Trace:
W20260709 12:58:33.030516  1566 rpcz_store.cc:269] 0709 12:58:31.521422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.545251 (+ 23829us) service_pool.cc:224] Handling call
0709 12:58:33.005934 (+1460683us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54002bfcd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:33.006061 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876019584}
I20260709 12:58:33.029532  5378 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:33.031404  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:33.033160  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:33.033627  5397 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:58:33.034346  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:33.034821  5397 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:33.034951  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:33.035349  5397 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.035531  5393 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.035801  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:33.036262  5396 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:33.036103  5393 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:33.036706  5396 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:33.037633  5378 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:33.037693  5396 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:33.038404  5393 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:33.039208  5396 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:33.040115  5380 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:33.018610  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:33.005728  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:33.019150  2342 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:33.017843  2346 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:58:33.055995  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 53674.5us
W20260709 12:58:33.056917  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.028445  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:33.035816  5397 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:33.068042  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:33.075682  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 47308.6us
I20260709 12:58:32.937767  5245 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:33.097271  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:33.101773  1535 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:33.102922  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:33.113333  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:33.114252  2340 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:33.017750  5136 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:33.124251  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:33.125398  1641 raft_consensus.cc:2393] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:33.123625  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:33.115157  5318 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:33.110422  5301 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:33.120139  1459 maintenance_manager.cc:419] P ab5bd50f45be44c4afe02e363e8322ae: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033369
I20260709 12:58:33.077759  5219 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:33.116228  5382 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:33.077508  5015 consensus_queue.cc:1059] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:58:33.120702  5145 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:33.144884  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:33.149884  1641 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.153308  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1773) took 1592 ms. Trace:
I20260709 12:58:33.153774  1644 rpcz_store.cc:276] 0709 12:58:31.560797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.350682 (+789885us) service_pool.cc:224] Handling call
0709 12:58:32.351023 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.431698 (+ 80675us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:32.889687 (+457989us) log.cc:844] Serialized 14 byte log entry
0709 12:58:33.152916 (+263229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:33.153029 (+   113us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:33.153079 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.153141 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.153251 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":563693,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":37,"thread_start_us":584849,"threads_started":2}
I20260709 12:58:33.161844  1640 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:33.177196  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:33.177887  1644 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:33.179090  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 55562.2us
I20260709 12:58:33.145566  5357 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:33.180044  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:33.149634  5301 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:33.188845  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:33.152938  5145 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:33.198531  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:33.187574  5380 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:33.236708  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 463176us
W20260709 12:58:33.237955  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44077.6us
I20260709 12:58:33.235702  1645 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:33.199010  5145 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:33.229549  5303 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:33.255434  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:33.238313  5380 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.229965  5264 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:58:33.254101  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:33.274546  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1769) took 1466 ms. Trace:
I20260709 12:58:33.275301  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:33.276875  5413 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:58:33.277283  5245 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:33.278757  5413 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:33.280278  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:33.285301  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:33.285881  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.251974  5357 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:33.288509  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 127680us
I20260709 12:58:33.289436  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1753) took 3280 ms. Trace:
W20260709 12:58:33.303596  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.303730  1644 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:33.259235  5380 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:33.313946  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 327730us
I20260709 12:58:33.317117  1641 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:33.316156  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:33.326750  5315 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:33.331784  5136 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:33.339468  5405 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:58:33.173844  5382 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:33.259855  5303 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:33.290763  5357 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.339401  5365 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:33.616979  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 235575us
I20260709 12:58:34.017041  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:33.722184  5380 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:33.349617  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1776) took 1041 ms. Trace:
I20260709 12:58:34.018275  1642 rpcz_store.cc:276] 0709 12:58:32.308531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.380406 (+ 71875us) service_pool.cc:224] Handling call
0709 12:58:32.401090 (+ 20684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.568508 (+167418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.349312 (+780804us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001c4654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:33.349557 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329348352}
I20260709 12:58:34.019450  5380 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:33.738312  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:33.356813  1641 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:33.358289  5301 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.021497  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:34.022019  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1790) took 1215 ms. Trace:
W20260709 12:58:33.715454  5397 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.000s
I20260709 12:58:34.022573  1641 rpcz_store.cc:276] 0709 12:58:32.806813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.318177 (+511364us) service_pool.cc:224] Handling call
0709 12:58:33.349575 (+ 31398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.021589 (+672014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.021954 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:34.022876  5397 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:33.377032  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:33.775643  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:33.406963  5395 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.618s
W20260709 12:58:33.551878  5156 consensus_meta.cc:287] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:58:34.025717  5156 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.026050  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:33.362906  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.027422  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:34.027886  5156 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.029001  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:33.405745  1647 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
W20260709 12:58:33.341037  5404 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:58:34.030030  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1793) took 1201 ms. Trace:
I20260709 12:58:33.297585  1643 rpcz_store.cc:276] 0709 12:58:30.008990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.356515 (+347525us) service_pool.cc:224] Handling call
0709 12:58:30.357149 (+   634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:30.358747 (+  1598us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:30.436759 (+ 78012us) log.cc:844] Serialized 14 byte log entry
0709 12:58:32.989819 (+2553060us) log.cc:844] Serialized 14 byte log entry
0709 12:58:33.235500 (+245681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:33.239806 (+  4306us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:33.244373 (+  4567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.257136 (+ 12763us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.289374 (+ 32238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25814,"prepare.queue_time_us":1090708,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":269390,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":10688,"thread_start_us":2674941,"threads_started":4,"wal-append.queue_time_us":865874,"wal-append.run_cpu_time_us":9375,"wal-append.run_wall_time_us":1373285}
I20260709 12:58:34.030462  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:33.795539  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:33.883767  5245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.026s	sys 0.068s
I20260709 12:58:34.015697  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:34.032063  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 469) took 1516 ms. Trace:
W20260709 12:58:33.996125  5318 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.000s
W20260709 12:58:33.771083  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.786934  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:33.675631  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:34.066663  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:34.032920  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 674017us
W20260709 12:58:34.067111  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.032922  5357 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.776295  1566 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:58:33.450788  1719 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:34.068290  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1781) took 1051 ms. Trace:
I20260709 12:58:34.030460  1647 rpcz_store.cc:276] 0709 12:58:32.828679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.893556 (+ 64877us) service_pool.cc:224] Handling call
0709 12:58:34.029941 (+1136385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:34.068523  1719 rpcz_store.cc:276] 0709 12:58:33.016893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.446762 (+429869us) service_pool.cc:224] Handling call
0709 12:58:33.450286 (+  3524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.068055 (+617769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.068233 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:33.297591  5015 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.358112  5219 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.022128  1572 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:34.026752  1568 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
W20260709 12:58:34.039021  5393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.012s
I20260709 12:58:33.409942  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:34.061029  1644 raft_consensus.cc:2410] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:34.086928  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1789) took 1280 ms. Trace:
I20260709 12:58:34.087299  1644 rpcz_store.cc:276] 0709 12:58:32.806492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.304430 (+497938us) service_pool.cc:224] Handling call
0709 12:58:34.086856 (+782426us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:34.059445  5245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.029s	sys 0.072s
I20260709 12:58:33.775914  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:34.059813  1712 rpcz_store.cc:276] 0709 12:58:32.515851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.715020 (+199169us) service_pool.cc:224] Handling call
0709 12:58:32.715351 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:32.740009 (+ 24658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.740053 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:32.766424 (+ 26371us) log.cc:844] Serialized 26 byte log entry
0709 12:58:33.126417 (+359993us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:33.126493 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.126584 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.031796 (+905212us) raft_consensus.cc:1685] finished
0709 12:58:34.031820 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.031996 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20761,"raft.queue_time_us":24406,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":8536,"thread_start_us":349238,"threads_started":1,"wal-append.queue_time_us":449196}
I20260709 12:58:34.029321  5365 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:34.040719  5035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.011s	sys 0.025s
W20260709 12:58:34.073808  5396 consensus_meta.cc:287] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.026s	user 0.013s	sys 0.004s
I20260709 12:58:33.356284  5382 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:34.080226  1721 raft_consensus.cc:2393] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:34.043769  5156 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.090108  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:34.107654  1568 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:33.551403  5201 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.092672  1571 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:34.097867  2347 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 12:58:34.103483  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:34.105149  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:34.086272  5393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.006s	sys 0.012s
I20260709 12:58:34.111310  1644 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:58:34.112496  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:34.095042  5413 consensus_meta.cc:287] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.816s	user 0.006s	sys 0.005s
I20260709 12:58:34.087659  5426 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.117784  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:34.087158  5318 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:34.130998  1568 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:58:34.101925  5035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.011s	sys 0.026s
I20260709 12:58:34.080565  5380 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.132561  1564 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:34.132937  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:34.133052  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1760) took 2520 ms (client timeout 3352 ms). Trace:
W20260709 12:58:34.114153  5145 consensus_meta.cc:287] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.002s
I20260709 12:58:34.117542  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:34.136999  1569 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:34.088737  5015 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:34.137537  1720 rpcz_store.cc:269] 0709 12:58:31.608461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.609826 (+  1365us) service_pool.cc:224] Handling call
0709 12:58:34.128581 (+2518755us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54002df854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:34.128710 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886912384}
I20260709 12:58:34.138209  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:34.143199  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:34.115882  5382 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.144081  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:34.149401  5145 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.150605  1720 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:34.145906  1712 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:34.147728  1647 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:34.147740  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 72621.9us
I20260709 12:58:34.144635  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:34.135924  5413 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:34.141234  5431 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.120227  5156 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.165472  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.145458  5435 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:34.145253  5397 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.166395  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:34.164880  1719 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:34.168150  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.151553  5145 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.130872  5201 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.170749  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.141363  5426 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.178359  1686 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:34.166749  5393 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:34.183171  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:34.183807  2347 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:34.171487  5301 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:58:34.179946  5383 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.814s	user 0.003s	sys 0.017s
I20260709 12:58:34.173301  5432 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:34.180434  5318 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:34.223505  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 52161us
I20260709 12:58:33.275184  1715 rpcz_store.cc:276] 0709 12:58:31.707369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.450915 (+743546us) service_pool.cc:224] Handling call
0709 12:58:32.451233 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.451662 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:32.931045 (+479383us) log.cc:844] Serialized 14 byte log entry
0709 12:58:33.173530 (+242485us) log.cc:844] Serialized 14 byte log entry
0709 12:58:33.173720 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:33.173759 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:33.173814 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.173874 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.174011 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8297,"prepare.queue_time_us":63877,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":56,"raft.queue_time_us":32967,"spinlock_wait_cycles":61672576,"thread_start_us":620381,"threads_started":2,"wal-append.queue_time_us":307273}
I20260709 12:58:34.224469  1721 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:58:34.226750  5419 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.946s	user 0.012s	sys 0.005s
I20260709 12:58:34.249794  2347 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:34.229748  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:34.221939  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 2149) took 3757 ms. Trace:
I20260709 12:58:34.161863  5382 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.169255  5380 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.264624  5380 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.182147  5219 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.182994  5145 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:34.227916  5421 log.cc:927] Time spent T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.951s	user 0.001s	sys 0.014s
I20260709 12:58:34.169382  5431 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.266063  1572 raft_consensus.cc:2410] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:58:34.253518  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 236597us
I20260709 12:58:34.231448  5435 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:34.260528  1714 rpcz_store.cc:276] 0709 12:58:30.464735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.540910 (+ 76175us) service_pool.cc:224] Handling call
0709 12:58:30.541237 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.541462 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.541488 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:30.563648 (+ 22160us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.794557 (+1230909us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:31.794628 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.794707 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.166483 (+2371776us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:34.221622 (+ 55139us) raft_consensus.cc:1685] finished
0709 12:58:34.221640 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.221858 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16187136,"thread_start_us":1230401,"threads_started":1,"wal-append.queue_time_us":1439579}
I20260709 12:58:34.230696  5301 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:34.274536  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 103885us
I20260709 12:58:34.279351  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:34.280227  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:34.231995  5432 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:34.288968  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:34.194931  5393 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.297639  5435 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:34.309127  5435 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.271730  5219 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.294395  5432 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:34.315295  5430 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:58:34.316382  5436 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:58:34.266038  5318 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.304865  5035 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:34.320232  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:34.320443  5035 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.276289  5438 raft_consensus.cc:2764] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:34.276137  5145 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:34.323274  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:34.327898  1714 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:34.328445  5035 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:34.331137  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:34.327086  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.295954  5365 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:34.297082  5440 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.361039  5301 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.375707  5438 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.377457  5440 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.377800  5438 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:34.392561  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 297197us
I20260709 12:58:34.375952  5413 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:34.444432  5431 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.444882  5438 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.445245  5431 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.445837  5431 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.446583  5440 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.450628  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1797) took 1580 ms. Trace:
I20260709 12:58:34.451154  1642 rpcz_store.cc:276] 0709 12:58:32.870745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.019969 (+1149224us) service_pool.cc:224] Handling call
0709 12:58:34.020310 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:34.064214 (+ 43904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.064258 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:34.102317 (+ 38059us) log.cc:844] Serialized 26 byte log entry
0709 12:58:34.271192 (+168875us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:34.271258 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.271329 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.450367 (+179038us) raft_consensus.cc:1685] finished
0709 12:58:34.450387 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.450543 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38654,"raft.queue_time_us":67833,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":15380,"thread_start_us":126654,"threads_started":1,"wal-append.queue_time_us":247878}
W20260709 12:58:34.453097  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:34.457412  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 167893us
W20260709 12:58:34.460224  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 80692.1us
I20260709 12:58:34.469477  5444 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:34.470196  5444 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.434151  5393 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.459802  5318 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.456930  5156 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.479586  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1798) took 1603 ms. Trace:
W20260709 12:58:34.479773  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 1.06986e+06us
I20260709 12:58:34.459565  5201 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.491724  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:34.457836  5426 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.490257  1641 rpcz_store.cc:276] 0709 12:58:32.876249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.023577 (+1147328us) service_pool.cc:224] Handling call
0709 12:58:34.023965 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.024157 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:34.097226 (+ 73069us) log.cc:844] Serialized 14 byte log entry
0709 12:58:34.479171 (+381945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:34.479231 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:34.479289 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.479374 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.479516 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130393,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":3375,"raft.queue_time_us":531,"thread_start_us":454243,"threads_started":2}
W20260709 12:58:34.494397  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.489102  5219 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.497406  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:34.498339  2347 raft_consensus.cc:2393] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 5: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:34.499094  1642 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:34.499400  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1770) took 2791 ms. Trace:
I20260709 12:58:34.499759  1717 rpcz_store.cc:276] 0709 12:58:31.707788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.493050 (+785262us) service_pool.cc:224] Handling call
0709 12:58:32.493499 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.770247 (+276748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.499164 (+1728917us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002774d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:34.499331 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611827456}
I20260709 12:58:34.476042  5444 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.507263  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 523) took 1187 ms. Trace:
I20260709 12:58:34.511587  1644 rpcz_store.cc:276] 0709 12:58:33.319624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.174223 (+854599us) service_pool.cc:224] Handling call
0709 12:58:34.180274 (+  6051us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:34.197776 (+ 17502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.197816 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:34.222737 (+ 24921us) log.cc:844] Serialized 26 byte log entry
0709 12:58:34.452215 (+229478us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:34.452262 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.452345 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.507062 (+ 54717us) raft_consensus.cc:1685] finished
0709 12:58:34.507083 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.507204 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10663,"raft.queue_time_us":755,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":14187,"thread_start_us":75716,"threads_started":1,"wal-append.queue_time_us":279553}
I20260709 12:58:34.513506  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:34.514606  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:34.515278  1644 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:34.516001  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:34.465667  5413 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:34.513520  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44262us
I20260709 12:58:34.518075  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1799) took 1631 ms. Trace:
I20260709 12:58:34.516584  1644 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:34.518549  1643 rpcz_store.cc:276] 0709 12:58:32.886594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.031078 (+1144484us) service_pool.cc:224] Handling call
0709 12:58:34.031400 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:34.218808 (+187408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.218848 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:34.265940 (+ 47092us) log.cc:844] Serialized 26 byte log entry
0709 12:58:34.472916 (+206976us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:34.472954 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.473024 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.515768 (+ 42744us) raft_consensus.cc:1685] finished
0709 12:58:34.515939 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.518014 (+  2075us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27819,"raft.queue_time_us":86467,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":4725,"thread_start_us":325443,"threads_started":2,"wal-append.queue_time_us":234589}
I20260709 12:58:34.519925  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:34.507892  5411 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:58:34.520538  1568 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:34.521929  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:34.522583  1644 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:34.498739  5241 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:34.493973  5380 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:34.524015  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:34.524610  1643 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:34.525038  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.537635  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:34.538902  1568 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:34.539559  1572 raft_consensus.cc:1240] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:34.540321  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:34.511818  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 231621us
I20260709 12:58:34.539299  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:34.546545  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:34.546835  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 172413us
I20260709 12:58:34.548044  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:34.560228  1715 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:34.559957  1717 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:34.529717  5219 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.548596  1716 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
W20260709 12:58:34.583676  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.586949  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:34.590188  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.594779  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:34.595698  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:34.596292  2343 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:58:34.568295  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2135545940000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260709 12:58:34.540779  5365 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:34.490852  5145 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:58:34.601728  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2117545940000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 12:58:34.604743  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1937545940000405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
I20260709 12:58:34.570951  5393 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:34.602556  2347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:34.626220  2347 raft_consensus.cc:606] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:34.626659  2347 raft_consensus.cc:614] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:34.627456  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0716440649999868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.40240000000000004s for a response
I20260709 12:58:34.627615  1642 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
W20260709 12:58:34.606063  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 82331.3us
I20260709 12:58:34.608915  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:34.609771  5443 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:34.610167  5450 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:58:34.604775  5116 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.633095  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:34.611613  1712 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:34.615721  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:34.618029  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.591394  5440 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:34.622193  1644 raft_consensus.cc:2410] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:34.622877  5219 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.534801  5380 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:34.627877  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0029545940000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 12:58:34.640077  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:34.640239  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:34.629268  1719 raft_consensus.cc:2393] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:34.566670  5201 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:58:34.640725  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:34.643455  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:34.625398  5382 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:34.596580  5411 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:58:34.647737  5434 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:58:34.651135  5453 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:34.652204  5453 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:34.626745  5156 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:34.655663  1644 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:34.625932  5393 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:34.658794  1684 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.656260  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.648094  5035 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.669852  1642 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:34.671218  1643 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:34.672068  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.674885  1641 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:34.676853  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.675879  5397 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:34.653652  5431 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.643975  5444 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.708719  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:34.657676  5435 consensus_queue.cc:1059] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:58:34.701704  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.707693  1714 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:34.659130  5318 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:34.706204  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:34.709324  1643 raft_consensus.cc:2376] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9. Re-sending same reply.
I20260709 12:58:34.715538  1644 raft_consensus.cc:2393] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:34.638127  5116 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.723886  5116 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.702674  5411 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:34.704991  5396 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.731103  1641 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:34.721884  5219 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.718950  5469 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:34.725348  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:34.727669  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 103011us
W20260709 12:58:34.719923  5463 log.cc:927] Time spent T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:58:34.648463  5445 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:58:34.705549  5434 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:34.710218  5397 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.672271  5440 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.732501  1684 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:34.733512  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 50381.4us
I20260709 12:58:34.642132  5443 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.736618  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.739434  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:34.758447  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 117850us
I20260709 12:58:34.761737  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:34.762984  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1790) took 1044 ms. Trace:
I20260709 12:58:34.734380  5396 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.769289  5439 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:34.769855  5439 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.770212  5439 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:34.771135  5450 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:34.771634  5450 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:34.769414  5431 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.737871  5318 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:34.736068  5469 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:34.714063  5444 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:34.763418  1720 rpcz_store.cc:276] 0709 12:58:33.718461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.169087 (+450626us) service_pool.cc:224] Handling call
0709 12:58:34.182654 (+ 13567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:34.278734 (+ 96080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.278779 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:34.296415 (+ 17636us) log.cc:844] Serialized 26 byte log entry
0709 12:58:34.465977 (+169562us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:34.466025 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.466110 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:34.762780 (+296670us) raft_consensus.cc:1685] finished
0709 12:58:34.762799 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:34.762929 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1221,"raft.queue_time_us":89968,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":18610,"thread_start_us":197996,"threads_started":2,"wal-append.queue_time_us":204229}
I20260709 12:58:34.739749  5219 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:34.757284  5397 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:34.807533  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:34.808177  2347 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
W20260709 12:58:34.808518  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 165127us
I20260709 12:58:34.805099  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:34.738489  5434 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:34.804011  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 90554.2us
I20260709 12:58:34.724900  5365 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.809968  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:34.818845  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.973165  1643 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:34.975461  1572 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:34.857825  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:35.014204  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.762935  5201 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:34.740311  5393 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:34.992712  2345 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
W20260709 12:58:35.065546  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 91878.2us
I20260709 12:58:34.769333  5396 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:35.066876  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 334441us
I20260709 12:58:34.806504  5219 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:34.857503  5461 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:58:35.067523  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:34.971693  5357 consensus_meta.cc:287] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.865s	user 0.004s	sys 0.008s
I20260709 12:58:34.800503  5469 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:34.807811  5413 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:34.945708  5380 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:34.984422  5434 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:34.842221  5156 raft_consensus.cc:697] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:35.064889  5201 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.157963  5201 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:35.158550  5465 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.396s	user 0.000s	sys 0.001s
I20260709 12:58:35.137568  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:35.149423  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.153213  5454 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.351s	user 0.001s	sys 0.001s
W20260709 12:58:35.154575  5468 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 12:58:35.155198  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:35.117723  5219 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:35.066293  5473 raft_consensus.cc:2764] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:35.159897  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1802) took 2172 ms. Trace:
I20260709 12:58:35.162550  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.153756  5472 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:35.168957  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 435917us
I20260709 12:58:34.945987  5431 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:35.176700  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 59181.8us
I20260709 12:58:35.177232  5440 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.177564  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:35.176160  5438 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:35.178319  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:35.178923  1643 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:35.179828  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.171209  1638 rpcz_store.cc:276] 0709 12:58:32.987273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.035891 (+1048618us) service_pool.cc:224] Handling call
0709 12:58:34.036264 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:34.221690 (+185426us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b4800112758. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
0709 12:58:34.274834 (+ 53144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:34.274883 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:34.290922 (+ 16039us) log.cc:844] Serialized 52 byte log entry
0709 12:58:34.601691 (+310769us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:34.601745 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:34.601834 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:35.159556 (+557722us) raft_consensus.cc:1685] finished
0709 12:58:35.159578 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.159830 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83966,"raft.queue_time_us":92145,"raft.run_cpu_time_us":881,"raft.run_wall_time_us":90793,"spinlock_wait_cycles":3581184,"thread_start_us":496941,"threads_started":2,"wal-append.queue_time_us":420926}
I20260709 12:58:35.162320  5035 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.193732  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.196379  1643 raft_consensus.cc:2410] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:35.188747  1646 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
W20260709 12:58:35.115851  1684 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33881 timed out after 2.336s (SENT) [suppressed 17 similar messages]
W20260709 12:58:35.201942  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 86118.6us
I20260709 12:58:35.191469  5380 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:35.152978  5475 consensus_queue.cc:1059] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:58:35.216068  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:35.152685  5470 consensus_queue.cc:1059] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:58:35.217423  5470 raft_consensus.cc:3055] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:35.217736  5470 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:35.152314  5471 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.253s
I20260709 12:58:35.218029  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1890) took 1036 ms. Trace:
I20260709 12:58:35.218420  1641 rpcz_store.cc:276] 0709 12:58:34.184874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.586605 (+401731us) service_pool.cc:224] Handling call
0709 12:58:35.217854 (+631249us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b54001e32d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:35.217969 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200277888}
I20260709 12:58:35.206401  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.219460  1646 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 5.
I20260709 12:58:35.219709  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.207758  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.202908  1572 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:35.214514  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:35.215065  5477 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:35.195056  5472 raft_consensus.cc:697] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:35.176191  5451 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:35.220270  1641 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:35.220768  2345 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 6.
I20260709 12:58:35.221750  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2032) took 1391 ms. Trace:
I20260709 12:58:35.205827  5380 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.126760  5450 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.128803  5357 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.264205  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:35.264989  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1887) took 1085 ms. Trace:
I20260709 12:58:35.294554  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:35.344901  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:35.393385  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.409228  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 231762us
I20260709 12:58:35.410383  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:35.242623  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.256803  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:35.410626  1643 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
W20260709 12:58:35.223412  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 299944us
I20260709 12:58:35.378319  1571 rpcz_store.cc:276] 0709 12:58:33.830040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.117401 (+287361us) service_pool.cc:224] Handling call
0709 12:58:35.215909 (+1098508us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:58:35.221677 (+  5768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4208384}
I20260709 12:58:35.411423  1646 raft_consensus.cc:2376] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9. Re-sending same reply.
I20260709 12:58:35.348658  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:35.352391  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:35.415925  1721 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:35.409198  1638 rpcz_store.cc:276] 0709 12:58:34.179313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.195483 (+1016170us) service_pool.cc:224] Handling call
0709 12:58:35.264894 (+ 69411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.409324  1572 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 5.
W20260709 12:58:35.419843  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 163184us
W20260709 12:58:35.281340  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 48247.9us
W20260709 12:58:35.359175  5432 consensus_meta.cc:287] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.044s	user 0.010s	sys 0.003s
I20260709 12:58:35.423348  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.423666  1645 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:58:35.423804  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 297783us
I20260709 12:58:35.424012  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.425437  1646 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:58:35.425802  1641 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:35.347321  5395 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:35.309034  5426 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.426012  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:35.409003  5380 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:35.327229  5444 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.313138  5035 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.330372  5431 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.432919  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 1895) took 1141 ms. Trace:
I20260709 12:58:35.435819  1646 rpcz_store.cc:276] 0709 12:58:34.291508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.414022 (+1122514us) service_pool.cc:224] Handling call
0709 12:58:35.432861 (+ 18839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.433133  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:35.354476  5241 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:35.434505  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:35.438609  1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.005s
W20260709 12:58:35.440740  1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.011s	sys 0.005s
W20260709 12:58:35.428733  5382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.008s	sys 0.016s
W20260709 12:58:35.446650  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.447894  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1805) took 1270 ms. Trace:
I20260709 12:58:35.448266  1643 rpcz_store.cc:276] 0709 12:58:34.177099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.430534 (+1253435us) service_pool.cc:224] Handling call
0709 12:58:35.447424 (+ 16890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.447596 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:35.447621 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.447660 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:35.447695 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.447754 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.447844 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.439025  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1806) took 1261 ms. Trace:
I20260709 12:58:35.419317  5477 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:35.429625  5395 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:35.449512  1646 rpcz_store.cc:276] 0709 12:58:34.177332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.436552 (+1259220us) service_pool.cc:224] Handling call
0709 12:58:35.438499 (+  1947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.438675 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:35.438703 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.438747 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:35.438781 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.438837 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.438935 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.429328  5312 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:35.352219  5397 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.428930  5445 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:35.464322  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:35.465406  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:35.466264  5440 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:35.466447  1684 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:35.466643  5440 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:35.467032  5440 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:35.468057  5473 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:35.469000  5413 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:35.469435  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1803) took 1293 ms. Trace:
I20260709 12:58:35.469877  1641 rpcz_store.cc:276] 0709 12:58:34.176505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.430408 (+1253903us) service_pool.cc:224] Handling call
0709 12:58:35.430689 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.430863 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:35.461583 (+ 30720us) log.cc:844] Serialized 14 byte log entry
0709 12:58:35.469053 (+  7470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.469099 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:35.469142 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.469214 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.469361 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"thread_start_us":23148,"threads_started":2}
I20260709 12:58:35.471900  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:35.473156  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:35.473893  1571 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
W20260709 12:58:35.451128  5382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.008s	sys 0.016s
I20260709 12:58:35.450855  5318 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.486581  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1885) took 1308 ms. Trace:
I20260709 12:58:35.450469  5479 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.488591  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1780) took 3113 ms. Trace:
I20260709 12:58:35.490415  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.495276  1641 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:35.417910  5451 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.445899  5438 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.436688  5482 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:35.492007  1643 rpcz_store.cc:276] 0709 12:58:34.177771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.449157 (+1271386us) service_pool.cc:224] Handling call
0709 12:58:35.477511 (+ 28354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.486258 (+  8747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:35.486283 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:35.486325 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:35.486357 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.486418 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.486525 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.445520  5241 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:35.349114  5470 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.520982  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:35.351317  5303 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.503293  1638 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:35.425405  5432 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.485625   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:58:35.409348  5156 consensus_queue.cc:237] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.506325  1720 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:35.498747  5015 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.451005  5035 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.483856  5483 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:35.514698  1612 leader_election.cc:336] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.698s (SENT)
I20260709 12:58:35.494796  1639 rpcz_store.cc:276] 0709 12:58:32.375175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.489960 (+114785us) service_pool.cc:224] Handling call
0709 12:58:32.490540 (+   580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:32.529860 (+ 39320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.529889 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:32.530479 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:58:32.898508 (+368029us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:32.898565 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.488220 (+2589655us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54003c69d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:35.488264 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:35.488308 (+    44us) raft_consensus.cc:1685] finished
0709 12:58:35.488318 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.488534 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11360,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":13152,"spinlock_wait_cycles":72028928,"thread_start_us":367561,"threads_started":1,"wal-append.queue_time_us":488820,"wal-append.run_cpu_time_us":1850,"wal-append.run_wall_time_us":1003217}
I20260709 12:58:35.460246  5426 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.519476  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 2019) took 3015 ms. Trace:
I20260709 12:58:35.532722  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 525) took 2212 ms. Trace:
W20260709 12:58:35.549263  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.554792  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.552564  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:35.554358  1638 rpcz_store.cc:276] 0709 12:58:33.320200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.420416 (+2100216us) service_pool.cc:224] Handling call
0709 12:58:35.499865 (+ 79449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.532458 (+ 32593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.532668 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.496845  5318 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.566672  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:35.568111  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52711.4us
I20260709 12:58:35.521092  5245 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:58:35.576090  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 61414.8us
W20260709 12:58:35.576911  1612 leader_election.cc:336] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.747s (SENT)
I20260709 12:58:35.577453  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:35.579407  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.485893  5445 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.525532  5438 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.564958  5470 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:35.605163  1612 leader_election.cc:336] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.768s (SENT)
I20260709 12:58:35.605674  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:35.553761  1570 rpcz_store.cc:276] 0709 12:58:32.504278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.504887 (+   609us) service_pool.cc:224] Handling call
0709 12:58:32.505284 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:32.505639 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.505676 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:32.506264 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:58:33.053914 (+547650us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:33.232077 (+178163us) log.cc:844] Serialized 14 byte log entry
0709 12:58:35.518937 (+2286860us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b180022bb20. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287
0709 12:58:35.519079 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.519155 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:35.519195 (+    40us) raft_consensus.cc:1685] finished
0709 12:58:35.519282 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.519402 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":226131,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":62891,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":351473,"spinlock_wait_cycles":2752768,"thread_start_us":678317,"threads_started":3,"wal-append.queue_time_us":637807,"wal-append.run_cpu_time_us":43187,"wal-append.run_wall_time_us":1917387}
I20260709 12:58:35.575845  5477 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.504451  5479 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:35.610729  5479 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.611241  5479 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:35.611706  5479 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.578434  5444 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:35.612830  1646 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:35.614380  5432 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.551395  5395 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.616492  5496 consensus_queue.cc:1059] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:58:35.617321  5488 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:58:35.619342  1721 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:35.619870  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1797) took 1345 ms. Trace:
I20260709 12:58:35.620213  1721 rpcz_store.cc:276] 0709 12:58:34.274197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.352105 (+1077908us) service_pool.cc:224] Handling call
0709 12:58:35.619813 (+267708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.575845  5473 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:35.630045  1612 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.858s (SENT)
I20260709 12:58:35.636898  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:35.634784  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 537) took 3086 ms. Trace:
I20260709 12:58:35.637651  1567 rpcz_store.cc:276] 0709 12:58:32.548043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.567410 (+ 19367us) service_pool.cc:224] Handling call
0709 12:58:32.571939 (+  4529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.671587 (+ 99648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:32.671628 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:32.671678 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:32.689617 (+ 17939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.634511 (+2944894us) spinlock_profiling.cc:243] Waited 77.4 ms on lock 0x7b54002be654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:35.634571 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.634715 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178031360}
I20260709 12:58:35.582149  5367 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:35.632246  5451 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.627942  5444 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:35.617684  5496 raft_consensus.cc:3055] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:35.582542  5471 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:35.654433  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:35.655431  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:35.654804  2348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 486) took 2359 ms. Trace:
I20260709 12:58:35.622323  5487 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:35.640782  5396 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.607425  5245 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:35.662748  5494 log.cc:927] Time spent T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 12:58:35.663556  5486 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:58:35.637298  5357 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.662333  5495 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.659672  2348 rpcz_store.cc:276] 0709 12:58:33.280762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.296093 (+ 15331us) service_pool.cc:224] Handling call
0709 12:58:33.313634 (+ 17541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:33.321270 (+  7636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:33.321297 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:35.165913 (+1844616us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b2c00021e98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4102da11 00007f6a4103d372 00007f6a4276fa01 00007f6a4273443a 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2
0709 12:58:35.166833 (+   920us) log.cc:844] Serialized 564 byte log entry
0709 12:58:35.428447 (+261614us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:35.428498 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.428588 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:35.632798 (+204210us) raft_consensus.cc:1685] finished
0709 12:58:35.632820 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.640000 (+  7180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43756288,"thread_start_us":255153,"threads_started":1,"wal-append.queue_time_us":322881}
I20260709 12:58:35.664873  5440 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.640600  5367 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:35.515165  5472 consensus_queue.cc:237] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:35.676661  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46635.2us
I20260709 12:58:35.677845  5318 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.678225  1567 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 12:58:35.683436  5469 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.539s	user 0.000s	sys 0.006s
W20260709 12:58:35.684027  1565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 539) took 3018 ms (client timeout 1827 ms). Trace:
W20260709 12:58:35.774716  1565 rpcz_store.cc:269] 0709 12:58:32.665428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.665562 (+   134us) service_pool.cc:224] Handling call
0709 12:58:35.683803 (+3018241us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400093154. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:35.683962 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443075968}
I20260709 12:58:35.678303  5396 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.686368  5438 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:35.689323  1570 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:35.690260  5443 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:35.744753  5434 consensus_meta.cc:287] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.000s
I20260709 12:58:35.658591  5444 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:35.579942  5483 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.637122  5482 consensus_queue.cc:1059] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:58:35.736526  5473 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.775324  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:35.773633  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 155530us
I20260709 12:58:35.655665  5496 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:35.777329  5357 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.789961  5357 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.794494  5357 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.795374  5367 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.779335  5469 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.794090  5496 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:35.811638  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.806469  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.843575  5241 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.798893  5479 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.798228  5483 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.785908  5434 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.845664  5241 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:35.799083  5330 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:35.843935  1641 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:35.846890  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 2039) took 1069 ms. Trace:
W20260709 12:58:35.845793  5219 consensus_meta.cc:287] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.001s
I20260709 12:58:35.847381  1563 rpcz_store.cc:276] 0709 12:58:34.777483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.777627 (+   144us) service_pool.cc:224] Handling call
0709 12:58:34.974594 (+196967us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:35.114890 (+140296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:35.114921 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:35.149989 (+ 35068us) log.cc:844] Serialized 52 byte log entry
0709 12:58:35.408003 (+258014us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:35.493307 (+ 85304us) log.cc:844] Serialized 14 byte log entry
0709 12:58:35.493760 (+   453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.493887 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:35.846676 (+352789us) raft_consensus.cc:1685] finished
0709 12:58:35.846697 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:35.846832 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99601,"prepare.queue_time_us":147672,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":158737,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":41878,"thread_start_us":288576,"threads_started":2,"wal-append.queue_time_us":247916}
I20260709 12:58:35.846988  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.849144  5219 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:35.850378  5439 consensus_meta.cc:287] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.080s	user 0.002s	sys 0.006s
I20260709 12:58:35.850790  5439 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.851300  5219 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.852324  1641 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:35.853614  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.848096  5434 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.854097  5469 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:35.859504  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.860080  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.860351  1713 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:35.861565  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.805086  1718 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:58:35.857239  5426 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.859241  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.861726  1721 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:35.863298  1720 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:35.863615  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:35.864439  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.863190  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.788961  5471 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:35.858719  5330 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:35.858596  5501 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:58:35.674146  5487 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.866487  1641 raft_consensus.cc:2410] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:58:35.862418  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:35.800551  5417 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 2.524s	user 0.006s	sys 0.021s
W20260709 12:58:35.877043  5201 consensus_meta.cc:287] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.003s
I20260709 12:58:35.878664  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:35.878062  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 89995.5us
I20260709 12:58:35.792079  5443 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:35.881562  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.801604  5499 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.800714  5396 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.885262  1715 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:35.805884  5440 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:35.886688  1713 raft_consensus.cc:2410] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:35.887671  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:35.893520  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:35.894872  1641 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:35.895385  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1891) took 1710 ms. Trace:
I20260709 12:58:35.895671  1641 rpcz_store.cc:276] 0709 12:58:34.185140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.894332 (+1709192us) service_pool.cc:224] Handling call
0709 12:58:35.894582 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.895166 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.895314 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.796537  5367 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:35.796428  5380 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.899755  1641 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [6.5-9.7]
I20260709 12:58:35.900410  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1894) took 1627 ms. Trace:
I20260709 12:58:35.883389  5312 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:35.888501  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:35.779040  5495 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.880566  5439 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.877257  5426 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.907330  5426 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.909277  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.902293  1720 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:35.889240  5496 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:35.903620  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:35.904551  1719 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:35.880115  5471 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.891974  5499 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.912942  1719 pending_rounds.cc:85] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 4
I20260709 12:58:35.889533  5201 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.914294  1721 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:35.916430  5487 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.918044  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.918738  1640 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:35.918857  5380 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.919903  1640 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:58:35.909384  5426 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:35.910811  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:35.925472  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1808) took 1743 ms (client timeout 2015 ms). Trace:
W20260709 12:58:35.925897  1642 rpcz_store.cc:269] 0709 12:58:34.181944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.628351 (+446407us) service_pool.cc:224] Handling call
0709 12:58:35.925302 (+1296951us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b54001e37d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:35.925414 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83008256}
I20260709 12:58:35.927161  1642 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:35.927708  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1897) took 1614 ms. Trace:
I20260709 12:58:35.920452  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1896) took 1607 ms. Trace:
I20260709 12:58:35.928957  1640 rpcz_store.cc:276] 0709 12:58:34.312906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.919396 (+1606490us) service_pool.cc:224] Handling call
0709 12:58:35.919707 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:35.920230 (+   523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.920395 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:35.936247  1537 connection.cc:256] RPC call timeout handler was delayed by -1.4620674529999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 12:58:35.900804  1641 rpcz_store.cc:276] 0709 12:58:34.273301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.896391 (+1623090us) service_pool.cc:224] Handling call
0709 12:58:35.899502 (+  3111us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:58:35.900180 (+   678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.900367 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.913200  1719 pending_rounds.cc:107] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:35.938369  1719 raft_consensus.cc:2889] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:35.910008  1713 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:35.940277  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.942183  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.942711  1715 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:35.943527  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.941159  1712 raft_consensus.cc:3055] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:35.944784  1712 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:35.945504  1712 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:35.946321  1712 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:35.944514  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.949692  1715 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
W20260709 12:58:35.951259  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.951943  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:35.953102  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.953678  5442 raft_consensus.cc:3055] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:35.953919  1715 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:58:35.954082  5442 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:35.955513  1715 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:35.955053  5442 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:35.956270  5442 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:35.956435  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 520) took 2720 ms. Trace:
I20260709 12:58:35.956843  1647 rpcz_store.cc:276] 0709 12:58:33.235831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.117148 (+881317us) service_pool.cc:224] Handling call
0709 12:58:34.136967 (+ 19819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:34.157715 (+ 20748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.956214 (+1798499us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5400418554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:35.956374 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24328576}
I20260709 12:58:35.958170  1647 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:35.958676  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1900) took 1583 ms. Trace:
I20260709 12:58:35.958966  1647 rpcz_store.cc:276] 0709 12:58:34.375753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.957689 (+1581936us) service_pool.cc:224] Handling call
0709 12:58:35.958010 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.958484 (+   474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.958629 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.960058  1647 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:35.962740  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.965844  1643 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:35.966434  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1903) took 1588 ms. Trace:
I20260709 12:58:35.966697  1643 rpcz_store.cc:276] 0709 12:58:34.377595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.965276 (+1587681us) service_pool.cc:224] Handling call
0709 12:58:35.965554 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.966212 (+   658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.966384 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.967832  1643 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:58:35.968374  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 526) took 1503 ms. Trace:
I20260709 12:58:35.968451  1712 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:35.970760  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1886) took 1792 ms. Trace:
I20260709 12:58:36.016215  1646 rpcz_store.cc:276] 0709 12:58:34.179065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.452194 (+1273129us) service_pool.cc:224] Handling call
0709 12:58:35.484183 (+ 31989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.613248 (+129065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.970543 (+357295us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001b5dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:35.970702 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295393536}
I20260709 12:58:36.016757  1643 rpcz_store.cc:276] 0709 12:58:34.465379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.967359 (+1501980us) service_pool.cc:224] Handling call
0709 12:58:35.967634 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:35.968154 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.968327 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:35.971396  5203 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:35.972824  5466 log.cc:927] Time spent T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 1.248s	user 0.000s	sys 0.002s
I20260709 12:58:35.975664  1715 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:35.976765  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.977408  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.020898  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.986253  5471 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:36.000377  5397 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.992987  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.994943  5499 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:35.995676  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.051919  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:35.996948  5395 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.003667  5245 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:36.006556  5035 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:35.906596  5495 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:35.887017  5330 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.009889  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:36.011024  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:36.014482  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 110945us
I20260709 12:58:35.928004  1642 rpcz_store.cc:276] 0709 12:58:34.313213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.926676 (+1613463us) service_pool.cc:224] Handling call
0709 12:58:35.926970 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.927503 (+   533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.927662 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:36.015619  1537 connection.cc:256] RPC call timeout handler was delayed by -1.4080674529999442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 12:58:36.066939  1537 connection.cc:256] RPC call timeout handler was delayed by -1.3925820409999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3352s for a response
W20260709 12:58:36.067893  1537 connection.cc:256] RPC call timeout handler was delayed by -1.3477335739999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3154s for a response
I20260709 12:58:35.960559  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1901) took 1583 ms. Trace:
I20260709 12:58:36.068820  1647 rpcz_store.cc:276] 0709 12:58:34.376936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.959608 (+1582672us) service_pool.cc:224] Handling call
0709 12:58:35.959882 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.960368 (+   486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.960514 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.028874  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:35.988518  5201 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:36.034229  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.046137  1717 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:36.073350  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.053110  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 528) took 1278 ms. Trace:
I20260709 12:58:36.074102  1643 rpcz_store.cc:276] 0709 12:58:34.774660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.017474 (+1242814us) service_pool.cc:224] Handling call
0709 12:58:36.052566 (+ 35092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.052768 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.052796 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.052837 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:36.052877 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.052927 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.053056 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.056962  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.059729  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.075363  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:36.020052  5203 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:36.073340  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 63524.3us
I20260709 12:58:36.078722  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:36.077239  1537 connection.cc:256] RPC call timeout handler was delayed by -1.2542258849999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 12:58:36.079365  1537 connection.cc:256] RPC call timeout handler was delayed by -1.2154674529999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 12:58:36.087133  1714 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:36.077808  1717 raft_consensus.cc:2393] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 6: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:36.080665  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:36.088872  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.082535  1571 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:36.085927  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.089954  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.090720  1572 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:36.091039  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.091581  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.092257  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:36.093225  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.094226  1565 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:36.094600  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.095156  1717 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:36.062700  1715 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.098363  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.079553  5203 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:36.099079  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.093786  1567 raft_consensus.cc:2376] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9. Re-sending same reply.
I20260709 12:58:36.099520  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:36.101540  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 90592.9us
I20260709 12:58:36.102334  1563 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:36.099181  1720 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:36.104833  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.105098  1570 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:36.078358  5472 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:36.086709  5303 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:36.106300  1566 raft_consensus.cc:2410] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:58:36.100014  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.092178  5495 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:36.109840  1564 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.109973  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:36.113446  1714 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:36.114400  5483 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:36.115696  5481 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:36.116720  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.099581  5241 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.126442  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.097098  5312 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:36.128311  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.137969  1717 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:36.079797  5442 consensus_queue.cc:1059] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:58:36.131299  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.131947  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.136094  1572 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:36.134555  1715 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:36.131892  1535 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:36.086822  5499 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:58:36.139427  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.142313  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:36.143774  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.146369  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.146896  1712 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.127465  5310 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:36.137732  5450 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:36.150398  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.149323  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.150241  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.153594  1570 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.154124  1571 raft_consensus.cc:2410] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:36.154939  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.155433  1571 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:36.137645  5312 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:36.106362  5487 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:58:36.106679  5434 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:58:36.140547  5506 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.288s	user 0.003s	sys 0.000s
I20260709 12:58:36.106547  5473 consensus_queue.cc:1059] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:58:36.137452  5245 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:36.108778  5440 consensus_queue.cc:1059] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:58:36.151118  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.126025  5469 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:58:36.131816  5249 consensus_queue.cc:1059] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:58:36.179890  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:36.176730  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.156211  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.156186  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.196332  1712 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:36.198402  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.156152  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.187366  5312 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.199854  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.200584  1566 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:36.200670  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.201511  1717 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:36.203343  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.204123  1717 raft_consensus.cc:2410] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:36.204386  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.204712  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.205096  1565 raft_consensus.cc:2393] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:36.205407  1712 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:36.202052  1720 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:36.150311  5035 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:36.213991  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.214762  1717 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
W20260709 12:58:36.215283  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.215889  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.216612  1717 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:36.189873  5245 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.150862  5310 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:36.219506  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:36.242650  5511 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:58:36.243726  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.224895  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.244913  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:36.221184  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.228659  1566 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:36.246978  1720 raft_consensus.cc:2410] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:36.243366  5310 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:36.248818  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 135266us
I20260709 12:58:36.251757  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.255892  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.210433  5446 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.271530  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.211798  5035 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.301743  2343 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 11: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
W20260709 12:58:36.304139  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.312032  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.247457  5245 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:36.270807  5514 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:58:36.217530  5469 raft_consensus.cc:3055] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:36.317785  1566 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:36.321051  1720 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
W20260709 12:58:36.372766  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.394735  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.457962  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.448546  1717 raft_consensus.cc:2410] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:36.448951  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.450644  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.459203  1712 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:36.403996  1564 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:36.460357  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.449596  2314 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:36.470228  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.473279  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.308207  5035 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:36.475808  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.319739  5310 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:36.477689  1717 raft_consensus.cc:2410] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:36.481318  1566 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:36.482795  1567 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:58:36.483285  1567 pending_rounds.cc:85] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 4
I20260709 12:58:36.483497  1567 pending_rounds.cc:107] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:58:36.483695  1567 raft_consensus.cc:2889] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:36.487596  1570 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:36.488304  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.488864  1720 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:36.489691  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.454916  5469 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:36.467278  5330 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:36.490515  1717 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:36.490590  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.494993  5241 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:36.486086  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.495173  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:36.496544  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.496097  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.501966  5495 raft_consensus.cc:3055] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:36.502709  5409 raft_consensus.cc:3055] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:36.504801  5483 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.515930  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.506901  5482 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:36.510500  1570 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:36.513039  1643 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:36.513131  1647 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:36.514051  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.311136  5446 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.512488  2343 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:36.506016  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:36.514707  5496 consensus_meta.cc:287] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.002s
I20260709 12:58:36.509482  5524 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:36.528604  1715 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:58:36.535247  1715 pending_rounds.cc:85] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 7
I20260709 12:58:36.536128  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.534415  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1815) took 1439 ms. Trace:
I20260709 12:58:36.537178  1570 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:36.537058  1647 rpcz_store.cc:276] 0709 12:58:35.095096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.533287 (+1438191us) service_pool.cc:224] Handling call
0709 12:58:36.533693 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.533947 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.533990 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.534051 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:36.534110 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.534186 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.534337 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.534472  1643 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:36.541742  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:36.542104  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 69454.2us
I20260709 12:58:36.518206  5482 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:36.516242  5409 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:36.549271  5409 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.550555  5409 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:36.551074  5518 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.396s	user 0.001s	sys 0.000s
I20260709 12:58:36.535609  1715 pending_rounds.cc:107] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.8
I20260709 12:58:36.551862  1715 raft_consensus.cc:2917] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Aborting config change with OpId 8.8: Aborted: Op aborted by new leader
I20260709 12:58:36.552258  1715 raft_consensus.cc:2889] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:36.553344  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.555383  5450 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:36.556176  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1788) took 3750 ms (client timeout 2871 ms). Trace:
I20260709 12:58:36.516758  5495 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:36.544951  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.545038  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.557003  1640 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:36.519964  5483 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.557934  1563 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:36.555835  5450 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:36.556547  1645 rpcz_store.cc:269] 0709 12:58:32.806199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.280000 (+473801us) service_pool.cc:224] Handling call
0709 12:58:36.555931 (+3275931us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b540040bfd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:36.556070 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4927490816}
I20260709 12:58:36.559944  2341 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:36.543962  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:36.548424  5445 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:36.565352  5495 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.566687  5495 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:36.563117  5477 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.568676  5249 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:36.569164  5249 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.569128  5477 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.569644  5446 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:36.569725  5249 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.524125  5515 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:58:36.571331  5477 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:36.555863  5245 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.560492  5330 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.577030  5330 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.578348  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 530) took 1114 ms. Trace:
I20260709 12:58:36.579062  5330 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:36.580466  1568 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:36.585259  5245 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:36.585635  5395 consensus_meta.cc:287] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.000s
I20260709 12:58:36.586074  5434 raft_consensus.cc:3055] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:36.586478  5434 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:36.586205  5469 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.587471  5469 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:36.587352  5434 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.588864  2347 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:36.563267  5487 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:36.589726  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.589577  5487 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.590322  1717 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:36.590981  2347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 497) took 1091 ms. Trace:
I20260709 12:58:36.591264  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.591471  2347 rpcz_store.cc:276] 0709 12:58:35.499129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.499295 (+   166us) service_pool.cc:224] Handling call
0709 12:58:36.590791 (+1091496us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54004cac54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:36.590894 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454324608}
I20260709 12:58:36.593497  5482 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.578727  1639 rpcz_store.cc:276] 0709 12:58:35.463654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.577557 (+1113903us) service_pool.cc:224] Handling call
0709 12:58:36.577877 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.578047 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.578072 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.578115 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:36.578145 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.578195 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.578293 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.596366  1639 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:58:36.596902  1639 pending_rounds.cc:85] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 8
I20260709 12:58:36.588486  5434 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:36.597174  1639 pending_rounds.cc:107] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:58:36.597864  1639 raft_consensus.cc:2889] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:36.598551   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:58:36.596764  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.598969  1571 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:36.592379  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.599478  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.605273  1717 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:36.602304  1568 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:36.602797  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 480) took 1149 ms. Trace:
I20260709 12:58:36.604094  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:36.606609  1718 rpcz_store.cc:276] 0709 12:58:35.453178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.476486 (+ 23308us) service_pool.cc:224] Handling call
0709 12:58:35.489007 (+ 12521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.862696 (+373689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.602475 (+739779us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400084b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:36.602728 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725862656}
W20260709 12:58:36.608094  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.608392  1645 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:36.608934  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1819) took 1410 ms. Trace:
I20260709 12:58:36.609059  5395 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:36.609273  1645 rpcz_store.cc:276] 0709 12:58:35.198296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.562852 (+1364556us) service_pool.cc:224] Handling call
0709 12:58:36.608102 (+ 45250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.608733 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.608886 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.609620  5395 raft_consensus.cc:697] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:36.610352  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.611057  1645 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:36.610572  5395 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.612030  1645 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:36.618503  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.621846  5487 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:36.622303  5249 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.623150  5481 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:36.623553  5481 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:36.624711  5482 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.624917  1715 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:36.629642  1646 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:36.630484  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1822) took 1158 ms. Trace:
I20260709 12:58:36.630888  1646 rpcz_store.cc:276] 0709 12:58:35.471961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.628968 (+1157007us) service_pool.cc:224] Handling call
0709 12:58:36.629276 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.630175 (+   899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.630416 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.612556  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1821) took 1140 ms. Trace:
I20260709 12:58:36.633693  1645 rpcz_store.cc:276] 0709 12:58:35.471724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.611625 (+1139901us) service_pool.cc:224] Handling call
0709 12:58:36.611870 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.612349 (+   479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.612511 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.635958  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.638034  2347 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:36.640266  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.640956  1645 raft_consensus.cc:2393] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:36.639559  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 531) took 1175 ms. Trace:
I20260709 12:58:36.642180  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:36.641816  1639 rpcz_store.cc:276] 0709 12:58:35.463897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.595667 (+1131770us) service_pool.cc:224] Handling call
0709 12:58:36.595966 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.639281 (+ 43315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.639485 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.644436  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:36.645489  5472 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:36.645941  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:36.646034  5472 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:36.647469  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.635170  5301 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:36.647969  5477 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:36.652418  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.653611  5483 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:36.657409  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.661196  5504 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:36.687104  1645 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 5.
I20260709 12:58:36.633196  5156 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:36.673560  1717 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:36.688050  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.675210  1565 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:58:36.689102  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.690342  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.690876  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1807) took 2509 ms. Trace:
I20260709 12:58:36.692258  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1824) took 1219 ms. Trace:
I20260709 12:58:36.693095  1645 rpcz_store.cc:276] 0709 12:58:35.472398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.691331 (+1218933us) service_pool.cc:224] Handling call
0709 12:58:36.691658 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.691874 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.691910 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.691963 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:36.692007 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.692075 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.692196 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.694969  1645 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:36.695607  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1825) took 1223 ms. Trace:
I20260709 12:58:36.695981  1645 rpcz_store.cc:276] 0709 12:58:35.472634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.694240 (+1221606us) service_pool.cc:224] Handling call
0709 12:58:36.694594 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.695339 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.695549 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:36.697039  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.697352  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:36.697723  1718 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:36.699146  5443 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:36.700203  5443 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.702241  1716 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:36.703359  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.704025  1713 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
W20260709 12:58:36.705933  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 762859us
I20260709 12:58:36.707156  1610 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:36.710330  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.676204  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:36.677594  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.680248  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:36.704223  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 805040us
I20260709 12:58:36.709040  5397 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:36.647831  5500 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.006s	user 0.005s	sys 0.000s
I20260709 12:58:36.682587  1571 raft_consensus.cc:1240] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:36.677621  1639 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:36.684499  1569 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:36.684093  2341 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 6.
I20260709 12:58:36.711020  2348 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:36.716492  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.719180  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:36.697391  1645 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:36.642515  5330 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:58:36.691324  1638 rpcz_store.cc:276] 0709 12:58:34.181673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.579694 (+1398021us) service_pool.cc:224] Handling call
0709 12:58:35.617132 (+ 37438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.617353 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:35.645123 (+ 27770us) log.cc:844] Serialized 14 byte log entry
0709 12:58:35.877886 (+232763us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.621367 (+743481us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18002b34e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:36.690351 (+ 68984us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b18002b34e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a3f649a40 00007f6a3f6444e4 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287 00007f6a4274f208
0709 12:58:36.690514 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.690568 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:36.690618 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.690700 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.690815 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":329,"prepare.queue_time_us":27862,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":75,"raft.queue_time_us":672,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":3041,"spinlock_wait_cycles":17371136,"thread_start_us":259651,"threads_started":2,"wal-append.queue_time_us":253083}
I20260709 12:58:36.681965  5472 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:36.681387  5495 raft_consensus.cc:2764] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:36.734746  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 529) took 1948 ms. Trace:
I20260709 12:58:36.767071  1642 rpcz_store.cc:276] 0709 12:58:34.786567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.083055 (+1296488us) service_pool.cc:224] Handling call
0709 12:58:36.097883 (+ 14828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.098090 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:36.117115 (+ 19025us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.493328 (+376213us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b18003d5220. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d423a
0709 12:58:36.734299 (+240971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.734366 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:36.734444 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.734533 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.734674 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":240717,"prepare.queue_time_us":11238,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":262829,"spinlock_wait_cycles":14000384,"thread_start_us":31528,"threads_started":1,"wal-append.queue_time_us":128259}
I20260709 12:58:36.738185  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.743343  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:36.710902  5249 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:36.744956  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.749716  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.757441  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.771358  1717 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:36.771692  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.738765  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1899) took 2399 ms. Trace:
I20260709 12:58:36.741109  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:36.770051  2345 raft_consensus.cc:2376] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11. Re-sending same reply.
I20260709 12:58:36.772794  2343 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:36.744367  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:36.731590  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:36.733557  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 283886us
I20260709 12:58:36.772346  1641 rpcz_store.cc:276] 0709 12:58:34.338994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.939797 (+1600803us) service_pool.cc:224] Handling call
0709 12:58:35.964740 (+ 24943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.964970 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:35.965529 (+   559us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.709838 (+744309us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.710048 (+   210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.710101 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:36.738457 (+ 28356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.738551 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.738696 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":616860,"prepare.queue_time_us":3144,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":34,"raft.queue_time_us":622122,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":23953,"spinlock_wait_cycles":91586304,"thread_start_us":126794,"threads_started":1,"wal-append.queue_time_us":148858}
I20260709 12:58:36.741437  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:36.776463  1644 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.733496  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.624517  5481 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.793589  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:36.794531  5524 consensus_queue.cc:1059] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:36.794796  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:36.797482  5367 consensus_meta.cc:287] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.894s	user 0.008s	sys 0.002s
I20260709 12:58:36.801497  5156 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.801923  5156 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:36.801968  5312 consensus_meta.cc:287] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.000s
I20260709 12:58:36.802553  5312 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.780242  1571 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.714737  5397 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:36.804927  5397 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:36.805624  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1898) took 2492 ms. Trace:
I20260709 12:58:36.806092  1640 rpcz_store.cc:276] 0709 12:58:34.326599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.929665 (+1603066us) service_pool.cc:224] Handling call
0709 12:58:36.556735 (+627070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.559871 (+  3136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.805384 (+245513us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540040bfd0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:36.805551 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441380736}
I20260709 12:58:36.807461  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:36.808079  1640 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:36.810424  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.811543  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.764844  5435 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:58:36.814435  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.815137  1638 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:36.816288  1638 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:36.816931  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.817576  1713 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:36.818534  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.819624  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.820194  1713 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 7.
I20260709 12:58:36.819846  5156 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:36.784399  5303 consensus_meta.cc:287] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.002s
I20260709 12:58:36.826432  5303 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:36.785521  5525 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:36.827384  5525 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.827690  5487 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:36.714259  5504 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:36.785291  5450 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.828217  5487 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:36.828444  5504 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:36.829276  5487 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.829519  5504 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.830008  5450 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:36.788170  5203 consensus_meta.cc:287] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.000s
I20260709 12:58:36.787446  1565 raft_consensus.cc:3055] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:36.789225  5330 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.831060  1565 raft_consensus.cc:740] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:36.831236  5330 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.831929  1565 consensus_queue.cc:260] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.790892  1717 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:36.836931  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.836989  2314 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:36.837806  1717 raft_consensus.cc:2410] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:58:36.838575  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.838594  1721 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:36.839144  1717 raft_consensus.cc:2376] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9. Re-sending same reply.
I20260709 12:58:36.839872  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.710132  5301 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.792922  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:36.781208  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:36.821435  5500 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:58:36.825529  1640 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:36.827852  5525 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.830603  5487 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.730645  5477 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:36.789907  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:36.823230  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:36.870575  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 85212.2us
I20260709 12:58:36.832484  5156 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:36.841351  1645 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:36.842936  1716 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:36.864066  1571 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:36.872722  2314 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:36.840420  1717 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:36.868932  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:36.873670  1535 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:36.871014  1719 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:36.870874  1569 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:36.877703  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:36.877911  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:36.880569  1645 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:36.881170  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.881247  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:36.881822  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.882225  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.882582  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.883558  1641 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:58:36.885670  1645 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:36.887312  1713 raft_consensus.cc:2410] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:58:36.889005  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 101823us
I20260709 12:58:36.845075  5303 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:36.890812  1645 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:36.895298  1644 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:36.903831  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:36.905449  1640 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:36.871393  5380 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.870399  5477 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:36.941368  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 67781.2us
W20260709 12:58:36.937431  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 47112.5us
I20260709 12:58:36.945308  1537 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:36.927259  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:36.883127  5460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.178s	user 0.007s	sys 0.023s
I20260709 12:58:36.929419  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1823) took 1457 ms. Trace:
I20260709 12:58:36.908555  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:36.975121  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 66651.8us
I20260709 12:58:36.831035  5203 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.876971  5469 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.883517  5318 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.879843  5515 consensus_queue.cc:1059] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:58:36.973232  1646 rpcz_store.cc:276] 0709 12:58:35.472180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.631854 (+1159674us) service_pool.cc:224] Handling call
0709 12:58:36.632491 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:36.636511 (+  4020us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:36.648206 (+ 11695us) log.cc:844] Serialized 14 byte log entry
0709 12:58:36.929107 (+280901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:36.929156 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:36.929204 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.929269 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.929367 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55185,"prepare.queue_time_us":11987,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":55671,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":225367,"threads_started":1}
I20260709 12:58:36.933490  5312 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:37.012863  1569 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:36.897145  5368 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:36.919323  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.973176  5460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.274s	user 0.007s	sys 0.023s
I20260709 12:58:36.978354  5526 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:36.951155  5471 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:37.020707  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:37.021075  5471 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:37.022210  5471 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.984759  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:36.934878  5301 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:36.928925  5219 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:36.986616  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:36.979199  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.987910  1640 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:36.988946  5393 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:36.949468  5477 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:36.949635  5380 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.989487  5469 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:36.906961  5156 consensus_queue.cc:1059] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:58:36.990235  5318 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.990880  1563 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 8. Current term is 10. Ops: []
I20260709 12:58:36.992686  5203 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:36.996562  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 2182) took 1004 ms. Trace:
I20260709 12:58:36.996685  1712 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:36.996744  2347 raft_consensus.cc:2410] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:58:36.999065  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.999289  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:37.046396  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:37.046262  1721 rpcz_store.cc:276] 0709 12:58:35.991950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.307719 (+315769us) service_pool.cc:224] Handling call
0709 12:58:36.996364 (+688645us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54003c6ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:36.996505 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838477184}
I20260709 12:58:37.046977  2345 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:37.000121  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:37.047609  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:37.047786  2342 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.004189  5330 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:37.009164  5515 raft_consensus.cc:3055] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:36.979159  5396 raft_consensus.cc:2764] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:58:36.949111  5432 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 12:58:37.025295  1686 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.554s (SENT)
W20260709 12:58:37.027110  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.026963  1646 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:37.028208  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:37.055945  1571 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:36.970175  5450 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:37.029050  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:37.031215  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.027931  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:37.019917  5472 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.062803  1569 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:37.036213  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:37.063733  1572 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:37.039835  1537 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:37.042164  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:37.047034  1570 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:36.999369  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:37.066804  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 132082us
I20260709 12:58:37.019950  5481 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:37.070338  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:37.051736  1644 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:37.014088  5035 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:36.969244  5483 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 12:58:37.074396  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.051898  5515 raft_consensus.cc:740] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:37.079457  1718 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:37.080049  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:37.084024  1640 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:37.063241  5450 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.053763  5368 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:37.067034  5367 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:58:37.089279  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.089502  1567 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 9. Ops: []
I20260709 12:58:37.089735  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:37.090188  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 483) took 1001 ms. Trace:
I20260709 12:58:37.090636  1712 rpcz_store.cc:276] 0709 12:58:36.088299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.459777 (+371478us) service_pool.cc:224] Handling call
0709 12:58:36.996494 (+536717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:37.046370 (+ 49876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:37.090003 (+ 43633us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54003c6ed0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:37.090137 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191412096}
I20260709 12:58:37.049434  5201 consensus_queue.cc:1059] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 12:58:37.097896  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 72644.1us
I20260709 12:58:37.090083  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.078471  5395 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.101929  1564 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:37.071018  5203 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:58:37.102324  1570 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:37.084880  5450 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:37.076390  5460 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:58:37.078308  5330 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:58:37.137815  1572 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:37.082778  5156 consensus_queue.cc:1059] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:58:37.101364  5531 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:37.097537  5495 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:58:37.127720  1640 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:37.117961  5524 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:58:37.155179  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:37.097873  5310 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:58:37.194586  1640 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:37.100697  5483 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:58:37.153038  5443 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:37.120296  5395 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.205708  5531 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:37.225721  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 249321us
I20260709 12:58:37.222896  5541 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:37.250612  1570 raft_consensus.cc:3055] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:37.154383  5515 consensus_queue.cc:260] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:37.283588  5532 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.266s	user 0.003s	sys 0.000s
I20260709 12:58:37.276612  5477 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.282706  5219 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.299533  1720 raft_consensus.cc:2368] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7.
I20260709 12:58:37.299252  5219 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.263449  5472 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:37.244858  5380 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:37.266011  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:37.313097  2343 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:37.269001  5469 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:37.269394  5528 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.252s	user 0.004s	sys 0.000s
I20260709 12:58:37.218425  5368 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.278795  1572 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:58:37.299202  5525 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.262398  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:37.300336  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.261300  5534 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:58:37.288807  1642 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:37.295279  1570 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:37.296480  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:37.296808  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:37.277889  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:37.342043  2347 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:37.342223  1640 raft_consensus.cc:2410] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:37.294315  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1818) took 2150 ms. Trace:
I20260709 12:58:37.296151  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:37.344269  1567 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:37.291160  5312 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:37.309096  1646 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
W20260709 12:58:37.323104  5542 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:58:37.284022  5446 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:37.339322  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.291599  5301 raft_consensus.cc:3055] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:37.306344  2345 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:37.342828  1643 rpcz_store.cc:276] 0709 12:58:35.143705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.539203 (+1395498us) service_pool.cc:224] Handling call
0709 12:58:36.539562 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.750260 (+210698us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:36.750300 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:36.750829 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:58:37.052263 (+301434us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:37.052301 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:37.052363 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:37.294118 (+241755us) raft_consensus.cc:1685] finished
0709 12:58:37.294136 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:37.294261 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196884,"raft.queue_time_us":231433,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":175149,"threads_started":1,"wal-append.queue_time_us":374047}
I20260709 12:58:37.377817  1640 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:37.378189  1643 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:37.296001  5515 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:37.294628  5395 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:37.385115  1646 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:37.329491  2342 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
W20260709 12:58:37.353102  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.362936  2343 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:37.288609  5443 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:37.293695  5035 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:37.381497  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:37.292140  5318 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:37.318897  5219 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:37.390292  1712 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:37.392617  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1817) took 2263 ms. Trace:
I20260709 12:58:37.394819  1647 rpcz_store.cc:276] 0709 12:58:35.129198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.538625 (+1409427us) service_pool.cc:224] Handling call
0709 12:58:36.539028 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.736604 (+197576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.736670 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:36.751139 (+ 14469us) log.cc:844] Serialized 26 byte log entry
0709 12:58:37.026091 (+274952us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:37.026127 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:37.026190 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:37.392409 (+366219us) raft_consensus.cc:1685] finished
0709 12:58:37.392432 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:37.392560 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197111,"raft.queue_time_us":221041,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":55455,"thread_start_us":230194,"threads_started":1,"wal-append.queue_time_us":285560}
W20260709 12:58:37.393083  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 334307us
W20260709 12:58:37.400964  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 361182us
I20260709 12:58:37.297403  5450 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.404964  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:37.346875  5312 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:37.406253  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.442400  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.443161  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:37.440907  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:37.387428  5303 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:37.377004  5301 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:37.392797  5443 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:37.384687  5472 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.368409  5393 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:58:37.443470  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.295006  5531 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:37.445372  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 346576us
W20260709 12:58:37.441601  5542 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:58:37.450243  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.452553  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:37.450412  1537 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.436216  5219 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:37.387161  5446 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.453439  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.442164  5201 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:37.457943  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:37.438473  5427 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:58:37.451633  5203 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:37.448057  5496 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:37.442636  5460 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:58:37.455000  5432 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:37.455155  5219 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:37.460063  5397 consensus_meta.cc:287] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 12:58:37.457115  5426 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:37.460476  5365 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:37.464026  5201 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.477921  5545 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:37.479226  5460 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.462478  5367 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:37.475234  5546 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:37.496901  5312 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:37.498049  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.453940  5035 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:58:37.454461  5472 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.472111  5496 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.519194  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:37.506330  5219 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:37.513432  5201 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:37.528329  5483 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:37.529395  5330 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:37.529767  5330 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:37.530611  5330 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.532021  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:37.532963  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:37.533108  5409 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:37.533501  5409 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.533834  5409 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:37.533908  5525 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:37.539170  5472 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:37.517874  5426 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:37.560042  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 263640us
I20260709 12:58:37.572140  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.513085  5397 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.527065  5496 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:37.576086  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 114025us
I20260709 12:58:37.559458  5312 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:37.559643  5548 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:37.516166  5301 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.580677  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:37.583851  2343 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:58:37.590276  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:37.605988  2343 pending_rounds.cc:85] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Aborting all ops after (but not including) 8
I20260709 12:58:37.606231  2343 pending_rounds.cc:107] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:58:37.606444  2343 raft_consensus.cc:2889] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:37.606585  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:37.602973  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.605516  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:37.609742  1713 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:37.607579  1638 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:37.611843  5481 consensus_meta.cc:287] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.000s
I20260709 12:58:37.582177  5556 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:37.613008  5530 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.594s	user 0.005s	sys 0.008s
I20260709 12:58:37.615381  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:37.615991  2342 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:37.620078  5330 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:37.608575  5548 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:37.621754  5548 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.626500  1713 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
W20260709 12:58:37.629032  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.629200  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 48609.7us
I20260709 12:58:37.630734  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:37.632606  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 169980us
I20260709 12:58:37.608923  5156 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:37.595064  5450 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:37.626113  5245 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:37.634436  5553 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:37.662021  5553 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:37.663223  5553 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.642689  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:37.593231  5426 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.643059  1565 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:37.645159  2342 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:37.647068  5397 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:37.648984  2343 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:37.671727  5495 raft_consensus.cc:3055] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:37.672140  5495 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:37.648555  1570 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.677894  1570 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:37.650291  1646 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:58:37.678789  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.654246  1713 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 11. Current term is 12. Ops: []
W20260709 12:58:37.654945  5357 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.021s	sys 0.028s
W20260709 12:58:37.657172  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.681806  1638 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:37.658599  1643 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:37.686363  1565 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:37.688666  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:37.690227  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 59558.2us
I20260709 12:58:37.693789  5450 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:37.694576  5450 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:37.695628  5450 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.695969  5495 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.681159  5245 raft_consensus.cc:697] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:37.697068  5495 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:37.697734  5245 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.691430  5522 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 12:58:37.681353  5357 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.021s	sys 0.029s
I20260709 12:58:37.674139  5156 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:37.701392  5555 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:37.701799  5555 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.702193  5555 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:37.701928  5156 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.703948  5409 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:37.705919  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.707633  5496 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.708882  5477 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:37.711308  5368 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.712211  1639 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:37.692519  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.717213  2342 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:37.712561  1570 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:37.727465  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:37.711374  5556 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:37.713066  1535 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:37.732266  2347 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:37.731554  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:37.737164  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:37.741202  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:37.599819  5443 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.745736  1537 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.744269  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:37.747767  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:37.745087  5396 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:37.753106  5439 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:37.753628  5439 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:37.754590  5439 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.747447  5397 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:37.759655  2347 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:37.748349  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.761067  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:37.736398  5301 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:37.771499  5427 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:37.775557  1644 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:37.713037  5219 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.779966  5219 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:37.744973  5368 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.781910  5409 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:37.782601  5368 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:37.769556  5397 raft_consensus.cc:697] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:37.785903  5397 consensus_queue.cc:237] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:37.787302  1464 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46898 (request call id 132) took 49147 ms (client timeout 15000 ms). Trace:
I20260709 12:58:37.767084  5015 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:37.790237  5470 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:37.790632  5470 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:37.791775  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:37.791538  5470 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.766443  5477 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:37.640317   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:37.792948  5477 raft_consensus.cc:697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:37.793761  5443 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:37.792383  2347 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:37.794028  5477 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:37.794979  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.769320  5515 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:58:37.796727  5201 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.797289  5470 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:37.798810  2343 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:37.799572  5201 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:37.782619  5446 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:37.769366  5357 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:37.766657  5481 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.802713  5481 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.803411  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:37.765144  5522 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:37.805147  5522 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:37.806169  5522 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:37.806905  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:37.809764  5525 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:37.810289  5525 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:37.812728  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:37.853008  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 78232.5us
I20260709 12:58:37.857270  5035 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.857831  5427 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:58:37.859371  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 113774us
I20260709 12:58:37.859519  5201 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:58:37.861178  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 59653.1us
I20260709 12:58:37.861513  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:37.864288  1610 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:37.866617  1537 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:37.869596  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 56970.3us
W20260709 12:58:37.852715  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.870823  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.873251  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:37.874274  2347 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:37.879354  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:37.880169  1563 raft_consensus.cc:2410] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:58:37.884408  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:37.885102  2347 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:37.887809  1641 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:37.879624  1535 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:37.890412  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.881516  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:37.895185  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:37.895702  2347 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:37.907399  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:37.907649  1537 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:37.907671  1639 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 6.
I20260709 12:58:37.870359  5201 raft_consensus.cc:697] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:37.875407  5546 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:37.878783  5563 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:58:37.911056  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:37.879122  5553 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:37.851467  5219 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:58:37.851859  5396 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:58:37.927582  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:37.931089  1563 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:37.903652  5443 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:37.869012  5393 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:58:37.901265  5015 raft_consensus.cc:2764] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:37.936352  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:37.909601  5365 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:37.904058  5312 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:37.936617  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:37.908985  5558 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:37.916326  5556 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:37.877357  5357 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:58:37.919430  5397 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:37.924631  5531 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:37.904618  5426 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:58:37.939939  5443 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:37.787810  1464 rpcz_store.cc:269] 0709 12:57:48.640077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.646333 (+  6256us) service_pool.cc:224] Handling call
0709 12:58:37.786996 (+49140663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:29.611391 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:29.803142 (+191751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:29.803192 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:58:29.803208 (+    16us) tablet.cc:662] Decoding operations
0709 12:58:29.803891 (+   683us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:29.803971 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:29.803997 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:58:29.804425 (+   428us) tablet.cc:701] Row locks acquired
0709 12:58:29.804476 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:58:29.804627 (+   151us) write_op.cc:270] Start()
0709 12:58:29.804788 (+   161us) write_op.cc:276] Timestamp: P: 1783601909804565 usec, L: 0
0709 12:58:29.804809 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:58:29.805435 (+   626us) log.cc:844] Serialized 1996 byte log entry
0709 12:58:31.322287 (+1516852us) op_driver.cc:464] REPLICATION: finished
0709 12:58:31.480850 (+158563us) write_op.cc:301] APPLY: starting
0709 12:58:31.480989 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:31.481215 (+   226us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:31.481376 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:31.482126 (+   750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:31.482406 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:58:31.482474 (+    68us) write_op.cc:312] APPLY: finished
0709 12:58:31.482772 (+   298us) log.cc:844] Serialized 41 byte log entry
0709 12:58:31.484520 (+  1748us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:31.484819 (+   299us) write_op.cc:454] Released schema lock
0709 12:58:31.484885 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:31.485418 (+   533us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:31.485458 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1971433,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":158191,"apply.run_cpu_time_us":2932,"apply.run_wall_time_us":4556,"num_ops":4,"prepare.queue_time_us":324274,"prepare.run_cpu_time_us":30183,"prepare.run_wall_time_us":534342,"raft.queue_time_us":296815,"raft.run_cpu_time_us":10166,"raft.run_wall_time_us":156028,"replication_time_us":1517212,"thread_start_us":843731,"threads_started":4,"wal-append.queue_time_us":1153748,"wal-append.run_cpu_time_us":28269,"wal-append.run_wall_time_us":1820990}]]}
I20260709 12:58:37.881249  5525 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:37.925994  5553 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:37.916528  5526 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:58:37.957242  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:37.941606  5543 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:37.955356  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:37.950918  5446 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:37.791452  1463 catalog_manager.cc:5697] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:37.924878  5557 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:58:37.968540  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:37.951766  5312 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:37.952708  5365 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:37.998574  5312 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:38.025687  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.962057  5443 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:38.044996  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 76591.7us
W20260709 12:58:38.043602  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.963696  5553 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:38.047375  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:37.967022  5446 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.994676  5357 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:38.050231  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:37.992372  5481 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:38.001771  5409 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:38.057753  5409 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.060171  5409 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:38.061038  5570 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:58:38.061275  1463 catalog_manager.cc:5697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 7, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:38.062690  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:38.063408  1643 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:58:38.062846  1463 catalog_manager.cc:5697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:38.065001  5219 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:38.065459  5219 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:38.065928  5219 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:38.066064  5562 log.cc:927] Time spent T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:58:38.067284  5496 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:38.069761  5396 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:38.070292  5396 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:38.070703  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:38.044251  5556 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:38.078222  5365 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.078840  5555 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.080142  1640 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:38.088027  2347 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:38.072387  5396 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:38.064229  5568 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:58:38.098654  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:38.099447  2347 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:38.054102  5446 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:38.086782  5357 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:38.115034  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 67730.3us
I20260709 12:58:38.115854  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:38.100355  5555 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:38.120101  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.064322  1463 catalog_manager.cc:5697] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 8, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 8 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:38.122999  1463 catalog_manager.cc:5697] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 7, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:38.124738  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1839) took 1151 ms. Trace:
I20260709 12:58:38.100988  5397 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:58:38.125130  1639 rpcz_store.cc:276] 0709 12:58:36.972902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.076351 (+103449us) service_pool.cc:224] Handling call
0709 12:58:38.124547 (+1048196us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b540040c4d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:38.124677 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427863296}
I20260709 12:58:38.113222  5357 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:38.133941  5439 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:38.134395  5439 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:38.136210  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.048053  5201 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.142747  5553 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:38.149701  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.152817  1639 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:38.155149  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:38.157073  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.157435  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.165336  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:38.169116  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:38.155872  1720 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:38.179018  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:38.183414  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:38.185510  2347 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:38.186717  1686 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:38.187428  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 71666us
I20260709 12:58:38.188381  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:38.131160  1463 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:38.199748  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:38.200397  1570 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:58:38.200919  1718 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:38.201948  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:38.202467  1712 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:38.210438  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:38.211131  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:38.211225  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:38.211807  1721 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:38.212093  1714 raft_consensus.cc:2410] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:38.213291  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:38.213796  1714 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:38.215059  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:38.219996  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.221421  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.222342  5301 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.222649  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:38.222903  5301 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.223374  1566 raft_consensus.cc:2376] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12. Re-sending same reply.
I20260709 12:58:38.225605  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.226819  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.228082  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.228336  2347 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:58:38.228814  2347 pending_rounds.cc:85] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Aborting all ops after (but not including) 7
I20260709 12:58:38.228978  1572 raft_consensus.cc:2410] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:58:38.229049  2347 pending_rounds.cc:107] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.8
I20260709 12:58:38.229611  2347 raft_consensus.cc:2917] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Aborting config change with OpId 8.8: Aborted: Op aborted by new leader
I20260709 12:58:38.230069  2347 raft_consensus.cc:2889] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:38.230317  1569 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:38.231411  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.232852  1571 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:38.233340  5203 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:38.235570  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:38.236284  2343 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:38.237039  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.237903  1571 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:38.238796  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.240306  5203 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:38.241052  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.242298  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:38.224404  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.172502  5330 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.251232  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.252170  1571 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:38.252822  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.178664  5495 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.260980  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:38.260372  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:38.265980  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:38.266788  1712 raft_consensus.cc:2410] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:38.266889  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:38.267431  1719 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:58:38.273164  1713 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:38.279567  1714 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:38.301939  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.201500  5409 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:38.199187  5396 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:38.311117  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.248762  5553 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:38.250468  5393 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.311493  1569 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
W20260709 12:58:38.315047  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.321978  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:38.313723  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:38.326290  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:38.217061  5483 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:58:38.215900  5541 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:58:38.354884  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:38.257011  5367 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:58:38.357831  1646 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:38.313287  5397 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:38.363539  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:38.364224  1642 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:38.365322  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:38.365933  1713 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:38.270102  5330 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:38.359500  1646 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:38.288707  5495 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:38.360761  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 170477us
I20260709 12:58:38.377233  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:38.378036  2347 raft_consensus.cc:2368] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12.
I20260709 12:58:38.358165  5395 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.408185  1686 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:38.410754  1684 leader_election.cc:400] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12.
I20260709 12:58:38.411178  1684 leader_election.cc:403] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:38.337034  5393 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.378791  5481 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:38.340023  5443 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.420017  1640 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:38.420898  2347 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:38.421027  1713 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:38.427917  1568 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:38.423866  1642 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:38.428380  1713 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:38.385674  5301 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:38.426894  1640 pending_rounds.cc:85] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:58:38.439633  1640 pending_rounds.cc:107] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:58:38.439955  1640 raft_consensus.cc:2889] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:38.479063  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 71341.1us
I20260709 12:58:38.480161  1641 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:38.424356  5481 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.484539  1686 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:38.441504  5550 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.411805  5395 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:38.526580  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.490666  5481 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:38.552337  5584 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:58:38.553947  5585 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:58:38.480368  5357 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:38.528753  5597 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:38.491288  5446 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.600309  5598 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.535261  5483 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
W20260709 12:58:38.701931  5580 log.cc:927] Time spent T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.386s	user 0.001s	sys 0.000s
I20260709 12:58:38.701797  1640 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:38.702522  5597 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.689893  5590 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
W20260709 12:58:38.716174  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.716603  1719 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:38.717357  1537 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:38.720158  1537 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:38.721815  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 279706us
W20260709 12:58:38.722656  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 534329us
I20260709 12:58:38.722754  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:38.725271  2347 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:38.744673  1537 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:38.746213  1537 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:38.750785  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:38.752094  1714 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:38.757997  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 273546us
W20260709 12:58:38.759644  5586 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:58:38.764843  5592 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 12:58:38.740684  5303 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.768746  1718 consensus_meta.cc:287] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.005s
I20260709 12:58:38.740542  5432 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:38.771854  1718 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:38.758929  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:38.773036  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:38.754258  5203 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:38.750536  5558 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:58:38.757673  5582 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 12:58:38.751405  5545 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:38.752974  5367 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:38.783448  1686 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:38.758227  5487 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.525827  5550 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:38.702970  5598 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:38.794450  5589 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
W20260709 12:58:38.795523  5588 log.cc:927] Time spent T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 12:58:38.796530  5595 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12.
I20260709 12:58:38.799001  5593 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:58:38.805445  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:38.806239  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1850) took 1220 ms. Trace:
I20260709 12:58:38.806527  1645 rpcz_store.cc:276] 0709 12:58:37.585391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.642273 (+ 56882us) service_pool.cc:224] Handling call
0709 12:58:38.805340 (+1163067us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5800002d98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60feee 0000000000375939 00007f6a476831e0 00007f6a4774c0c4 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:58:38.806181 (+   841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3821056}
W20260709 12:58:38.809767  5578 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.813s	user 0.000s	sys 0.004s
I20260709 12:58:38.363306  1463 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 2 to 4, term changed from 3 to 7, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193), VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194), VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195), VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 7 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:38.768568  5495 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:38.838969  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.815048  1463 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 7, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 7 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.820564  5524 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.858918  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:38.820760  5443 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:38.773651  5469 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:38.821871  5357 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:38.825517  5550 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:38.827154  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:38.828039  5598 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:38.831779  5219 consensus_meta.cc:287] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.000s
I20260709 12:58:38.784823  5515 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:38.726873  5597 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:38.837021  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:38.781634  5545 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:38.781956  5558 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:38.859530  2342 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:38.858206  5483 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.865895  1638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.022s	sys 0.050s
I20260709 12:58:38.867133  1563 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:38.777341  5303 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.857412  5495 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:38.819129  5487 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.867614  5443 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:38.904386  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:38.905294  1642 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:38.907097  1643 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:38.910365  5597 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:38.884109  5545 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:38.860746  1720 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:38.883307  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:38.859530  5312 raft_consensus.cc:2764] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:58:38.885186  1638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.022s	sys 0.050s
I20260709 12:58:38.922605  1646 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:38.882305  5558 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:38.863673  5524 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:38.899950  5515 raft_consensus.cc:697] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:39.008536  2312 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:38.929378  5601 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.871359  5219 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:39.028012  1715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.002s	sys 0.010s
W20260709 12:58:39.057585  1715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.010s
W20260709 12:58:39.040017  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 289281us
I20260709 12:58:39.027848  2342 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:39.014293  5310 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:39.030670  5434 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:39.073171  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 289810us
I20260709 12:58:38.900323  5483 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:39.058549  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 51127.4us
I20260709 12:58:39.015698  5312 consensus_queue.cc:1059] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 12:58:39.077117  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 308872us
W20260709 12:58:39.078094  1713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.008s	sys 0.010s
W20260709 12:58:39.100798  1713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.008s	sys 0.011s
I20260709 12:58:39.101893  1537 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:39.118606  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.111631  1684 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:39.130359  5219 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:39.056190  5598 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.079200  5434 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.132278  5432 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:39.076908  5310 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:39.123344  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53342.9us
I20260709 12:58:39.099123  5522 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.143182  1612 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:39.067266  5601 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.139089  5597 raft_consensus.cc:3055] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:39.086511  5481 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.142632  5434 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:39.143474  5367 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:39.165002  1686 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:39.134786  5598 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.147392  5312 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.148571  5409 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:39.134655  5617 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:58:39.148628  5615 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:39.183728  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:39.195139  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.197891  1719 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:39.176815  5597 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:39.201426  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:39.202174  1719 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:39.180114  5556 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:39.211570  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1854) took 1348 ms. Trace:
I20260709 12:58:39.211935  1639 rpcz_store.cc:276] 0709 12:58:37.862769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.126125 (+263356us) service_pool.cc:224] Handling call
0709 12:58:38.126407 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:38.153243 (+ 26836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.211360 (+1058117us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b540040d3d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:39.211513 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60203776}
W20260709 12:58:39.212796  5607 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:58:39.214202  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1853) took 1351 ms. Trace:
I20260709 12:58:39.214690  1644 rpcz_store.cc:276] 0709 12:58:37.862474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.123045 (+260571us) service_pool.cc:224] Handling call
0709 12:58:38.123381 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:38.185775 (+ 62394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:38.185806 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:38.208985 (+ 23179us) log.cc:844] Serialized 26 byte log entry
0709 12:58:38.561387 (+352402us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:38.561444 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:38.561540 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.213956 (+652416us) raft_consensus.cc:1685] finished
0709 12:58:39.213984 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.214133 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32550,"raft.queue_time_us":77273,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":42418,"thread_start_us":252257,"threads_started":1,"wal-append.queue_time_us":634391}
W20260709 12:58:39.216187  5587 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.857s	user 0.002s	sys 0.000s
I20260709 12:58:39.218743  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:39.184072  5495 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:39.208177  5483 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:39.211148  5598 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:39.309890  1719 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:39.314299  5627 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:58:39.177614  5610 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 12:58:39.213600  1717 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:58:39.186992  1463 catalog_manager.cc:5697] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:39.157198  5515 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.150034  5522 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.158474  5614 consensus_queue.cc:1059] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:58:39.186291  5615 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:39.321388  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 120059us
I20260709 12:58:39.352923  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:39.317677  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 122639us
I20260709 12:58:39.322607  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:39.325134  2340 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:39.354486  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:39.355443  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.324162  1717 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:39.185402  5312 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.358731  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.360164  5556 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:39.355049  5615 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:39.370827  5556 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:39.371260  5556 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:39.360158  5621 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:39.361991  1686 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:39.327246  5583 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.956s	user 0.002s	sys 0.000s
I20260709 12:58:39.363993  1721 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:39.374218  1686 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:39.367373  1717 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:39.376078  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.376832  5555 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:39.328697  5496 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.334273  5617 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:39.342907  5219 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.378422  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 1816) took 1153 ms. Trace:
I20260709 12:58:39.331060  5330 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:39.322327  5591 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.384198  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.333000  5487 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:39.322732  5303 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:39.334132  5601 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:39.312790  5545 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.410919  1720 rpcz_store.cc:276] 0709 12:58:38.210089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.210214 (+   125us) service_pool.cc:224] Handling call
0709 12:58:39.363262 (+1153048us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54002c47d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:39.363399 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447019392}
I20260709 12:58:39.372576  5522 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:39.355926  5524 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:39.395566  5483 raft_consensus.cc:3055] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:39.394862  5495 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:39.402515  5471 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:39.400691  5621 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:39.437979  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53855.1us
I20260709 12:58:39.438923  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:39.439167  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1831) took 1069 ms. Trace:
I20260709 12:58:39.325729  5367 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:39.447885  2343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.006s	sys 0.014s
W20260709 12:58:39.448328  2343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.006s	sys 0.014s
I20260709 12:58:39.439635  1713 rpcz_store.cc:276] 0709 12:58:38.369266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.430061 (+ 60795us) service_pool.cc:224] Handling call
0709 12:58:38.485098 (+ 55037us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:38.513350 (+ 28252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:38.513393 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:38.526431 (+ 13038us) log.cc:844] Serialized 52 byte log entry
0709 12:58:39.101284 (+574853us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:39.417446 (+316162us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.438534 (+ 21088us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.438747 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.438843 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.438904 (+    61us) raft_consensus.cc:1685] finished
0709 12:58:39.438921 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.439096 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70731,"raft.queue_time_us":121438,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":4812,"thread_start_us":826433,"threads_started":2,"wal-append.queue_time_us":628224}
I20260709 12:58:39.419315  5330 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:39.437733  5522 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.410604  5496 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.437317  5483 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:39.441661  5471 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:39.478489  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 574) took 1602 ms. Trace:
I20260709 12:58:39.454725  5553 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:39.481086  1565 rpcz_store.cc:276] 0709 12:58:37.876025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.877139 (+  1114us) service_pool.cc:224] Handling call
0709 12:58:37.877463 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:37.896099 (+ 18636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:37.896129 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:37.896584 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:58:38.198672 (+302088us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:38.198724 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:38.198803 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.326576 (+1127773us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:39.467506 (+140930us) raft_consensus.cc:1685] finished
0709 12:58:39.467537 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.478401 (+ 10864us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13458,"raft.queue_time_us":19753,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5522,"spinlock_wait_cycles":15964928,"thread_start_us":301776,"threads_started":1,"wal-append.queue_time_us":415562}
I20260709 12:58:39.457291  5555 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.485096  5620 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 12:58:39.402012  5597 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.420605  5591 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.325549  1463 catalog_manager.cc:5697] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 11, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.483652  5471 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:39.521694  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 147562us
I20260709 12:58:39.523273  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:39.508361  5481 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:39.508991  5553 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:39.524684  1686 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:39.513541  5201 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:39.531934  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:39.483839  5522 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.502774  5555 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.535012  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:39.535315  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 551) took 1211 ms. Trace:
I20260709 12:58:39.541189  1646 rpcz_store.cc:276] 0709 12:58:38.323026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.925970 (+602944us) service_pool.cc:224] Handling call
0709 12:58:38.926344 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:38.926589 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:39.185925 (+259336us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.534076 (+348151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:39.534139 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:39.534205 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.534268 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.534373 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86753,"prepare.queue_time_us":290807,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":507434,"threads_started":3,"wal-append.queue_time_us":336342}
I20260709 12:58:39.543568  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:39.527673  5624 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:39.527673  5495 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:39.542208  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 103368us
I20260709 12:58:39.552405  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.530871  5487 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:39.525813  5330 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:58:39.569181  5626 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:58:39.569563  5477 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:39.570245  5477 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:39.570580  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1835) took 1156 ms. Trace:
I20260709 12:58:39.551309  5312 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:39.570942  1718 rpcz_store.cc:276] 0709 12:58:38.414618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.773049 (+358431us) service_pool.cc:224] Handling call
0709 12:58:38.790334 (+ 17285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:39.187565 (+397231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.187592 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:39.188109 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:58:39.516804 (+328695us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:39.516848 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.516930 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.570357 (+ 53427us) raft_consensus.cc:1685] finished
0709 12:58:39.570378 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.570518 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75442,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":15498,"thread_start_us":534582,"threads_started":2,"wal-append.queue_time_us":248452}
W20260709 12:58:39.570580  5625 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:58:39.573712  1463 catalog_manager.cc:5697] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 8, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 8 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:39.543967  5647 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:39.544312  1646 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:39.589128  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:39.594301  5638 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:58:39.595253  5629 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:58:39.596184  5545 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:39.560812  5487 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:39.599711  5558 consensus_meta.cc:287] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.585s	user 0.004s	sys 0.005s
I20260709 12:58:39.531194  5621 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.556304  5495 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.602608  5495 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:39.600296  5487 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:39.533125  5483 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.540477  5201 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.562137  5330 consensus_queue.cc:1243] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 2af567a273d44ca89d2b3b0f7c815bd1 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:39.708762  1646 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:58:39.720382  5648 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:39.576042  1463 catalog_manager.cc:5697] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:39.742619  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 553) took 1330 ms. Trace:
I20260709 12:58:39.743739  1646 rpcz_store.cc:276] 0709 12:58:38.412327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.621292 (+1208965us) service_pool.cc:224] Handling call
0709 12:58:39.621705 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.742322 (+120617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.742552 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:39.721388  5645 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:58:39.721659  5641 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:39.722819  5635 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:58:39.723624  5649 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:39.729930  5522 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:39.731460  5555 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:39.734728  5622 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:58:39.737422  5591 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:39.738879  5646 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:39.741004  5496 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:39.606176  5481 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.600121  5558 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.743501  5648 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:39.793051  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 248881us
W20260709 12:58:39.751717  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 199389us
I20260709 12:58:39.754865  5620 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.704867  5495 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:39.765604  1646 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:39.751168  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 216252us
I20260709 12:58:39.761143  5483 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:58:39.751122  5553 raft_consensus.cc:697] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:39.842180  2312 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:39.840098  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.859020  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.848661  1686 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:39.851287  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 554) took 1417 ms. Trace:
I20260709 12:58:39.861307  1646 rpcz_store.cc:276] 0709 12:58:38.434065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.755702 (+1321637us) service_pool.cc:224] Handling call
0709 12:58:39.765375 (+  9673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.850997 (+ 85622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.851224 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:39.860306  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.867605  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.872932  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:39.873409  1646 raft_consensus.cc:3055] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:39.873780  1646 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:39.874128  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:39.867637  5555 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:39.875864  5330 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:39.872957  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:39.879612  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:39.880883  5330 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:39.881462  5330 raft_consensus.cc:697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:39.881800  5201 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:39.882458  5330 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.883548  5439 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.874524  1646 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.885722  1646 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:39.753585  5641 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.895109  5641 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:39.847299  5443 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.922s	user 0.012s	sys 0.000s
W20260709 12:58:39.852388  5635 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:58:39.901305  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:39.901549  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:39.902575  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:39.903676  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:39.904458  1572 raft_consensus.cc:3055] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:39.839973  5648 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:39.933363  1572 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:39.934283  1569 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:39.936985  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:39.880441  5487 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:39.847575  5522 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.942559  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1834) took 1554 ms. Trace:
I20260709 12:58:39.940908  1572 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.955188  1572 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:39.954926  1714 rpcz_store.cc:276] 0709 12:58:38.389464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.754001 (+364537us) service_pool.cc:224] Handling call
0709 12:58:38.754472 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:38.824429 (+ 69957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:38.824462 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:38.824890 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:58:39.143907 (+319017us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:39.143962 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.899375 (+755413us) spinlock_profiling.cc:243] Waited 69.6 ms on lock 0x7b54002c42d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:39.899427 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.899475 (+    48us) raft_consensus.cc:1685] finished
0709 12:58:39.899490 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.942473 (+ 42983us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44652,"spinlock_wait_cycles":184160896,"thread_start_us":318618,"threads_started":1,"wal-append.queue_time_us":575210}
I20260709 12:58:39.905619  5439 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:39.896095  5515 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:39.839241  5481 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.867028  5591 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:39.965252  5522 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:39.971740  5640 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:58:39.973030  1463 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 7, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:39.782631  5556 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.976174  1572 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:58:40.011880  1572 pending_rounds.cc:85] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 8
I20260709 12:58:40.012200  1572 pending_rounds.cc:107] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:58:40.012432  1572 raft_consensus.cc:2889] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:39.853977  5495 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:39.851055  5620 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.765518  5649 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:39.978081  5655 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:58:39.979856  5611 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.927s	user 0.000s	sys 0.001s
W20260709 12:58:39.980557  5434 consensus_meta.cc:287] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.003s
I20260709 12:58:39.895926  5651 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:39.985670  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:39.992506  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:39.939719  5443 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:39.976742  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1954) took 1114 ms. Trace:
I20260709 12:58:40.015523  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.018018  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:39.783201  5646 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.021246  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:39.840936  5432 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.007s	sys 0.023s
I20260709 12:58:40.022039  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 550) took 1709 ms. Trace:
I20260709 12:58:40.057574  1643 rpcz_store.cc:276] 0709 12:58:38.313063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.907743 (+594680us) service_pool.cc:224] Handling call
0709 12:58:38.907999 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:38.908328 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:39.139694 (+231366us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.405425 (+265731us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:39.406887 (+  1462us) log.cc:844] Serialized 26 byte log entry
0709 12:58:39.407062 (+   175us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:39.407103 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.407191 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:40.021771 (+614580us) raft_consensus.cc:1685] finished
0709 12:58:40.021808 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.021970 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":237799,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5490,"raft.queue_time_us":1968,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":3171,"thread_start_us":494529,"threads_started":2,"wal-append.queue_time_us":339215}
I20260709 12:58:39.871712  5615 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.068403  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:40.027588  1537 leader_election.cc:336] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Timed out: RequestConsensusVote RPC to 127.0.107.195:36649 timed out after 1.669s (SENT)
I20260709 12:58:39.999658  5515 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.033043  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.052376  1645 rpcz_store.cc:276] 0709 12:58:38.862643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.975753 (+1113110us) service_pool.cc:224] Handling call
0709 12:58:39.976104 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.976311 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.976346 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:39.976393 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:39.976438 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.976500 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.976675 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:40.053551  1566 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:40.074882  1567 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:40.075636  1566 raft_consensus.cc:3055] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:40.076056  1566 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:40.053615  1572 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:39.906520  5647 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:40.055542  1571 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
I20260709 12:58:40.056706  1569 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:40.010114  5496 consensus_queue.cc:1059] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:58:40.046617  5556 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.017127  5470 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.057245  5555 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:40.013314  5591 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.086798  2343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 512) took 1840 ms. Trace:
W20260709 12:58:40.065474  5432 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.007s	sys 0.024s
I20260709 12:58:40.085052  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.028697  5655 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:40.048579  5522 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.038305  5495 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:40.076927  1566 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.078326  5477 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.097640  1566 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:40.096496  2343 rpcz_store.cc:276] 0709 12:58:38.238920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.239116 (+   196us) service_pool.cc:224] Handling call
0709 12:58:38.239505 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:38.850519 (+611014us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b180046bb80. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4272cbfb 00007f6a4273764b
0709 12:58:38.850643 (+   124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:38.850670 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:38.851151 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:58:39.448795 (+597644us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:39.448854 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.448964 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:40.070694 (+621730us) raft_consensus.cc:1685] finished
0709 12:58:40.070735 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.079433 (+  8698us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17287,"raft.queue_time_us":80969,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":10661,"spinlock_wait_cycles":10318080,"thread_start_us":694696,"threads_started":2,"wal-append.queue_time_us":902695}
I20260709 12:58:40.054694  5651 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:40.093343  1569 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:40.104301  5201 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.094858  5470 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.078740  5515 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:40.089227  5443 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:40.048863  5434 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.111994  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 555) took 1327 ms. Trace:
I20260709 12:58:40.078613  5656 raft_consensus.cc:2764] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 12:58:40.117725  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:40.116470  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 242388us
I20260709 12:58:40.031666  5553 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.104885  5201 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.089326  5647 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.120571  1612 leader_election.cc:400] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 6. Current term is 7.
W20260709 12:58:40.265219  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 144813us
W20260709 12:58:40.216169  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:40.106703  5219 consensus_meta.cc:287] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.691s	user 0.013s	sys 0.000s
W20260709 12:58:40.174952  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.142896  2345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 513) took 1900 ms. Trace:
I20260709 12:58:40.102108  5655 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:40.107813  5651 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:40.109076  5654 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:40.272573  5573 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 2.276s	user 0.005s	sys 0.026s
I20260709 12:58:40.142374  1463 catalog_manager.cc:5697] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 6, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:40.163975  5555 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.164278  5591 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.142771  5558 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.274870  5446 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:40.294687  5660 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:58:40.275652  5615 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:40.291194  5654 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:40.139271  5471 consensus_meta.cc:287] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 12:58:40.269739  5646 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:40.144654  5602 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.283s
I20260709 12:58:40.282065  5661 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:40.296988  5471 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:40.203437  1566 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:40.297350  5470 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.281795  5219 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:40.338603  5470 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.338969  1639 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:40.339148  5470 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.340236  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1951) took 1977 ms. Trace:
I20260709 12:58:40.318022  5434 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.340618  1639 rpcz_store.cc:276] 0709 12:58:38.362663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.326208 (+963545us) service_pool.cc:224] Handling call
0709 12:58:39.326452 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:40.339400 (+1012948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.340000 (+   600us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002a6cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:40.340176 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328124672}
I20260709 12:58:40.236109  5481 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.168853  5667 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.342694  5667 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.343680  5443 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:40.346442  5667 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.398249  5409 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.398795  5409 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.401578  5409 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:40.396160  5443 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.403287  5443 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.405977  5443 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.409940  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1868) took 2255 ms. Trace:
I20260709 12:58:40.410486  1640 rpcz_store.cc:276] 0709 12:58:38.154793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.447433 (+292640us) service_pool.cc:224] Handling call
0709 12:58:38.447736 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:38.708482 (+260746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.409630 (+1701148us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001b62d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:40.409856 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502861568}
W20260709 12:58:40.425756  1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 547) took 2610 ms (client timeout 1760 ms). Trace:
W20260709 12:58:40.426376  1641 rpcz_store.cc:269] 0709 12:58:37.815801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.915888 (+100087us) service_pool.cc:224] Handling call
0709 12:58:40.425447 (+2509559us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54003c69d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:40.425635 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238460672}
I20260709 12:58:40.434012  1458 maintenance_manager.cc:643] P ab5bd50f45be44c4afe02e363e8322ae: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.180s	user 0.172s	sys 0.065s Metrics: {"bytes_written":29648,"cfile_init":1,"drs_written":1,"lbm_read_time_us":456,"lbm_reads_lt_1ms":4,"lbm_write_time_us":234354,"lbm_writes_10-100_ms":5,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":63,"thread_start_us":241366,"threads_started":2,"wal-append.queue_time_us":12953}
I20260709 12:58:40.438268  1459 maintenance_manager.cc:419] P ab5bd50f45be44c4afe02e363e8322ae: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8051 bytes on disk
I20260709 12:58:40.445619  1458 maintenance_manager.cc:643] P ab5bd50f45be44c4afe02e363e8322ae: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":515,"lbm_reads_lt_1ms":4}
I20260709 12:58:40.450397  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1820) took 2237 ms. Trace:
I20260709 12:58:40.450964  1721 rpcz_store.cc:276] 0709 12:58:38.213363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.213537 (+   174us) service_pool.cc:224] Handling call
0709 12:58:39.363589 (+1150052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.374419 (+ 10830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.450122 (+1075703us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002c47d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:40.450317 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644228352}
I20260709 12:58:40.458835  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:40.460067  2343 raft_consensus.cc:2393] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:40.463923  2347 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:40.466100  2340 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:58:40.474367  5597 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:40.477437  5634 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.845s	user 0.004s	sys 0.006s
I20260709 12:58:40.478933  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1823) took 2264 ms. Trace:
I20260709 12:58:40.479420  1716 rpcz_store.cc:276] 0709 12:58:38.214730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.215787 (+  1057us) service_pool.cc:224] Handling call
0709 12:58:38.216130 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:38.422250 (+206120us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:38.422284 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:38.820875 (+398591us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b48001b0258. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
0709 12:58:38.935898 (+115023us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b2c000f13c8. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4102da11 00007f6a4103d372 00007f6a4276fa01 00007f6a4273443a 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2
0709 12:58:39.057759 (+121861us) log.cc:844] Serialized 26 byte log entry
0709 12:58:39.421036 (+363277us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:39.421086 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.422615 (+  1529us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:40.406146 (+983531us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:40.478688 (+ 72542us) raft_consensus.cc:1685] finished
0709 12:58:40.478709 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.478853 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17610,"raft.queue_time_us":142135,"raft.run_cpu_time_us":2787,"raft.run_wall_time_us":460199,"spinlock_wait_cycles":58631552,"thread_start_us":474010,"threads_started":2,"wal-append.queue_time_us":425275}
I20260709 12:58:40.482000  5619 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:40.482461  5619 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:40.490792  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:40.493290  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:40.493836  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.499464  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.500329  1640 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:40.501438  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.502938  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.503854  1640 raft_consensus.cc:2393] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:40.504823  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.505628  1643 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:40.515317  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.524151  1639 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:40.525517  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:40.527268  1645 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:40.542018  2343 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:40.558167  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.561931  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.562906  1639 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:40.564180  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.583703  5673 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:40.289417  5649 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.112546  1646 rpcz_store.cc:276] 0709 12:58:38.784477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.862179 (+1077702us) service_pool.cc:224] Handling call
0709 12:58:39.873295 (+ 11116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:40.111370 (+238075us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:40.111445 (+    75us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:40.111535 (+    90us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:40.111639 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.111733 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.111906 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":216167,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5425,"thread_start_us":208756,"threads_started":1}
I20260709 12:58:40.277007  5620 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.310830  5661 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.321863  5471 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.327999  5657 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:40.337859  5647 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:40.213246  5643 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:40.350585  5648 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.307402  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1869) took 2126 ms. Trace:
I20260709 12:58:40.361846  5470 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:40.370008  1644 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:58:40.363000  1463 catalog_manager.cc:5697] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 8, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:40.377449  5393 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.378836  5395 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.382628  5201 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:40.384459  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 503) took 1641 ms. Trace:
I20260709 12:58:40.391043  5546 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:40.390942  5558 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:58:40.392382  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.392835  5594 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.395673  5439 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:40.396119  1610 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:40.660378  1570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.057s	sys 0.134s
I20260709 12:58:40.584914  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:40.660774  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 264767us
I20260709 12:58:40.586467  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:40.629372  5330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.035s	sys 0.038s
W20260709 12:58:40.660799  1570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.057s	sys 0.134s
W20260709 12:58:40.528388  5605 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 1.775s	user 0.002s	sys 0.002s
I20260709 12:58:40.225441  5367 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.259791  5432 raft_consensus.cc:697] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:40.611653  2312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.021s	sys 0.034s
W20260709 12:58:40.770505  2312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.022s	sys 0.034s
W20260709 12:58:40.770898  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 709279us
I20260709 12:58:40.436021  5310 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.109259  5477 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:40.619809  1535 connection.cc:256] RPC call timeout handler was delayed by -1.3988087409999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 12:58:40.781926  1535 connection.cc:256] RPC call timeout handler was delayed by -1.2890087409999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 12:58:40.785444  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:40.669462  5330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.035s	sys 0.038s
I20260709 12:58:40.279332  2345 rpcz_store.cc:276] 0709 12:58:38.242972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.243110 (+   138us) service_pool.cc:224] Handling call
0709 12:58:38.243495 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:38.514942 (+271447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:38.514992 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:38.534405 (+ 19413us) log.cc:844] Serialized 52 byte log entry
0709 12:58:38.741294 (+206889us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:38.741347 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:38.741439 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.979286 (+1237847us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:40.137087 (+157801us) raft_consensus.cc:1685] finished
0709 12:58:40.137123 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.142816 (+  5693us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20146,"raft.queue_time_us":72921,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":15455,"spinlock_wait_cycles":24791808,"thread_start_us":464246,"threads_started":2,"wal-append.queue_time_us":366960}
I20260709 12:58:40.629256  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:40.632812  1563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.018s	sys 0.040s
I20260709 12:58:40.632967  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:40.796473  1563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.018s	sys 0.040s
I20260709 12:58:40.633677  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:40.536445  5619 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:40.614567  5496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.057s	sys 0.084s
I20260709 12:58:40.634861  1642 rpcz_store.cc:276] 0709 12:58:38.181246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.906225 (+724979us) service_pool.cc:224] Handling call
0709 12:58:38.906595 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.013278 (+106683us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:39.390387 (+377109us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.514069 (+123682us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.578846 (+ 64777us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:39.578893 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:39.578951 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.307095 (+728144us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b54002a94d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:40.307156 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.307325 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11369,"prepare.queue_time_us":311273,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":414158,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":117,"spinlock_wait_cycles":72376064,"thread_start_us":548076,"threads_started":3,"wal-append.queue_time_us":158347}
I20260709 12:58:40.802001  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:40.619946  5515 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:40.659291  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.584052  2340 raft_consensus.cc:1240] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:40.609740  5614 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:40.535719  5443 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:40.587337  2343 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:58:40.661835  1712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.034s	sys 0.028s
W20260709 12:58:40.696182  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:40.809398  1712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.035s	sys 0.059s
W20260709 12:58:40.809756  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.728101  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:40.711313  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.729781  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:40.812093  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:40.814800  1720 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:40.726610  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:40.742316  1643 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:58:40.741679  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 557) took 1529 ms. Trace:
I20260709 12:58:40.817508  1721 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
W20260709 12:58:40.777527  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 388530us
I20260709 12:58:40.742142  1714 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:40.788483  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.789425  1571 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:40.801558  5621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.199s	user 0.017s	sys 0.018s
I20260709 12:58:40.789913  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:40.790017  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:40.790619  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:40.792563  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:40.787909  1568 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:40.609416  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:40.794755  1569 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:40.883625  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:40.884209  1568 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:40.651741  5035 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.896324  5035 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.897745  5654 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:40.898383  2340 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:58:40.898538  5035 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:40.742319  5525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.933s	user 0.015s	sys 0.004s
W20260709 12:58:40.899469  5525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.090s	user 0.015s	sys 0.008s
I20260709 12:58:40.797895  1713 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:40.798277  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:40.777240  5439 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.900470  2344 raft_consensus.cc:2393] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:40.630141  5657 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.653714  1719 rpcz_store.cc:276] 0709 12:58:38.742720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.322733 (+580013us) service_pool.cc:224] Handling call
0709 12:58:39.323012 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.358440 (+ 35428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.358469 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:39.358511 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:39.358542 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.384235 (+1025693us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b5400300054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:40.384277 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.384400 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81051008}
I20260709 12:58:40.741179  5471 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:40.741441  5409 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.722952  5594 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.817656  1644 rpcz_store.cc:276] 0709 12:58:39.212574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.311202 (+ 98628us) service_pool.cc:224] Handling call
0709 12:58:40.741498 (+1430296us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400336b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:40.741624 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335909632}
I20260709 12:58:40.812260  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:40.786221  5367 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.778795  5633 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:40.808046  5496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.057s	sys 0.085s
I20260709 12:58:40.790004  5553 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.939489  1568 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:40.940493  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:40.941367  1568 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:40.818974  5614 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.825415  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:40.827100  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.879148  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1826) took 2567 ms. Trace:
I20260709 12:58:40.944540  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:40.878180  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:40.880241  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:40.881572  2341 raft_consensus.cc:2393] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:40.879518  1572 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:40.949419  5035 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:40.950562  5035 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:40.950914  5035 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:40.951786  5035 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:40.874693  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.947679  1712 rpcz_store.cc:276] 0709 12:58:38.311529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.311656 (+   127us) service_pool.cc:224] Handling call
0709 12:58:38.361052 (+ 49396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:38.361502 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:38.406249 (+ 44747us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.891205 (+1484956us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b180048a060. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d423a 00007f6a4273ea2a
0709 12:58:40.878800 (+987595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:40.878856 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:40.878903 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.878990 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.879095 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19320,"prepare.queue_time_us":36228,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":9264,"raft.queue_time_us":84856,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":13971712,"thread_start_us":918460,"threads_started":1,"wal-append.queue_time_us":2480295}
I20260709 12:58:40.874148  1716 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:40.824658  1720 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:58:40.883852  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.884473  1569 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:40.853330  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:40.819473  5310 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:40.885404  5203 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:40.802904  5595 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.889045  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.889353  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:40.890089  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:40.890578  5658 consensus_queue.cc:1059] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:40.892158  5601 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:40.639719  5643 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.893432  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:40.895285  5515 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:40.900765  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:40.901710  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1863) took 2988 ms. Trace:
I20260709 12:58:40.902082  5439 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:40.798552  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.904152  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.929312  5647 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:40.905830  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:40.906320  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.975828  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:40.909972  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:40.910822  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:40.850821  5621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.248s	user 0.017s	sys 0.018s
W20260709 12:58:40.901767  5672 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:58:40.924080  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 111890us
I20260709 12:58:40.773922  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:40.823506  5619 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:40.880832  5610 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:40.934247  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:40.818773  5443 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:40.797657  2349 raft_consensus.cc:2410] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:58:40.954200  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:41.007346  1716 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:40.953527  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:41.008287  1712 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:40.999429  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:40.965514  1721 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:40.966495  1713 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:41.009881  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:41.010164  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.010581  1721 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:41.010983  1713 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:41.011421  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:40.967383  1718 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:41.012029  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:40.965447  1647 rpcz_store.cc:276] 0709 12:58:37.913629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.156376 (+242747us) service_pool.cc:224] Handling call
0709 12:58:38.156703 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:38.361696 (+204993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:38.361824 (+   128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:38.377681 (+ 15857us) log.cc:844] Serialized 26 byte log entry
0709 12:58:38.485304 (+107623us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:38.485354 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:38.485445 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:40.440235 (+1954790us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:40.901403 (+461168us) raft_consensus.cc:1685] finished
0709 12:58:40.901432 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.901647 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50178,"raft.queue_time_us":102389,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":32209,"spinlock_wait_cycles":145956224,"thread_start_us":231905,"threads_started":2,"wal-append.queue_time_us":292042}
I20260709 12:58:41.012718  1713 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.013310  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.014045  1647 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:40.958379  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:40.905406  2340 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:58:40.972889  1641 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:41.015475  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:41.016196  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.016816  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.972594  1566 raft_consensus.cc:2376] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11. Re-sending same reply.
W20260709 12:58:40.976049  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.906874  1645 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:40.927037  5471 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:40.992921  1719 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:41.029062  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:40.993369  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.993949  2345 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:40.994518   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:41.030642  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:41.031252  1721 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:41.031152  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.032799  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.972121  1714 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:40.993569  1643 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:41.035712  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:41.036535  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:41.037140  1643 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:41.037299  1718 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:41.001883  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:40.998663  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:41.038092  1567 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:40.998025  1568 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:41.038235  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:40.998849  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:40.994634  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 50204.9us
I20260709 12:58:41.010490  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:40.974861  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.039502  1569 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:40.926857  5409 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.050115  5409 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.050495  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:41.052424  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.053143  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:40.993144  5647 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.936981  5633 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:40.999347  1572 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:58:41.045334  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.058231  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.046587  5643 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:40.946364  5553 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.007023  5035 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:41.057549  1712 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:41.058697  1684 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:41.027105  5526 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:41.077790  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.078375  1712 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:41.039213  1718 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 8: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:41.065264  1642 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:41.053884  1567 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:40.974871  5601 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.029835  5654 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:41.083820  5654 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.084321  5654 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:41.084607  5657 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:41.085301  5643 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:41.066946  1566 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:40.974943  5595 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.081143  1571 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:41.067237  1714 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:41.057798  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:41.079211  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.059332  1713 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:41.090376  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.091737  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.050657  5548 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:41.102892  1721 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:41.079280  5648 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:41.114058  1719 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.063699  5647 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:41.060360  5621 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:41.094576  1686 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:41.054414  5546 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:58:41.073413  5203 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:41.029397  5550 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:58:40.962070  5432 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.117365  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.137442  1718 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:41.122225  1646 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:58:41.085804  5643 raft_consensus.cc:697] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:41.099164  1716 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:41.139810  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1916) took 1245 ms. Trace:
I20260709 12:58:41.130074  1719 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:41.138998  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.087387  5661 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:41.060685  5460 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:58:41.140594  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.045256  5471 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.051223  5522 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:58:41.068058  5409 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:58:41.140618  1644 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:40.942433  1463 catalog_manager.cc:5697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.144245  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1852) took 3282 ms. Trace:
I20260709 12:58:41.154830  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1915) took 1264 ms. Trace:
I20260709 12:58:41.156124  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.154856  1638 rpcz_store.cc:276] 0709 12:58:37.862119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.114112 (+251993us) service_pool.cc:224] Handling call
0709 12:58:38.115165 (+  1053us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:58:38.178330 (+ 63165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:38.178360 (+    30us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:58:38.186644 (+  8284us) log.cc:844] Serialized 104 byte log entry
0709 12:58:38.925733 (+739089us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:40.432487 (+1506754us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800415180. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4612c3c7 00007f6a4273e9a7 00007f6a4274e0bf
0709 12:58:40.498583 (+ 66096us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.138765 (+640182us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.139196 (+   431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.139297 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.143976 (+  4679us) raft_consensus.cc:1685] finished
0709 12:58:41.144001 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.144176 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39853,"prepare.queue_time_us":251847,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":63754,"raft.run_cpu_time_us":590,"raft.run_wall_time_us":34969,"spinlock_wait_cycles":26126720,"thread_start_us":1505199,"threads_started":4,"wal-append.queue_time_us":1236553,"wal-append.run_cpu_time_us":2891,"wal-append.run_wall_time_us":1006146}
I20260709 12:58:41.158627  1714 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:41.145845  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.160045  1714 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:58:41.101019  5469 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:41.161921  1714 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:41.155261  1565 rpcz_store.cc:276] 0709 12:58:39.890450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.892747 (+  2297us) service_pool.cc:224] Handling call
0709 12:58:39.893090 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:40.062534 (+169444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:40.062583 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:40.063153 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:58:40.251314 (+188161us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:40.282491 (+ 31177us) log.cc:844] Serialized 14 byte log entry
0709 12:58:40.282763 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.405304 (+122541us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b18001ad460. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6152a6 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419
0709 12:58:40.472080 (+ 66776us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18001ad460. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:40.496771 (+ 24691us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400002dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:40.496845 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.154620 (+657775us) raft_consensus.cc:1685] finished
0709 12:58:41.154644 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.154774 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8122,"prepare.queue_time_us":30897,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1857,"raft.queue_time_us":951,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":11079,"spinlock_wait_cycles":401444608,"thread_start_us":151018,"threads_started":1,"wal-append.queue_time_us":639511}
I20260709 12:58:41.163379  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.164314  1718 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 8: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:41.166290  1714 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:58:41.166878  1714 pending_rounds.cc:85] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 4
I20260709 12:58:41.167275  1714 pending_rounds.cc:107] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:58:41.100934  5548 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:41.169308  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.151350  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:41.170428  1642 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:41.171949  5683 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:58:41.172739  5548 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.173727  5469 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:41.142110  5477 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.152813  5621 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:41.085986  5201 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 12:58:41.177191  5676 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:58:41.124769  5526 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.177917  5526 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.140223  1563 rpcz_store.cc:276] 0709 12:58:39.894123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.894281 (+   158us) service_pool.cc:224] Handling call
0709 12:58:39.894658 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:39.895028 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.895059 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:39.895654 (+   595us) log.cc:844] Serialized 52 byte log entry
0709 12:58:40.796861 (+901207us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.102226 (+305365us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.139283 (+ 37057us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.139487 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.139574 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.139621 (+    47us) raft_consensus.cc:1685] finished
0709 12:58:41.139635 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.139752 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26552,"prepare.queue_time_us":99736,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":655,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":80,"thread_start_us":1205535,"threads_started":2,"wal-append.queue_time_us":903611}
I20260709 12:58:41.148995  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.179797  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.180187  1639 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:41.181347  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.167744  1714 raft_consensus.cc:2889] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:41.187686  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.141227  5659 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:41.199354  1642 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:41.200481  1712 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:58:41.201411  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.204607  1712 pending_rounds.cc:85] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 4
I20260709 12:58:41.204968  1712 pending_rounds.cc:107] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:58:41.204919  1644 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:41.205456  1712 raft_consensus.cc:2889] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:41.207388  1712 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:41.202277  1639 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:41.209784  1642 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:41.210526  5526 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:41.210842  1639 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:41.214613  1716 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:41.243774  1643 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
W20260709 12:58:41.213868  5675 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 12:58:41.255470  1718 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:58:41.259115  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 208670us
W20260709 12:58:41.260190  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 134313us
I20260709 12:58:41.262907  1686 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:41.264212  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:41.267161  1684 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:41.268221  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.270949  1612 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:41.272754  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:41.248054  5367 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:41.272620  1684 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:41.271986  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 218375us
I20260709 12:58:41.284333  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:41.292101  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:41.297042  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.297518  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:41.298097  1642 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:41.299003  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:41.254676  5614 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:41.300144  1537 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:41.270565  5409 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:41.273798  5439 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:41.341059  1537 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:41.300460  5648 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:41.277407  5477 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:41.356227  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 64212.5us
I20260709 12:58:41.303973  5649 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:41.247641  5643 consensus_queue.cc:237] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.299943  5601 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.359378  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:41.310936  5522 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:41.269950  5621 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
W20260709 12:58:41.360493  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 87978.8us
I20260709 12:58:41.299099  5661 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:58:41.341562  5409 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.355419  5553 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:41.340862  5614 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:41.371995  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:41.356479  5526 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:41.354871  5633 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:41.355899  5648 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.311640  5367 consensus_queue.cc:1059] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:58:41.343767  5692 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:41.361809  5550 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:41.358928  5477 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.359043  5595 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:41.434078  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 74717.4us
I20260709 12:58:41.406304  5426 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:41.407032  5439 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:41.425163  5614 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.424121  5526 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.363601  5649 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:41.366000  5522 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:41.431963  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.314720  5690 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
W20260709 12:58:41.415402  5655 consensus_meta.cc:287] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.000s
I20260709 12:58:41.412791  5661 consensus_queue.cc:1243] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:41.415449  5409 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:41.439913  5526 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.458192  1712 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:58:41.439991  5614 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:41.462276  1716 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:41.463937  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 548040us
I20260709 12:58:41.467684  5679 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:41.468086  5679 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:41.468806  5496 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:41.469040  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:41.468896  5679 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.469417  5496 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.470351  5679 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:41.471491  5496 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.472538  2349 raft_consensus.cc:1240] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:41.475837  5599 raft_consensus.cc:3055] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:41.476230  5599 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:41.440310  5439 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:41.440847  5522 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:41.477092  5599 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.478153  5599 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.483093  1721 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:58:41.428860  5550 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.304868  1463 catalog_manager.cc:5697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 8, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 8 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.484841  5659 consensus_queue.cc:1059] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:58:41.485795  5659 raft_consensus.cc:3055] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:41.486164  5659 raft_consensus.cc:740] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:41.485965  1463 catalog_manager.cc:5697] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 10, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:41.486929  5659 consensus_queue.cc:260] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.487690  5443 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:41.488121  5659 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:41.442845  5674 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:41.489320  5674 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.489701  5674 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:41.490742  5696 log.cc:927] Time spent T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:58:41.442453  5689 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:58:41.493453  1719 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:58:41.494163  5689 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:41.494526  5651 consensus_meta.cc:287] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 1.203s	user 0.009s	sys 0.000s
I20260709 12:58:41.441404  1642 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:41.364300  5658 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 12:58:41.439574  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 136312us
I20260709 12:58:41.429697  5648 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:41.460443  1712 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:41.442271  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 832863us
I20260709 12:58:41.434808  5477 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.498744  2312 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:41.455806  1715 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:58:41.506994  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:41.509574  1715 pending_rounds.cc:85] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 5
I20260709 12:58:41.509895  1715 pending_rounds.cc:107] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:58:41.438230  5553 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:41.510341  1715 raft_consensus.cc:2889] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:41.455289  5597 consensus_meta.cc:287] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.980s	user 0.011s	sys 0.000s
I20260709 12:58:41.497979  1721 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:41.511839  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:41.508558  5686 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 12:58:41.511422  2312 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:41.494686  5689 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.514544  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:41.488047  1463 catalog_manager.cc:5697] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 9, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:41.454106  5661 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:41.538515  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:41.548198  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.502789  5649 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:41.477133  5439 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.468564  5647 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.455416  5620 raft_consensus.cc:3055] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:41.442760  5701 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:41.484862  5550 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:41.509861  5692 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:41.451853  5548 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:41.546752  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 111391us
I20260709 12:58:41.578549  5633 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.515419  5496 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:41.625097  1718 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:41.558125  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 46915.8us
I20260709 12:58:41.517834  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:41.538555  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:41.541774  5667 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:41.627730  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 89265.5us
I20260709 12:58:41.629431  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.517867  5693 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:41.546366  5367 raft_consensus.cc:3055] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:41.515637  5426 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:41.587368  1717 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
W20260709 12:58:41.594301  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 55888.6us
W20260709 12:58:41.597246  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 93456.6us
I20260709 12:58:41.643409  1535 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:41.612881  5673 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:41.577390  5661 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:41.535940  5515 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:41.681769  1713 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:41.536892  5310 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.535475  5525 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:41.558416  5597 raft_consensus.cc:3060] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:41.543597  5689 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:41.627748  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:41.628484  2312 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:41.695776  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:41.639523  5671 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:41.639257  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.547876  5641 raft_consensus.cc:1064] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:58:41.644599  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.701690  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.702699  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.597129  5620 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:41.705668  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:41.706293  1567 raft_consensus.cc:3060] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:41.615542  5621 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.682133  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.710516  1720 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:41.654983  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.654278  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:41.688575  5035 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:41.690989  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.717507  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.691736  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.681519  5515 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.577520  5553 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:41.703701  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 76061.1us
I20260709 12:58:41.734696  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:41.640751  5367 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:41.707814  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.708412  1712 raft_consensus.cc:2410] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 11 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:41.681205  5661 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:41.712189  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.692427  5525 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.742614  1566 raft_consensus.cc:2393] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:41.647042  5426 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.648756  5434 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:58:41.681623  5690 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:41.732542  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 78356.5us
I20260709 12:58:41.647460  5610 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.624274  5614 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.737056  1568 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:41.647285  5522 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:41.712739  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.691677  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:41.707149  5671 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.750068  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:41.751096  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 122712us
I20260709 12:58:41.751609  1566 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:41.751547  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.640257  5633 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.752210  5673 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:41.707198  5601 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:41.745594  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.744626  5595 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.741930  5035 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.798043  5595 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.799634  5035 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:41.800065  5595 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:41.760885  1569 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:41.801872  1571 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 12. Current term is 13. Ops: []
W20260709 12:58:41.752280  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 66328.4us
I20260709 12:58:41.803117  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:41.742969  5515 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:41.699313  5667 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:58:41.742929  5643 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:41.695642  5310 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.647893  5693 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.834923  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.718015  5546 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:58:41.774493  1720 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:41.761042  5702 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.762408  5434 consensus_queue.cc:1243] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer 2af567a273d44ca89d2b3b0f7c815bd1 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:41.646893  1463 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:41.719277  5409 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.453100  5655 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.548375  5674 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.874336  2347 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:41.875686  5674 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:41.495157  5651 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.877347  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1836) took 3440 ms. Trace:
I20260709 12:58:41.877835  1715 rpcz_store.cc:276] 0709 12:58:38.437197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.175524 (+738327us) service_pool.cc:224] Handling call
0709 12:58:39.182504 (+  6980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.514376 (+2331872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.877094 (+362718us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54002c38d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:41.877275 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5227152768}
I20260709 12:58:41.878453  5651 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:41.828099  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 456171us
I20260709 12:58:41.879664  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:41.880527  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:41.881320  1712 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:58:41.783696  5671 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:41.831182  1572 raft_consensus.cc:2410] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:58:41.885171  5597 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:41.748404  5525 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:41.618781  5701 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.734371  5621 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.750329  5694 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:58:41.835566  1641 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:41.895569  1716 raft_consensus.cc:2468] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:41.789649  5471 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:58:41.901006  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 80903.4us
I20260709 12:58:41.850183  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:41.851294  1644 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:41.895294  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:41.881604  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:41.902256  2345 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:41.800417  5526 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.874293  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.854948  5548 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.911432  1718 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:41.855782  5310 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.856190  5633 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:41.857115  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.857764  5693 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.832011  5460 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:41.774174  5692 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.861761  5434 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:41.863059  5647 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.851347  5702 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.864852  5545 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:41.869292  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.844386  5601 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.859422  1567 raft_consensus.cc:2468] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:41.860426  5641 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.881371  5725 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:41.828685  5496 raft_consensus.cc:2804] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:41.900146  1647 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:41.749687  5553 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.956216  5655 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:41.903172  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:41.904723  1712 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:41.908882  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.914059  2314 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:41.762161  5610 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.759608  5620 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.921039  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:41.924754  1640 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:41.957876  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 54785.5us
I20260709 12:58:41.926607  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:41.927678  1684 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:41.970400  1641 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:41.929644  5434 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.919859  5703 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:41.904103  5651 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:41.872190  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:41.920619  5471 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:41.949100  5711 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:58:41.950356  5713 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:58:41.924155  5701 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:42.002972  5695 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.572s	user 0.000s	sys 0.002s
I20260709 12:58:42.004819  5648 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.006017  5471 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:41.969273  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 55334us
I20260709 12:58:41.943380  5658 raft_consensus.cc:2764] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:41.975409  5655 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:41.937486  5545 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:41.927486  5643 consensus_queue.cc:1059] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:58:41.984360  5553 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:41.985069  5614 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:41.985567  5654 consensus_meta.cc:287] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.901s	user 0.008s	sys 0.008s
I20260709 12:58:41.985663  5460 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:41.987108  5702 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.986912  5661 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:41.987598  5691 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.557s	user 0.000s	sys 0.001s
W20260709 12:58:41.987982  5706 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:58:41.989290  5522 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:41.925168  5673 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.990051  5526 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:41.993343  5550 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.998270  5621 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:41.998943  5620 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:41.957561  5601 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:41.976941  5720 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:41.977555  5725 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:41.981454  5703 raft_consensus.cc:697] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:42.009217  5651 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:42.055733  5690 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:41.981287  5727 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:42.056140  5703 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.019440  5655 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:42.047294  5720 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.049616  5725 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.056903  5727 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.059469  5655 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.060806  5720 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:42.060186  5671 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.060993  5727 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:42.065276  5679 consensus_meta.cc:287] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.007s
W20260709 12:58:41.900684  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.101119  1463 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 8, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
W20260709 12:58:42.104030  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.991411  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 2227) took 1262 ms. Trace:
I20260709 12:58:42.120566  1717 rpcz_store.cc:276] 0709 12:58:40.728990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.729505 (+   515us) service_pool.cc:224] Handling call
0709 12:58:41.991199 (+1261694us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54001caa54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:41.991333 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668051328}
W20260709 12:58:41.928534  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:41.975930  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:41.978412  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1842) took 1152 ms. Trace:
I20260709 12:58:42.125059  1644 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:42.125110  1714 rpcz_store.cc:276] 0709 12:58:40.825809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.190188 (+364379us) service_pool.cc:224] Handling call
0709 12:58:41.190477 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.190709 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:41.363074 (+172365us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.974070 (+610996us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.977986 (+  3916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.978052 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:41.978109 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.978198 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.978343 (+   145us) inbound_call.cc:177] Queueing success response
0709 12:58:41.990152 (+ 11809us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b1800489ca0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a4660858f 00007f6a3f647571 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd
Metrics: {"mutex_wait_us":13441,"prepare.queue_time_us":312431,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":83002,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4712,"spinlock_wait_cycles":21738624,"thread_start_us":763740,"threads_started":3,"wal-append.queue_time_us":501598}
I20260709 12:58:42.129792  1565 pending_rounds.cc:85] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 6
I20260709 12:58:42.130249  1565 pending_rounds.cc:107] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:58:42.130685  1565 raft_consensus.cc:2889] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:41.970414  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:42.010722  2314 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:42.133906  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:42.135253  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 124422us
I20260709 12:58:42.131423  1463 catalog_manager.cc:5697] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 8, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
W20260709 12:58:42.138477  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:42.103957  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 399804us
W20260709 12:58:42.138350  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 167902us
I20260709 12:58:42.009582  2347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:42.140856  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:42.141309  2347 raft_consensus.cc:606] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:42.141870  2347 raft_consensus.cc:614] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:42.143770  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:41.977248  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 49666.4us
I20260709 12:58:41.930289  5367 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.146894  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:42.147424  5367 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:42.116950  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.150031  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.150895  1644 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:42.117436  1645 pending_rounds.cc:85] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 9
I20260709 12:58:41.974511  5496 raft_consensus.cc:697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:42.160279  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:41.974668  5434 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.038010  5545 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.053259  5648 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.035813  5649 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.198124  5545 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:42.199169  5649 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.056394  5651 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:58:42.200963  5690 consensus_queue.cc:1175] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "20c9ad12e0d0435f95be2eda5b653b39" responder_term: 11 status { last_received { term: 8 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: [10.5-10.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:42.025444  5654 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:41.975817  5594 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:42.210388  5659 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:42.211249  5659 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:42.154557  1645 pending_rounds.cc:107] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:58:42.158510  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:42.212842  1645 raft_consensus.cc:2889] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:42.213434  1639 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:42.213899  1720 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:42.214692  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.161659  5409 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.035275  5515 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.162070  5496 consensus_queue.cc:237] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.168286  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:42.022784  5460 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.015960  5477 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.138721  1463 catalog_manager.cc:5697] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 1 to 7, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 7 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:42.176352  5471 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:42.177208  5673 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:42.260506  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.169140  5522 consensus_queue.cc:1059] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:58:42.178577  5667 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:42.261569  5667 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.262079  5667 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:42.262511  1642 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:42.188145  5526 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:42.267957  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.268235  5526 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.269097  2340 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:58:42.269275  1463 catalog_manager.cc:5697] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 10, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.271041  5526 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:42.189854  5704 consensus_queue.cc:1059] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:58:42.272207  5704 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:42.272607  5704 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:42.204589  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.016446  5525 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.207736  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:42.273803  5704 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.217391  5701 consensus_queue.cc:1059] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:58:42.276005  5525 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.216759  5553 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.250293  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1873) took 1466 ms. Trace:
I20260709 12:58:42.216470  5720 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.247196  5727 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.240936  5659 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.250398  1537 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:42.217618  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:42.256083  2341 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:58:42.257073  5515 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.284979  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1976) took 1015 ms. Trace:
I20260709 12:58:42.258792  5477 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.270964  5649 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:42.275599  5704 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:42.273828  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.282833  5727 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:42.278194  5553 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.285954  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:42.309358  2345 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.309796  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:42.310635  2340 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:42.314643  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:42.315588  1571 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:42.276934  1640 rpcz_store.cc:276] 0709 12:58:40.783592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.785923 (+  2331us) service_pool.cc:224] Handling call
0709 12:58:40.786277 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.969981 (+1183704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.249721 (+279740us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001c4654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:42.250050 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617643264}
I20260709 12:58:42.290143  5654 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:42.317142  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:42.317960  1640 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:42.290438  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.278553  2349 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:42.280543  5522 raft_consensus.cc:3055] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:42.276427  5701 raft_consensus.cc:3055] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:42.320371  5701 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:42.322158  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1878) took 1537 ms. Trace:
I20260709 12:58:42.321794  5701 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.322513  1647 rpcz_store.cc:276] 0709 12:58:40.784981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.195397 (+410416us) service_pool.cc:224] Handling call
0709 12:58:41.195686 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.943732 (+748046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.321745 (+378013us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400192dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:42.322001 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599363840}
I20260709 12:58:42.323608  5701 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:42.324762  5522 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:42.325385  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:42.326406  2340 raft_consensus.cc:2393] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 13: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:42.326195  5522 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.327983  5661 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.281060  5720 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.291481  5550 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.258217  1717 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:42.305297  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:42.303048  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 99397.5us
I20260709 12:58:42.328317  5522 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:42.336355  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.339465  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.340147  1640 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.294004  1646 rpcz_store.cc:276] 0709 12:58:41.268144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.268249 (+   105us) service_pool.cc:224] Handling call
0709 12:58:41.292839 (+ 24590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.516370 (+223531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.516402 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.537079 (+ 20677us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.709281 (+172202us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:41.743581 (+ 34300us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.743843 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.282586 (+538743us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b54002666d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:42.282659 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.282739 (+    80us) raft_consensus.cc:1685] finished
0709 12:58:42.282837 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.283020 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35894,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":66078,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":13501,"spinlock_wait_cycles":150117760,"thread_start_us":232840,"threads_started":2,"wal-append.queue_time_us":273842}
I20260709 12:58:42.342079  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.342756  1639 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:42.345155  1644 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:42.351059  5610 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.351692  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:42.352720  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 102512us
I20260709 12:58:42.353006  5610 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:58:42.353317  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 48170.3us
I20260709 12:58:42.354547  5558 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:42.355087  5558 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:42.355548  5558 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:42.357149  5515 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:42.357854  5515 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:42.358367  5515 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:42.329161  5553 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.382228  1684 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:42.385309  1643 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.364078  2340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13d708096220406385b27d464c8725f2"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:42.391635  2340 raft_consensus.cc:606] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:42.396003  1571 raft_consensus.cc:2468] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:42.359396  5689 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:58:42.377281  5526 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:58:42.409185  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50628.9us
I20260709 12:58:42.414896  5617 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:42.415293  5617 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:42.416771  1641 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:42.419219  5434 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:42.423108  5439 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.830s	user 0.016s	sys 0.001s
I20260709 12:58:42.423599  5439 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.436820  5610 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:42.437284  5610 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.437646  5610 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:42.440812  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 107436us
I20260709 12:58:42.443519  5446 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:58:42.444123  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.444542  5599 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:42.444965  5599 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:42.446130  5661 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:42.446030  5599 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.447491  5599 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.412680  2314 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:42.389636  5737 log.cc:927] Time spent T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
W20260709 12:58:42.456488  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 43908us
I20260709 12:58:42.276219  1463 catalog_manager.cc:5697] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 7, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 7 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.471997  2341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:42.473654  2341 raft_consensus.cc:606] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:42.474103  2341 raft_consensus.cc:614] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:42.459378  5446 raft_consensus.cc:2804] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:42.482091  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 73219.3us
I20260709 12:58:42.481904  5460 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:42.488273  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.401103  5553 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:58:42.486918  2345 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:42.459045  5689 consensus_queue.cc:1243] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:42.416232  5617 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.491941  5657 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:58:42.492681  5601 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.493330  5460 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:42.493983  5741 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:58:42.494220  1567 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 12. Current term is 13. Ops: []
W20260709 12:58:42.498198  5739 log.cc:927] Time spent T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:58:42.498740  5671 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.498965  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1844) took 1624 ms. Trace:
W20260709 12:58:42.499843  5668 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 1.480s	user 0.000s	sys 0.006s
I20260709 12:58:42.510493  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:42.510044  1640 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:42.511721  1713 rpcz_store.cc:276] 0709 12:58:40.874867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.196538 (+321671us) service_pool.cc:224] Handling call
0709 12:58:41.244416 (+ 47878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.682296 (+437880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.498510 (+816214us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400105ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:42.498792 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005332736}
I20260709 12:58:42.524959  5657 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:42.525424  5657 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:42.526343  5657 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.527652  5657 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:42.529716  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.531416  5617 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.511143  5446 raft_consensus.cc:697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:42.533515  5446 consensus_queue.cc:237] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.536906  1645 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:58:42.539642  5720 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:58:42.553273  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 82815.2us
I20260709 12:58:42.554953  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:42.519156  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:42.564862  2345 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:42.565454  5692 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:42.565878  5692 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:42.566859  5692 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.568192  5692 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:42.568820  5654 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:58:42.575505  5747 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:58:42.576661  5434 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:42.581192  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 93684.4us
I20260709 12:58:42.580713  1639 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
W20260709 12:58:42.581429  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 111204us
I20260709 12:58:42.588457  1643 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:42.585847  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:42.580273  5654 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.587275  5601 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:58:42.607136  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:42.598217  5654 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:42.609520  5595 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:42.612388  1463 catalog_manager.cc:5697] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 9, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 9 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.601020  5720 raft_consensus.cc:2764] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:58:42.620963  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:42.624276  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1924) took 2686 ms. Trace:
I20260709 12:58:42.623987  5515 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.619575  5595 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.630007  5651 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:42.586712  5667 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.585503  5704 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:58:42.633009  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:42.651202  1717 raft_consensus.cc:2410] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 12:58:42.633751  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 73409.6us
I20260709 12:58:42.633884  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:42.635205  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:42.635224  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 80366.6us
I20260709 12:58:42.625404  1684 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:42.641412  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:42.653275  1719 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:42.656317  1712 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:42.649344  5595 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:42.664795  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:42.668752  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 43533.9us
I20260709 12:58:42.654898  5610 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.690389  2347 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:58:42.690230  5446 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:42.658167  5434 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.643507  1570 rpcz_store.cc:276] 0709 12:58:39.938111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.945731 (+  7620us) service_pool.cc:224] Handling call
0709 12:58:39.946157 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:39.946643 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.946686 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:39.947270 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 12:58:40.721843 (+774573us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:40.777395 (+ 55552us) log.cc:844] Serialized 14 byte log entry
0709 12:58:40.792058 (+ 14663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.792166 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:40.896548 (+104382us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b1800002a40. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:42.410206 (+1513658us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:42.623755 (+213549us) raft_consensus.cc:1685] finished
0709 12:58:42.623777 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.623994 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6981,"prepare.queue_time_us":61297,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":16491,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":15129,"spinlock_wait_cycles":14087168,"thread_start_us":647076,"threads_started":1,"wal-append.queue_time_us":970456}
I20260709 12:58:42.694319  2314 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:42.694577  1714 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:42.699611  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:42.699352  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:42.723960  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:42.738096  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.757589  1712 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:42.762367  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:42.762002  1721 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:42.703676  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:42.660077  5651 raft_consensus.cc:697] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:42.704298  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:42.700284  5746 log.cc:927] Time spent T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:58:42.774995  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:42.700539  5659 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:42.692601  5610 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.706758  5330 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:42.828855  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:42.828403  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 129177us
I20260709 12:58:42.830220  1718 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:42.829622  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.699663  5434 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.829614  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:42.815375  5601 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:42.828190  1721 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:42.837129  5620 consensus_meta.cc:287] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.771s	user 0.005s	sys 0.010s
I20260709 12:58:42.828190  5496 raft_consensus.cc:2804] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:42.829214  5617 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:42.860939  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 166707us
I20260709 12:58:42.837927  5659 raft_consensus.cc:697] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:42.856319  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:42.865345  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:42.869077  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 95785.5us
I20260709 12:58:42.870502  1639 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:42.850044  5657 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.875236  1643 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:42.872514  1684 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:42.870223  5496 raft_consensus.cc:697] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:58:42.882947  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.833261  5330 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:42.899770  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.894105  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:42.874668  5701 consensus_meta.cc:287] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.551s	user 0.013s	sys 0.000s
I20260709 12:58:42.903688  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:42.905262  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:42.904016  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:42.697594  1463 catalog_manager.cc:5697] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 8, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:58:42.909004  1572 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:42.912848  5657 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:42.913329  5748 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:58:42.915035  5657 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:42.893893  5744 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 12:58:42.916811  1567 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
W20260709 12:58:42.918241  5749 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:58:42.919209  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:42.920177  5434 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.920828  5515 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.922434  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:42.924156  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:42.925928  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:42.927342  5432 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.927516  5654 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.928040  5432 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.931424  2349 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:58:42.932521  5674 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:42.932607  5701 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:42.937419  5701 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.937902  5667 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.938961  5496 consensus_queue.cc:237] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.939620  5701 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.942660  5330 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.942718  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:42.943554  5432 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:42.943857  1572 raft_consensus.cc:2393] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:42.943691  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:42.933169  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:42.904927  5550 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:42.956353  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:42.957403  2345 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:42.958655  1641 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:42.961820  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:42.961948  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:42.962495  1639 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:42.963083  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:42.962924  5689 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:42.963563  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:42.963894  1572 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:42.964568  1537 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:42.965000  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 59833.5us
I20260709 12:58:42.967613  5654 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.968888  5601 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:42.969424  5601 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:42.970396  5601 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.935964  5656 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:42.971544  5656 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:42.972187  5330 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:42.972724  5330 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.973770  5656 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:42.974613  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:42.974808  5330 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:42.972903  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:42.977248  2349 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:42.976989  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:42.978824  1646 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:42.979081  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:42.984825  5550 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:42.987834  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:42.988107  5550 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:42.989157  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:42.936620  5522 consensus_meta.cc:287] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.592s	user 0.013s	sys 0.001s
W20260709 12:58:42.936259  5558 consensus_meta.cc:287] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 12:58:43.002754  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:43.003433  1641 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:58:42.935703  5553 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:42.968477  5654 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:43.068063  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 103654us
I20260709 12:58:43.069159  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:43.073335  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:43.066586  1645 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:43.077881  1718 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:43.080054  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:43.081003  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 156888us
I20260709 12:58:42.985119  5610 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:43.093417  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.081760  2314 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:43.096820  1684 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:42.912547  5595 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.123147  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:43.080376  5740 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.620s	user 0.005s	sys 0.001s
W20260709 12:58:43.190326  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 93672.3us
I20260709 12:58:43.079864  5460 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:43.200902  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 119206us
I20260709 12:58:43.081506  5446 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:43.203670  1639 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 7.
W20260709 12:58:43.204113  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 130872us
I20260709 12:58:43.207823  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.209698  1645 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:43.218778  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.219163  5595 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:43.219673  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.220062  5595 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:43.220156  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.221135  1563 raft_consensus.cc:2410] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:43.206460  5673 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:43.222535  5673 raft_consensus.cc:697] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:58:43.224735  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 366231us
I20260709 12:58:43.211342  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:43.226323  2346 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:43.219257  5553 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.227454  1641 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:43.211323  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:43.005034  5330 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.164s
I20260709 12:58:42.933197  5651 consensus_queue.cc:237] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.233431  1720 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:58:43.065956  5558 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.204728  5460 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:43.232632  1642 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:43.249015  1644 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:43.234319  5595 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:43.249351  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:43.219188  5621 consensus_queue.cc:1059] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 12:58:43.251101  5658 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:43.251555  5657 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:43.256321  5439 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:43.284425  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.223722  5673 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.241246  5515 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:43.294319  1571 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:43.264842  5460 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:43.296960  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 85721.9us
I20260709 12:58:43.272332  5704 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.298486  1639 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:43.298650  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.303452  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:43.272501  5658 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:43.313167  5658 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.314162  5658 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:43.309369  1569 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:58:43.309126  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.309353  5704 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.317581  1568 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:43.311035  1567 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:58:43.311818  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 51201.9us
I20260709 12:58:43.218791  5659 consensus_queue.cc:237] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.325400  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:43.327922  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.294351  5617 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:43.330195  1537 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:43.343794  1645 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:43.341533  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:43.351274  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:43.358383  1646 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
W20260709 12:58:43.324327  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0583836609999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 12:58:43.361826  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 45272.9us
I20260709 12:58:43.328680  5601 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:43.369984  5439 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:43.370646  5439 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.372906  5432 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:43.373044  5439 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:43.373646  5432 raft_consensus.cc:697] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:43.373802  5657 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:43.374806  5432 consensus_queue.cc:237] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.352108  1717 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:43.382215  2348 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:43.385385  1569 raft_consensus.cc:1275] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:43.394431  5601 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:43.397938  5692 consensus_meta.cc:287] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.829s	user 0.010s	sys 0.003s
I20260709 12:58:43.400068  1568 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:43.432632  1567 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:58:43.382227  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:43.440490  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:43.442471  1565 raft_consensus.cc:2410] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:58:43.445703  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 120433us
W20260709 12:58:43.446209  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 70270.5us
I20260709 12:58:43.447203  5661 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:43.457763  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:43.458542  1717 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:43.456187  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.444180  5692 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.485350  5692 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.487931  5692 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:43.480948  1716 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:43.469991  5601 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:43.484766  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.491044  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.492365  5460 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.507480  2314 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:43.511263  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:43.512662  5762 consensus_queue.cc:1059] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:58:43.546221  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.547058  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.559243  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:43.564795  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 58594.9us
I20260709 12:58:43.495082  5460 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:43.573904  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 364817us
I20260709 12:58:43.587139  2341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:43.543463  5667 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:43.438915  5595 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.595788  1564 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:58:43.587739  2341 raft_consensus.cc:606] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:43.596901  2341 raft_consensus.cc:614] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:43.503585  5671 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:58:43.543258  5617 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:43.636799  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.580832  5550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.013s	sys 0.013s
W20260709 12:58:43.732327  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 146466us
I20260709 12:58:43.589131  5553 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:43.594727  5558 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:43.592469  5667 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:43.626107  5692 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:43.725415  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 519) took 1124 ms. Trace:
I20260709 12:58:43.649147  5674 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.657030  5704 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:43.618577  5434 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:58:43.734107  5550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.013s	sys 0.014s
I20260709 12:58:43.644495  5763 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
W20260709 12:58:43.740074  5654 consensus_meta.cc:287] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.003s
I20260709 12:58:43.741128  5667 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:43.743696  5671 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:58:43.760833  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 313718us
W20260709 12:58:43.757506  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.745460  5330 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:43.625517  5610 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:43.757633  5654 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:43.740571  1713 rpcz_store.cc:276] 0709 12:58:42.601463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.605153 (+  3690us) service_pool.cc:224] Handling call
0709 12:58:42.612119 (+  6966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.612725 (+   606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.612754 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.613342 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.848675 (+235333us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:43.236836 (+388161us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.725049 (+488213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.725155 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.725195 (+    40us) raft_consensus.cc:1685] finished
0709 12:58:43.725205 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.725341 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89242,"prepare.queue_time_us":143742,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":36,"raft.queue_time_us":280792,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":10702,"thread_start_us":1047883,"threads_started":3,"wal-append.queue_time_us":453321}
I20260709 12:58:43.772703  5775 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:43.772732  5776 raft_consensus.cc:3055] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:58:43.773518  5761 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:58:43.781118  5774 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.760253  5671 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:43.802518  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:43.804890  5621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.021s
I20260709 12:58:43.794821  5776 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:43.636926  5496 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 12:58:43.760507  5674 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.811092  1686 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:43.809772  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 222212us
W20260709 12:58:43.807745  1641 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.011s
W20260709 12:58:43.832787  1641 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.007s	sys 0.011s
W20260709 12:58:43.813747  5621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.009s	sys 0.021s
I20260709 12:58:43.837433  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:43.825282  5553 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:43.814286  5658 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:43.874137  1564 raft_consensus.cc:1240] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:43.790879  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1883) took 1021 ms. Trace:
W20260709 12:58:43.817386  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.877768  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1882) took 1117 ms. Trace:
W20260709 12:58:43.887360  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 110719us
I20260709 12:58:43.878163  1714 rpcz_store.cc:276] 0709 12:58:42.760453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.774289 (+ 13836us) service_pool.cc:224] Handling call
0709 12:58:42.833233 (+ 58944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.860240 (+ 27007us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:43.450971 (+590731us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.870539 (+419568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.870598 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:43.877475 (+  6877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.877555 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.877699 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49026,"prepare.queue_time_us":335442,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":27186,"thread_start_us":781322,"threads_started":2}
W20260709 12:58:43.892886  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 122780us
W20260709 12:58:43.895308  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.841745  5673 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 12:58:43.896425  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.908116  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.915346  1713 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:43.911319  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:43.844856  5550 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:58:43.924365  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 561524us
W20260709 12:58:43.902442  5689 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.005s	sys 0.010s
I20260709 12:58:43.875330  1715 rpcz_store.cc:276] 0709 12:58:42.769626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.771969 (+  2343us) service_pool.cc:224] Handling call
0709 12:58:42.819407 (+ 47438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.833712 (+ 14305us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:42.856997 (+ 23285us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.790439 (+933442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.790505 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:43.790578 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.790670 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.790808 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82039,"prepare.queue_time_us":23139,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":405063,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":12263,"thread_start_us":894880,"threads_started":2,"wal-append.queue_time_us":775234}
I20260709 12:58:43.927644  1537 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:43.929016  1719 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:43.837855  5671 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.932597  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:43.933019  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:43.908403  5434 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:43.935913  2347 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEARNER]: Advancing to term 10
I20260709 12:58:43.841498  5610 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.888389  5785 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:43.935662  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:43.938870  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:43.938961  1684 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:43.937955  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:43.930835  5689 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.005s	sys 0.010s
W20260709 12:58:43.943976  5773 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:58:43.944231  2348 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 14: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:43.944510  2342 raft_consensus.cc:2393] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 14: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
W20260709 12:58:43.945040  5777 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:58:43.922654  5657 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.888635  5658 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.930358  5692 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:43.957868  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.935746  5460 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:43.804141  5774 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.974663  2348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:43.797658  5775 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:43.975273  2348 raft_consensus.cc:606] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:43.976876  1643 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:43.968833  5782 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:58:43.983814  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:43.992400  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1941) took 1136 ms. Trace:
W20260709 12:58:43.992766  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 65067.5us
I20260709 12:58:43.992837  1565 rpcz_store.cc:276] 0709 12:58:42.852778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.852924 (+   146us) service_pool.cc:224] Handling call
0709 12:58:43.986161 (+1133237us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400323054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:43.989344 (+  3183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314560768}
I20260709 12:58:43.993903  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:43.994727  5522 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:43.995131  5522 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:43.995424  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:43.905997  5776 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:43.969023  5460 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.946875  5496 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:58:43.996860  5460 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:44.001117  2342 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:44.001773  5658 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:44.002993  5661 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:44.003396  5661 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:44.003777  5661 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:44.009341  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 59518.9us
I20260709 12:58:44.009397  5654 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:44.010296  1535 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:44.011854  5765 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.499s	user 0.001s	sys 0.001s
I20260709 12:58:44.012869  5432 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:43.968153  5595 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:58:44.018662  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 48833.9us
I20260709 12:58:44.016376  1714 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:43.967919  5798 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:43.960760  5657 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.046950  5657 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:43.964763  5692 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.049023  5692 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:44.031657  1535 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:44.052026  1535 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:58:44.032804  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 49072.9us
I20260709 12:58:44.014425  5788 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:44.053691  1686 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:44.054966  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:44.032933  5791 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:58:44.034546  5775 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:44.034646  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 602) took 1626 ms. Trace:
I20260709 12:58:44.037278  5671 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:44.037971  5674 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:44.040892  5558 consensus_queue.cc:1059] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:44.025745  5798 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.043437  5774 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:44.022491  5784 consensus_queue.cc:1059] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:58:44.018100  5704 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:43.995981  5522 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.062901  1563 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:44.120963  2347 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:44.190954  1571 rpcz_store.cc:276] 0709 12:58:42.411840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.428721 (+ 16881us) service_pool.cc:224] Handling call
0709 12:58:42.429117 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.296058 (+866941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.034330 (+738272us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b54001fe854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:44.034545 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1973154176}
W20260709 12:58:44.205593  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 150694us
I20260709 12:58:44.027387  5595 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:44.205619  5654 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.055291  5432 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:44.189462  5692 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:44.203481  5657 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:58:44.214116  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 162182us
I20260709 12:58:44.260790  1535 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:44.219076  5799 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:44.218513  5798 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:44.280424  1686 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:44.297806  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:44.298789  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:44.275641  5651 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:58:44.301111  5601 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:44.301590  5601 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:44.302397  5601 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.303637  5601 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:44.305804  5785 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:44.269866  5799 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.275941  5657 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:44.264003  5654 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.308250  5460 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.279945  5558 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:44.315599  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:44.327330  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 530) took 1008 ms. Trace:
W20260709 12:58:44.324513  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.326304  2340 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:44.313284  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:44.331172  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:44.353478  2347 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:58:44.353566  2346 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:44.348874  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:44.349220  1684 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:44.358023  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 401595us
W20260709 12:58:44.329115  5770 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.818s	user 0.006s	sys 0.027s
W20260709 12:58:44.318926  5796 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:58:44.319070  5667 consensus_meta.cc:287] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260709 12:58:44.330708  5522 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:44.331549  5772 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:44.361179  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 341685us
I20260709 12:58:44.352720  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:44.339597  5460 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:44.378752  5667 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.379774  5792 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:44.380596  5792 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:44.351193  1718 rpcz_store.cc:276] 0709 12:58:43.318983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.319110 (+   127us) service_pool.cc:224] Handling call
0709 12:58:43.340490 (+ 21380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:43.362448 (+ 21958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.362479 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:43.447597 (+ 85118us) log.cc:844] Serialized 52 byte log entry
0709 12:58:43.885171 (+437574us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:43.885224 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.885313 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.327070 (+441757us) raft_consensus.cc:1685] finished
0709 12:58:44.327097 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.327257 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2588,"raft.queue_time_us":395327,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":20438,"thread_start_us":415961,"threads_started":1,"wal-append.queue_time_us":827528}
I20260709 12:58:44.312954  5799 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:44.320350  5654 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:44.386050  5620 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:44.386471  5620 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:44.386847  5595 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.387408  5620 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.388123  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1901) took 1442 ms. Trace:
I20260709 12:58:44.388752  5620 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:44.388517  1643 rpcz_store.cc:276] 0709 12:58:42.945549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.957803 (+ 12254us) service_pool.cc:224] Handling call
0709 12:58:43.065953 (+108150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.981287 (+915334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.387884 (+406597us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b540040d3d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:44.388062 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094242048}
W20260709 12:58:44.391144  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.389201  5802 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:58:44.392042  1684 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:44.373212  5659 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:44.396503  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.358065  5434 consensus_queue.cc:1048] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:58:44.402665  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:44.383674  5785 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:44.403555  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.407680  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.407541  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:44.381007  5667 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:44.405831  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:44.316095  5657 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.403267  5704 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.411037  1571 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:44.413956  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:44.414671  1712 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:44.411643  1565 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:44.392186  5654 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:44.417950  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:44.428007  1564 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:44.418632  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.420269  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:44.399350  5772 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:58:44.425319  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.426998  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:44.434170  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:44.435143  1567 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:44.423084   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:44.437232  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:44.438042  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:44.421607  5763 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.446475  1570 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:44.441816  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:44.447477  1569 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:44.448068  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.448568  1645 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:44.442117  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:44.443071  1571 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:44.450400  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:44.450659  5805 consensus_queue.cc:1059] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:58:44.451118  1571 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:44.452066  5805 raft_consensus.cc:3055] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:44.452489  5805 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:44.453548  1647 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:44.453639  5805 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.454522  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:44.430696  5772 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:44.455372  5772 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:44.456133  5794 log.cc:927] Time spent T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.489s	user 0.005s	sys 0.007s
I20260709 12:58:44.399025  5775 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:58:44.407235  5659 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.421098  5807 consensus_queue.cc:1059] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:58:44.461428  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2097) took 1161 ms. Trace:
I20260709 12:58:44.461721  5807 raft_consensus.cc:3055] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:44.461843  1563 rpcz_store.cc:276] 0709 12:58:43.300224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.300365 (+   141us) service_pool.cc:224] Handling call
0709 12:58:44.461267 (+1160902us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400094554. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:44.461371 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101367936}
I20260709 12:58:44.462644  5659 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:44.462762  5806 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:58:44.463357  5659 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:44.455590  5704 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.414697  5785 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:44.466420  5704 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:44.466504  1572 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:44.462275  5807 raft_consensus.cc:740] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:44.467803  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:44.468461  5790 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.469183  5790 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.469566  5658 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.467995  5807 consensus_queue.cc:260] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.470144  5658 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.470531  5807 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:44.463953  5659 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.471561  5790 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:44.467041  5785 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:44.472846  5760 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.992s	user 0.010s	sys 0.004s
I20260709 12:58:44.473384  1568 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:44.474318   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:44.472869  5659 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:44.475162  5330 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:44.475616  5330 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:44.476042  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.477198  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1896) took 1609 ms. Trace:
I20260709 12:58:44.477625  1640 rpcz_store.cc:276] 0709 12:58:42.867579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.867729 (+   150us) service_pool.cc:224] Handling call
0709 12:58:42.877569 (+  9840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.878010 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.878042 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.878579 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:58:43.073819 (+195240us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:43.073858 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.073926 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.472139 (+1398213us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:44.476891 (+  4752us) raft_consensus.cc:1685] finished
0709 12:58:44.476914 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.477138 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1785,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":67611,"spinlock_wait_cycles":243689216,"thread_start_us":194858,"threads_started":1,"wal-append.queue_time_us":520130}
I20260709 12:58:44.479876  5786 raft_consensus.cc:3055] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:44.480309  5786 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:44.475956  5330 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:44.476819  5763 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:44.482827  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 237115us
I20260709 12:58:44.497400  1712 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:44.481210  1720 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:44.421795  5788 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:44.439002  5610 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.501091  1641 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:44.512343  1640 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:44.512475  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.513605  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.514256  1643 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:44.515720  2347 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:44.515872  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.515771  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:44.517076  1643 raft_consensus.cc:2410] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:44.517484  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:44.518738  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.501442  1565 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:44.529789  1645 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:44.436450  5654 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.531268  1646 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:44.531316  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:44.532603  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:44.535936  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.536844  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.537881  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:44.539193  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 543824us
I20260709 12:58:44.539507  1571 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:44.498921  5667 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:44.550920  5667 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.553328  5667 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:44.556177  5763 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:44.556934  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.541242  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:44.547582  5553 consensus_meta.cc:287] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.675s	user 0.013s	sys 0.000s
I20260709 12:58:44.561295  1639 raft_consensus.cc:3055] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:44.561952  1639 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:44.567701  1570 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
W20260709 12:58:44.570869  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.570796  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:44.591873  1565 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:58:44.595707  1569 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:44.550035  5772 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.598671  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.613687  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:44.614027  1564 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:44.614285  1720 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:44.614567  1644 raft_consensus.cc:2410] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:58:44.602463  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:44.576434  5553 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:44.615811  1572 raft_consensus.cc:2410] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:58:44.617612  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 1995) took 1641 ms. Trace:
I20260709 12:58:44.618960  1567 raft_consensus.cc:3055] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:44.593946  1639 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.619432  1567 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:44.621636  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:44.613570  5661 consensus_meta.cc:287] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.006s
I20260709 12:58:44.618011  1638 rpcz_store.cc:276] 0709 12:58:42.976562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.978105 (+  1543us) service_pool.cc:224] Handling call
0709 12:58:42.978403 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.282271 (+303868us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:58:43.753406 (+471135us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.980530 (+227124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.980581 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:58:43.980635 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.617366 (+636731us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400336b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:44.617439 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.617551 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8821,"prepare.queue_time_us":516522,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":31,"raft.queue_time_us":13312,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":14704,"spinlock_wait_cycles":651269888,"thread_start_us":628933,"threads_started":2,"wal-append.queue_time_us":458179}
I20260709 12:58:44.631451  1718 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:44.632910  1639 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:44.634801  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:44.635898  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:44.637480  1641 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
W20260709 12:58:44.638501  1463 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.021s	sys 0.030s
W20260709 12:58:44.638948  1463 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.021s	sys 0.030s
I20260709 12:58:44.502341  5792 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.620910  5689 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:44.630235  1567 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.593503  5610 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:44.647544  1535 connection.cc:256] RPC call timeout handler was delayed by -1.0082856709999533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 12:58:44.651307  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 259328us
I20260709 12:58:44.652809  5810 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:44.658699  5817 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 12:58:44.632530  5811 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:44.660790  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:44.658914  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:44.659694  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 88999.4us
I20260709 12:58:44.559283  5786 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.680779  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:44.621325  5798 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.682016  1572 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:44.682555  1684 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:44.652136  5667 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:58:44.698760  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:44.697638  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:44.656459  5689 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:44.659473  5819 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:44.702383  1639 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 12:58:44.729882  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.742591  1639 pending_rounds.cc:85] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:58:44.742866  1639 pending_rounds.cc:107] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:44.743145  1639 raft_consensus.cc:2889] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:44.637974  5661 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.748993  1535 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:44.752372  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 71243.5us
W20260709 12:58:44.750486  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52557.5us
I20260709 12:58:44.753554  1713 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:44.756914  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:44.758157  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:44.759316  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:44.760761  5821 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:44.761246  5821 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:44.761658  5821 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:44.764739  5809 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:44.765446  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 83543.1us
I20260709 12:58:44.766157  5820 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:44.766571  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:44.765332  5809 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.769192  5787 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:58:44.769353  5809 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:44.770351  5822 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:44.752128  5811 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:44.768018  5330 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.760346  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:44.777040  1717 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:44.777837  1537 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:44.778687  1537 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:44.790863  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 92213.1us
I20260709 12:58:44.768262  5601 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:44.792989  1647 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:44.753749  5786 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:44.672338  5810 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:44.790350  5671 consensus_meta.cc:287] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.003s
I20260709 12:58:44.812765  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.813481  5689 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:44.814390  5801 log.cc:927] Time spent T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.838s	user 0.000s	sys 0.003s
I20260709 12:58:44.870072  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:44.791586  5822 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:44.823683  1718 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:44.823793  5772 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:44.825371  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:44.827466  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.805612  5654 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:44.830318  5610 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:44.831871  5798 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:44.796169  5785 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:58:44.835587  1567 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:44.838188  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:44.841008  1645 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:44.842460  1719 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:44.845821  1640 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:44.835654  5799 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.786602  5809 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:44.897249  2342 raft_consensus.cc:1240] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:58:44.755509  5819 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.881186  5818 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:44.868927  5811 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:44.881724  5439 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.882505  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.895680  1720 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:44.820218  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:44.903044  5821 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:44.890834  5689 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:44.887531  5822 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:44.904212  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 92698.7us
I20260709 12:58:44.955547  2343 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
W20260709 12:58:44.905301  5692 consensus_meta.cc:287] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 12:58:44.909199  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:44.896363  5434 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:44.915766  1717 raft_consensus.cc:2410] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:44.916388  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:44.934407  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:44.936456  1712 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [7.4-10.5]
I20260709 12:58:44.952667  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:44.953924  1642 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:44.953440  5787 consensus_queue.cc:1059] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:58:44.961331  1638 raft_consensus.cc:1275] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:58:45.024430  1638 pending_rounds.cc:85] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 9
I20260709 12:58:45.024780  1638 pending_rounds.cc:107] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:58:44.913125  5809 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.027619  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:44.965534  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1895) took 1055 ms. Trace:
I20260709 12:58:44.883854  5553 consensus_queue.cc:1059] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:58:45.025146  1639 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 6.
I20260709 12:58:45.028276  1714 rpcz_store.cc:276] 0709 12:58:43.910115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.930241 (+ 20126us) service_pool.cc:224] Handling call
0709 12:58:43.947815 (+ 17574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.020700 (+ 72885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.958664 (+937964us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b54002de954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:44.965429 (+  6765us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156632832}
W20260709 12:58:44.992170  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.025167  1638 raft_consensus.cc:2889] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:45.030436  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.893476  5558 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:58:45.031765  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.032194  1720 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:58:45.045780  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.955397  5674 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.046716  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 112355us
W20260709 12:58:45.033439  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 47499.4us
I20260709 12:58:44.960232  5822 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:44.965260  5692 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:45.055771  1716 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:58:44.931346  5784 consensus_queue.cc:1059] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:58:45.023722  5610 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.932394  5667 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:58:44.931624  5432 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:58:45.055363  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:45.055552  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:45.061739  1639 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:45.031358  5809 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:45.051076  5522 consensus_meta.cc:287] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.004s
I20260709 12:58:45.065330  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:44.954175  5439 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.068300  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:45.053395  5825 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:45.031402  5763 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:58:45.077482  1716 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:44.942039  5811 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.076998  5827 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.049108  5798 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:58:45.057091  5674 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:44.941495  5818 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:45.093128  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:45.098017  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.062016  5610 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.104316  1717 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:58:45.070379  5780 consensus_queue.cc:1059] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:58:45.090785  5661 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:45.129851  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:45.140491  1716 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:45.133968  1639 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
W20260709 12:58:45.146123  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.150353  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.090657  5692 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:58:45.088577  5827 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.140959  5780 consensus_queue.cc:1243] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer c05ea12435084ad9b281ed3a0a2ecebe log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:58:45.156947  1717 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:45.157692  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:45.092051  5522 consensus_queue.cc:1059] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:58:45.201691  1721 raft_consensus.cc:3055] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:45.202071  1721 raft_consensus.cc:740] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:45.202821  1721 consensus_queue.cc:260] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:45.169955  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.182881  5673 consensus_queue.cc:1048] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:58:45.205041  5814 raft_consensus.cc:993] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:58:45.205587  5814 raft_consensus.cc:1081] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:58:45.206111  5621 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.206583  5621 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.208447  5621 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:45.209946  5674 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:45.192514  5620 consensus_meta.cc:287] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.803s	user 0.007s	sys 0.003s
I20260709 12:58:45.211316  5330 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:45.211961  1566 raft_consensus.cc:2410] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:45.213901  5811 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:45.214654  5811 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:45.219111  1645 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:58:45.220010  5835 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:58:45.222311  5787 raft_consensus.cc:3055] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:45.222791  5787 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:45.223701  5787 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.225039  5819 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:45.226969  1686 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.557s (SENT) [suppressed 40 similar messages]
W20260709 12:58:45.183475  5831 log.cc:927] Time spent T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:58:45.183372  5807 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:45.184398  5830 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:58:45.184995  1720 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:58:45.187059  5829 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:58:45.192857  5799 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:45.194506  5833 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:58:45.231819  2314 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:45.159657  5810 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:45.253396  1719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:58:45.234151  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:45.263235  1717 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
W20260709 12:58:45.263549  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 206978us
I20260709 12:58:45.266126  1719 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:45.266701  1719 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:45.252259  5330 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.270900  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 244122us
I20260709 12:58:45.266817  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:45.262573  5805 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:45.265492  5821 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:45.251312  5807 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:45.265941  5515 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:45.286158  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:45.271391  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 203148us
W20260709 12:58:45.287040  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 232976us
I20260709 12:58:45.293721  1567 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:58:45.294269  1567 pending_rounds.cc:85] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 6
I20260709 12:58:45.294554  1567 pending_rounds.cc:107] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:58:45.294833  1567 raft_consensus.cc:2889] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:45.306803  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.282145  5330 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.283962  5434 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:58:45.453510  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.509341   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:45.372138  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 77507.1us
I20260709 12:58:45.291497  5807 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:45.363992  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44130.6us
W20260709 12:58:45.517725  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 231605us
I20260709 12:58:45.530498  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:45.329002  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:45.557133  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.609804  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:45.307174  5657 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:45.610520  1645 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:45.521193  5434 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:45.607295  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 57425.9us
I20260709 12:58:45.610208  1684 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:45.309046  5818 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:45.357856  5439 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:45.306866  5515 raft_consensus.cc:697] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:58:45.618247  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 69296.5us
W20260709 12:58:45.646564  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.647025  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.509553  5795 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.542675  5832 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:58:45.606891  5667 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.621745  5837 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 12:58:45.621922  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 91548us
I20260709 12:58:45.622397  5330 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:45.622543  5784 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:45.623561  5820 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:58:45.625595  5834 log.cc:927] Time spent T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
W20260709 12:58:45.641825  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.473623  5620 consensus_queue.cc:1059] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 12:58:45.632555  5434 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:45.737284  5846 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:58:45.657339  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:45.644078  5822 consensus_meta.cc:287] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 12:58:45.659209  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:45.648977  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:45.333039  5814 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.307s
W20260709 12:58:45.684314  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.707793  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.646219  5827 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:45.720296  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:45.721385  5823 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.726608  5515 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:45.654031  5617 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:58:45.653682  5621 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:45.661605  5667 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:45.738754  1645 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:45.738607  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.741080  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 92329.2us
I20260709 12:58:45.661084  5795 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:45.750344  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 541) took 1145 ms. Trace:
I20260709 12:58:45.667387  5839 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:58:45.673905  5820 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:45.746837  1719 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:45.759261  1713 rpcz_store.cc:276] 0709 12:58:44.605492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.815869 (+210377us) service_pool.cc:224] Handling call
0709 12:58:44.816245 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:44.882280 (+ 66035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.882310 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:44.882812 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:58:45.118655 (+235843us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:45.118709 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.118787 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:45.750112 (+631325us) raft_consensus.cc:1685] finished
0709 12:58:45.750134 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.750275 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55060,"raft.queue_time_us":67144,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4787,"thread_start_us":235420,"threads_started":1,"wal-append.queue_time_us":421770}
W20260709 12:58:45.771759  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 112642us
W20260709 12:58:45.773509  1612 connection.cc:256] RPC call timeout handler was delayed by -2.6973322250000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 12:58:45.748785  5821 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:45.782097  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.775542  1612 connection.cc:256] RPC call timeout handler was delayed by -2.2433836969999561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.271s for a response
I20260709 12:58:45.783540  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 2248) took 1185 ms. Trace:
I20260709 12:58:45.746932  5849 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:45.796011  1612 connection.cc:256] RPC call timeout handler was delayed by -1.5956303680000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 12:58:45.797371  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3526303680000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 12:58:45.798249  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3355303679999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 12:58:45.798691  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2923303679999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:58:45.799088  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2923303679999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:58:45.799517  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2680303679999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 12:58:45.799945  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1969303679999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 12:58:45.800348  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1474303679999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 12:58:45.800793  1612 connection.cc:256] RPC call timeout handler was delayed by -1.144730367999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 12:58:45.801175  1612 connection.cc:256] RPC call timeout handler was delayed by -1.107830368000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
I20260709 12:58:45.784176  1712 rpcz_store.cc:276] 0709 12:58:44.597815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.597994 (+   179us) service_pool.cc:224] Handling call
0709 12:58:44.606241 (+  8247us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:45.029607 (+423366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.783197 (+753590us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400301454. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:45.783459 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758586112}
W20260709 12:58:45.807961  1686 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.010s	sys 0.026s
W20260709 12:58:45.808522  1686 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.010s	sys 0.026s
W20260709 12:58:45.808908  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 581931us
I20260709 12:58:45.744985  5822 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.813439  1686 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:45.771409  5621 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:45.781363  5821 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:45.808130  5809 consensus_meta.cc:287] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.006s
I20260709 12:58:45.822990  1719 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:45.821358  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:45.820443  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 611) took 1218 ms. Trace:
I20260709 12:58:45.775722  5818 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:58:45.811863  5657 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:45.803124  5811 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.840274  1572 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:45.840845  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:45.841097  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:45.775951  5439 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:58:45.840196  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:45.794751  5810 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:58:45.776192  5844 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:58:45.780814  5823 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.838233  5845 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:45.851979  5855 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:58:45.851873  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:45.845651  5657 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:45.825503  5821 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:45.854401  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 43633.4us
I20260709 12:58:45.855038  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:45.855047  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:45.857154  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 43778us
I20260709 12:58:45.858208  1564 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:45.850762  5689 consensus_meta.cc:287] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.002s
I20260709 12:58:45.844513  1568 rpcz_store.cc:276] 0709 12:58:44.601718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.601840 (+   122us) service_pool.cc:224] Handling call
0709 12:58:44.613637 (+ 11797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:44.629999 (+ 16362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.630025 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:44.645001 (+ 14976us) log.cc:844] Serialized 26 byte log entry
0709 12:58:44.818891 (+173890us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b18002df580. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1 00007f6a426efa0f
0709 12:58:45.128445 (+309554us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:45.128518 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.128614 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:45.812999 (+684385us) raft_consensus.cc:1685] finished
0709 12:58:45.813018 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.820353 (+  7335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44052,"raft.queue_time_us":20093,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":7978,"spinlock_wait_cycles":21165824,"thread_start_us":309313,"threads_started":1,"wal-append.queue_time_us":626776}
I20260709 12:58:45.881162  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:45.881405  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:45.883414  1567 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:45.886085  1566 raft_consensus.cc:2410] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:58:45.847270  5809 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.889534  5847 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:45.888929  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:45.890563  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:45.891688  1564 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:58:45.916541  1564 pending_rounds.cc:85] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 5
I20260709 12:58:45.917405  1564 pending_rounds.cc:107] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:58:45.917725  1564 raft_consensus.cc:2889] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:45.860669  5657 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:45.860486  5849 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:45.921871  1567 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:45.856980  5811 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.920784  5689 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:45.920253  5799 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:45.931595  5799 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:45.934170  5799 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:45.934653  5621 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.937364  5434 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:45.940910  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:45.941601  1565 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:45.888871  5776 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:45.891861  5822 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:45.946147  1570 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:45.946588  1567 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:45.947737  1645 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:45.846367  5820 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.952031  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:45.920658  5847 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:45.948851  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 58366us
I20260709 12:58:45.956117  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:45.957489  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:45.958072  1639 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:45.958892  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:45.959376  1639 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:45.920691  5617 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:58:45.956240  5868 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:45.961983  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:45.969054  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 88775us
I20260709 12:58:45.945235  5852 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:45.972285  1568 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:45.944290  5784 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.970717  1686 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:45.946012  5689 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.982846  1565 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:45.983843  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:45.984768  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:45.924188  5839 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:58:45.960212  5657 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:45.962797  5847 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:45.993327  1639 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:45.923969  5859 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:58:45.995787  1686 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:45.998049  2345 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:45.999995  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.000746  2345 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:46.001111  2346 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:58:46.002596  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:46.006412  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44523.9us
I20260709 12:58:46.007472  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:46.010157  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.012676  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:46.013244  5799 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:46.013345  5849 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:46.015203  5849 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:46.016017  1612 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:46.017102  5849 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:46.018352  5823 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.022058  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.016489  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:46.023897  1644 raft_consensus.cc:2410] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:58:46.024042  1569 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:46.023630  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:45.970805  5439 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:58:45.993477  5844 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:46.040274  1639 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:46.041787  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.044967  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:46.046126  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:46.048098  1535 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:46.050380  1535 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:46.021858  5787 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:46.039543  5848 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:58:46.053399  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.059067  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:46.060949  1565 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 13: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:45.992894  5689 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.064253  5799 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:46.072865  5795 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.072950  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.073879  1565 raft_consensus.cc:2410] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:46.074977  1565 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [7.4-10.5]
I20260709 12:58:46.076189  1565 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:58:46.079370  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1911) took 1567 ms. Trace:
I20260709 12:58:46.079741  1641 rpcz_store.cc:276] 0709 12:58:44.511877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.515095 (+  3218us) service_pool.cc:224] Handling call
0709 12:58:46.079142 (+1564047us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540028ffd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:46.079272 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269020928}
I20260709 12:58:45.989960  5784 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.082616  5784 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.084393  1721 raft_consensus.cc:3060] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.088490  5610 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:46.084393  1565 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.090381  5658 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.093220  5460 raft_consensus.cc:3055] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:46.093622  5460 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:46.093706  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:46.094439  5460 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.095535  5460 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:46.096881  2343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 537) took 1808 ms (client timeout 1707 ms). Trace:
W20260709 12:58:46.097281  2343 rpcz_store.cc:269] 0709 12:58:44.288713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.288855 (+   142us) service_pool.cc:224] Handling call
0709 12:58:46.096696 (+1807841us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54004763d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:46.096794 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318349696}
I20260709 12:58:46.100471  5786 raft_consensus.cc:3055] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:46.100936  5786 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:46.102043  2343 raft_consensus.cc:1240] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:46.101915  5786 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.103482  5825 raft_consensus.cc:3055] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:46.103639  5852 consensus_queue.cc:1059] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:46.104467  5852 consensus_queue.cc:1243] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer c05ea12435084ad9b281ed3a0a2ecebe log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:58:46.103930  5825 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:46.105700  5825 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.106666  5825 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.107232  5657 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.047139  5849 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:46.112040  5667 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.113615  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 543) took 1226 ms. Trace:
I20260709 12:58:46.119962  1718 rpcz_store.cc:276] 0709 12:58:44.887123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.030015 (+142892us) service_pool.cc:224] Handling call
0709 12:58:45.030416 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:45.051839 (+ 21423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:45.051967 (+   128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:45.071159 (+ 19192us) log.cc:844] Serialized 26 byte log entry
0709 12:58:45.287637 (+216478us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:45.287674 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.287737 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.113408 (+825671us) raft_consensus.cc:1685] finished
0709 12:58:46.113430 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.113556 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20501,"raft.queue_time_us":20393,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5763,"thread_start_us":195098,"threads_started":1,"wal-append.queue_time_us":672873}
I20260709 12:58:46.051050  5823 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:45.975373  5868 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.114542  1568 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:46.112119  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:46.125833  1645 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:46.105722  1721 raft_consensus.cc:1275] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:58:46.115934  5661 raft_consensus.cc:3055] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:46.127799  5661 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:46.128041  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.128734  1567 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:46.128789  5661 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.129951  5661 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.130182  1567 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:46.131538  1567 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [7.4-10.5]
W20260709 12:58:46.134249  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.052841  5809 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.117785  1565 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:58:46.118542  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 1908) took 1622 ms (client timeout 1707 ms). Trace:
I20260709 12:58:46.119092  1646 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:46.047546  5867 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:46.052764  5822 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:46.059075  5850 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:46.126690  1721 pending_rounds.cc:85] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 8
W20260709 12:58:46.138995  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 94105.3us
I20260709 12:58:46.117103  5689 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:46.100164  5821 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:46.063514  5805 consensus_meta.cc:287] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.774s	user 0.002s	sys 0.011s
I20260709 12:58:46.152227  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:46.140676  1647 rpcz_store.cc:269] 0709 12:58:44.495917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.501539 (+  5622us) service_pool.cc:224] Handling call
0709 12:58:46.118347 (+1616808us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54001b4ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:46.118482 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625237760}
I20260709 12:58:46.061615  5651 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:46.155758  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:46.156497  5868 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.157053  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:46.157634  1647 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:46.141637  5867 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.160941  5867 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:46.143937  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.145525  1721 pending_rounds.cc:107] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:58:46.145942  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:46.160899  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:46.163622  1721 raft_consensus.cc:2889] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:46.142231  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 146560us
I20260709 12:58:46.166246  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:46.168171  1647 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:46.169668  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:46.174142  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:46.175550  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:46.176842  5651 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:46.177577  5651 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:46.178216  5651 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:58:46.182193  5807 consensus_meta.cc:287] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.001s
I20260709 12:58:46.182606  5807 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.183604  2346 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:58:46.194674  5762 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:58:46.194610  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 533) took 2866 ms. Trace:
I20260709 12:58:46.197690  1721 rpcz_store.cc:276] 0709 12:58:43.327902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.328156 (+   254us) service_pool.cc:224] Handling call
0709 12:58:43.342444 (+ 14288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:45.201598 (+1859154us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540017ee20. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426abdc0 00007f6a427361c0 00007f6a42737231 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c
0709 12:58:46.084179 (+882581us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b58003b09d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426900aa 00007f6a42712447 00007f6a4272afe7 00007f6a4272c7de 00007f6a42736b49 00007f6a42737416 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4
0709 12:58:46.194338 (+110159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.194523 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326412928}
I20260709 12:58:46.235389  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:46.156528  5821 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:46.202859  5558 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:46.460829  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1912) took 1225 ms. Trace:
I20260709 12:58:46.461756  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:46.462196  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:46.472404  2343 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:46.449568  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:46.473371  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.269204  5762 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:46.456323  5515 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:46.474167  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 307983us
I20260709 12:58:46.462617  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:46.399899  5840 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:58:46.268307  5854 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.420s	user 0.001s	sys 0.001s
I20260709 12:58:46.475014  2346 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:46.252403  5850 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:46.448216  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 254391us
I20260709 12:58:46.473174  2343 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:46.476527  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1911) took 1590 ms. Trace:
I20260709 12:58:46.446781  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 613) took 1843 ms. Trace:
I20260709 12:58:46.472033  5558 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.485419  1714 rpcz_store.cc:276] 0709 12:58:44.885768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.029761 (+143993us) service_pool.cc:224] Handling call
0709 12:58:45.053190 (+ 23429us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:58:45.259199 (+206009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:45.259228 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:58:45.264623 (+  5395us) log.cc:844] Serialized 78 byte log entry
0709 12:58:45.647891 (+383268us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:45.648128 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.267648 (+619520us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:46.285864 (+ 18216us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54001752d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:46.285936 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.476273 (+190337us) raft_consensus.cc:1685] finished
0709 12:58:46.476291 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.476456 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":993,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7476,"spinlock_wait_cycles":474070272,"thread_start_us":361196,"threads_started":1,"wal-append.queue_time_us":502092}
I20260709 12:58:46.475085  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:46.300568  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.486471  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.403471  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2013) took 1595 ms. Trace:
I20260709 12:58:46.489806  1568 raft_consensus.cc:2410] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:58:46.489621  1643 rpcz_store.cc:276] 0709 12:58:44.807745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.831803 (+ 24058us) service_pool.cc:224] Handling call
0709 12:58:44.832231 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:45.026343 (+194112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:45.026381 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:45.026428 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:45.048032 (+ 21604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.403176 (+1355144us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002a76d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:46.403235 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.403397 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309670784}
I20260709 12:58:46.487840  1563 rpcz_store.cc:276] 0709 12:58:44.603306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.603433 (+   127us) service_pool.cc:224] Handling call
0709 12:58:44.610112 (+  6679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:44.616407 (+  6295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.616433 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:44.625090 (+  8657us) log.cc:844] Serialized 26 byte log entry
0709 12:58:44.748428 (+123338us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:44.748466 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.748538 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:45.309011 (+560473us) raft_consensus.cc:1685] finished
0709 12:58:45.309031 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.446506 (+1137475us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b54003124d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:46.446718 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5954,"raft.queue_time_us":14507,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":18810,"spinlock_wait_cycles":14544256,"thread_start_us":67355,"threads_started":1,"wal-append.queue_time_us":385082,"wal-append.run_cpu_time_us":3014,"wal-append.run_wall_time_us":1294366}
I20260709 12:58:46.241427  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:46.492601  2346 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:58:46.288347  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 593) took 1729 ms. Trace:
I20260709 12:58:46.499130  1646 rpcz_store.cc:276] 0709 12:58:44.558933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.656058 (+ 97125us) service_pool.cc:224] Handling call
0709 12:58:46.118905 (+1462847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.140852 (+ 21947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.288151 (+147299us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54001b4ed0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:46.288283 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328774400}
W20260709 12:58:46.346271  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.376868  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 259436us
I20260709 12:58:46.333396  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 602) took 1438 ms. Trace:
I20260709 12:58:46.501530  1638 rpcz_store.cc:276] 0709 12:58:44.895389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.091815 (+196426us) service_pool.cc:224] Handling call
0709 12:58:45.108021 (+ 16206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:45.149479 (+ 41458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:45.149521 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:45.149578 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:45.149624 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.333066 (+1183442us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b54000f8cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:46.333136 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.333317 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94752128}
I20260709 12:58:46.287345  1684 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:46.475318  1720 rpcz_store.cc:276] 0709 12:58:45.235811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.257324 (+ 21513us) service_pool.cc:224] Handling call
0709 12:58:46.459971 (+1202647us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800150f98. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a4770dfc0 00007f6a476f8929 00007f6a476f83d2 00007f6a40c6fbd4
0709 12:58:46.460211 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.460430 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.460466 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:46.460518 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:46.460570 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.460637 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.460777 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2434432}
I20260709 12:58:46.511965  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:46.513450  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:46.512574  1640 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.443277  5434 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.516390  1686 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:46.516413  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:46.522344  1535 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:46.517117  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 229861us
I20260709 12:58:46.530393  1535 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:46.530342  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:46.285424  5856 log.cc:927] Time spent T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.437s	user 0.002s	sys 0.000s
I20260709 12:58:46.441372  5776 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:46.445796  5818 raft_consensus.cc:3055] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:46.523669  1684 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:46.265754  5522 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.615828  5522 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.476076  5850 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.619402  5850 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:46.619557  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:46.540591  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.624234  1572 raft_consensus.cc:2410] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:58:46.631116  1563 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:58:46.534279  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:46.475112  5840 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:46.521318  2343 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.633186  2343 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:46.402882  5811 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:46.642020  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 107857us
I20260709 12:58:46.399855  5807 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:46.474442  5762 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:46.533140  5825 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:58:46.541280  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.604809  5460 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:46.605556  5839 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.606375  5657 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.606835  5558 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:46.515455  5671 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.528316  5330 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:46.532586  5661 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:58:46.608155  5776 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.521538  5820 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.253324  5847 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.608922  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:46.610107  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2024) took 1316 ms. Trace:
I20260709 12:58:46.542708  5823 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:46.613914  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 599) took 1768 ms. Trace:
I20260709 12:58:46.806810  1643 rpcz_store.cc:276] 0709 12:58:45.294041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.532972 (+1238931us) service_pool.cc:224] Handling call
0709 12:58:46.609583 (+ 76611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.609766 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.609791 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:46.609825 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:46.609850 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.609898 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.610054 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:46.635780  1640 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:46.514950  5822 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.644774  1645 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:58:46.813318  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2023) took 1519 ms. Trace:
I20260709 12:58:46.515208  5805 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:46.528620  5674 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.644147  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:46.520795  5550 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:46.618356  5522 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:46.819928  5876 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:58:46.653312  2343 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:46.252347  5780 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.821449  2342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 679) took 1515 ms. Trace:
I20260709 12:58:46.821530  5780 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.821826  2342 rpcz_store.cc:276] 0709 12:58:45.305585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.325554 (+ 19969us) service_pool.cc:224] Handling call
0709 12:58:45.325909 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:45.329458 (+  3549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:45.329499 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:45.374068 (+ 44569us) log.cc:844] Serialized 26 byte log entry
0709 12:58:46.202530 (+828462us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b1800385900. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1 00007f6a426efa0f
0709 12:58:46.528658 (+326128us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:46.528715 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.528783 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.821145 (+292362us) raft_consensus.cc:1685] finished
0709 12:58:46.821175 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.821377 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6511,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":13960,"spinlock_wait_cycles":51920256,"thread_start_us":325486,"threads_started":1,"wal-append.queue_time_us":1266902}
I20260709 12:58:46.823743  5780 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:46.539849  5774 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:46.824579  5877 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:58:46.825930  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 604) took 1619 ms. Trace:
W20260709 12:58:46.826218  5880 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:58:46.826275  1644 rpcz_store.cc:276] 0709 12:58:45.206437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.024479 (+818042us) service_pool.cc:224] Handling call
0709 12:58:46.042062 (+ 17583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.149267 (+107205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.149302 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:46.202941 (+ 53639us) log.cc:844] Serialized 26 byte log entry
0709 12:58:46.307517 (+104576us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:46.307583 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.307678 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.825676 (+517998us) raft_consensus.cc:1685] finished
0709 12:58:46.825701 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.825853 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18480,"raft.queue_time_us":26781,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":149195,"threads_started":2,"wal-append.queue_time_us":395577}
I20260709 12:58:46.533318  5809 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:46.474411  5515 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.540125  5863 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.515425  5852 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 12:58:46.541738  5873 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:58:46.662252  1639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.028s	sys 0.046s
I20260709 12:58:46.721730  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:46.830816  1639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.028s	sys 0.047s
I20260709 12:58:46.831046  1638 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.725426  5839 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.834381  5839 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.724599  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:46.835215  1641 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:46.723794  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:46.837136  5674 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.839201  5674 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.721307  5460 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:46.656728  5845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.012s	sys 0.039s
I20260709 12:58:46.751873  5827 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:58:46.839839  5845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.016s	sys 0.047s
I20260709 12:58:46.839975  5827 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.840173  5845 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:46.528497  5689 consensus_queue.cc:1059] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 12:58:46.841084  5689 raft_consensus.cc:3055] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:46.841591  5689 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:46.842437  5776 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:46.842357  5689 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.811035  5330 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:46.843531  5689 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:46.745217  5881 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:46.647272  5871 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.844616  5515 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:46.641204  5792 consensus_queue.cc:1175] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" responder_term: 9 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:46.803421  5671 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.510650  5867 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.641074  5850 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.849534  5847 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:46.849705  5671 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.818599  5823 raft_consensus.cc:697] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:46.851145  5823 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.846899  5805 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.853725  5805 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.795913  5762 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.866132  1641 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:46.870476  5661 raft_consensus.cc:1064] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
W20260709 12:58:46.870996  5661 raft_consensus.cc:1068] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Unable to promote non-voter c05ea12435084ad9b281ed3a0a2ecebe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:58:46.652386  5821 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:46.762029  5787 consensus_meta.cc:287] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 12:58:46.539942  5667 consensus_queue.cc:1048] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 12:58:46.786463  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:46.890439  1714 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:46.787524  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:46.841193  5460 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:46.891855  1721 raft_consensus.cc:2410] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:58:46.788492  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:46.756498  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 109494us
I20260709 12:58:46.895222  2312 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:46.603612  5818 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:46.789958  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 264661us
I20260709 12:58:46.793042  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:46.793193  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:46.796042  1720 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:46.797489  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.804395  1713 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:46.809041  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:46.898320  1640 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.898873  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:46.813659  1645 rpcz_store.cc:276] 0709 12:58:45.293754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.530652 (+1236898us) service_pool.cc:224] Handling call
0709 12:58:46.554328 (+ 23676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.813079 (+258751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.813264 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:46.854979  5852 raft_consensus.cc:3055] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:46.529153  5788 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:46.837494  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2031) took 1117 ms. Trace:
I20260709 12:58:46.910585  1646 rpcz_store.cc:276] 0709 12:58:45.720171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.836685 (+1116514us) service_pool.cc:224] Handling call
0709 12:58:46.836999 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.837183 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.837212 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:46.837256 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:46.837291 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.837344 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.837440 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:46.910071  5811 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:58:46.849705  5867 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:46.912678  1646 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:46.755787  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 132240us
I20260709 12:58:46.844010  5330 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.845291  2345 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:46.845933  1564 raft_consensus.cc:2368] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15.
W20260709 12:58:46.846496  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 202439us
I20260709 12:58:46.844977  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:46.913950  1719 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:46.849957  5850 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.661971  5617 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:58:46.855916  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2028) took 1303 ms. Trace:
I20260709 12:58:46.931936  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:46.932055  1647 rpcz_store.cc:276] 0709 12:58:45.552661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.541455 (+988794us) service_pool.cc:224] Handling call
0709 12:58:46.604609 (+ 63154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.607012 (+  2403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.607051 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:46.607526 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:58:46.785421 (+177895us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:46.785468 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.785538 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.855724 (+ 70186us) raft_consensus.cc:1685] finished
0709 12:58:46.855743 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.855859 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1107,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":177524,"threads_started":1,"wal-append.queue_time_us":188000}
I20260709 12:58:46.818436  5822 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.814455  5810 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:46.857124  1638 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 7.
I20260709 12:58:46.816063  5874 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:46.661892  5825 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.805959  5885 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:46.885731  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.886165  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 362550us
I20260709 12:58:46.816510  5558 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.897444  1712 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:46.802084  5657 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.901410  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:46.964630  1647 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:46.910450  5805 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:46.905701  5852 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:46.905865  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:46.907475  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:46.908630  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:46.840451  5827 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.914080  1686 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:46.925979  1571 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:46.930442  1640 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:46.979961  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2034) took 1094 ms. Trace:
I20260709 12:58:46.892306  5776 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:46.937212  5788 raft_consensus.cc:697] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:46.951823  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.956696  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.960536  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:46.960590  1644 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:58:46.963631  5899 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:46.965221  1645 raft_consensus.cc:2410] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:58:46.807691  1642 rpcz_store.cc:276] 0709 12:58:44.845061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.065054 (+219993us) service_pool.cc:224] Handling call
0709 12:58:45.071887 (+  6833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:45.283769 (+211882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:45.283806 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:45.305049 (+ 21243us) log.cc:844] Serialized 26 byte log entry
0709 12:58:45.663472 (+358423us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:45.663510 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.663580 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.284638 (+621058us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:46.613625 (+328987us) raft_consensus.cc:1685] finished
0709 12:58:46.613646 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.613853 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138562,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":16169728,"thread_start_us":492456,"threads_started":2,"wal-append.queue_time_us":448839}
I20260709 12:58:46.965821  1638 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:46.959889  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:46.913537  5786 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:46.902200  1718 raft_consensus.cc:2410] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:58:47.005141  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.005615  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:46.967325  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:46.973398  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.007108  1572 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:46.975884  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:46.975904  1720 raft_consensus.cc:2410] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:58:46.980377  1640 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:47.008582  1646 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:46.975194  1716 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:46.941494  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.011129  1568 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
W20260709 12:58:46.981638  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 67633.1us
I20260709 12:58:46.966946  5805 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:46.982767  5811 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:46.983933  1719 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
W20260709 12:58:46.985656  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.910081  5661 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:58:46.965041  5825 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:46.959398  5807 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:58:46.958743  5874 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:47.003168  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:47.007177  1563 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:47.012529  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:46.980382  1643 rpcz_store.cc:276] 0709 12:58:45.885301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.845878 (+960577us) service_pool.cc:224] Handling call
0709 12:58:46.861575 (+ 15697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.862039 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.862078 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:46.862671 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:58:46.979646 (+116975us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:46.979682 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.979752 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:46.979793 (+    41us) raft_consensus.cc:1685] finished
0709 12:58:46.979805 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:46.979907 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1349,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":116579,"threads_started":1,"wal-append.queue_time_us":98743}
I20260709 12:58:46.951793  5617 consensus_queue.cc:1243] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 2af567a273d44ca89d2b3b0f7c815bd1 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:47.011250  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:47.006429  1718 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:47.018227  2343 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:47.020743  1567 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:47.030076  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:47.030823  1570 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:58:47.031275  1570 pending_rounds.cc:85] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 8
I20260709 12:58:47.021239  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:47.021528  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 61722.1us
I20260709 12:58:46.981344  5460 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.023547  1640 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:58:47.026762  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:46.966871  5810 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.991676  5873 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:47.042456  1721 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:47.043861  1638 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:47.044430  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:47.048468  1535 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:47.027590  1569 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:47.063510  1643 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:47.031529  1570 pending_rounds.cc:107] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.9
W20260709 12:58:47.056217  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.058462  1686 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:46.973953  5558 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.022217  5805 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:47.077157  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 1973) took 1236 ms. Trace:
I20260709 12:58:47.077355  1686 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.077539  1571 rpcz_store.cc:276] 0709 12:58:45.840432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.840573 (+   141us) service_pool.cc:224] Handling call
0709 12:58:47.077010 (+1236437us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400043654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:47.077101 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398046080}
I20260709 12:58:47.080446  1570 raft_consensus.cc:2917] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Aborting config change with OpId 9.9: Aborted: Op aborted by new leader
I20260709 12:58:47.081189  1570 raft_consensus.cc:2889] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:47.027405  5867 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:47.019505  5811 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:58:47.111765  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 47901.3us
I20260709 12:58:47.113639  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1919) took 1021 ms. Trace:
I20260709 12:58:47.114086  1641 rpcz_store.cc:276] 0709 12:58:46.092141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.866919 (+774778us) service_pool.cc:224] Handling call
0709 12:58:46.867171 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.867406 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:46.953264 (+ 85858us) log.cc:844] Serialized 14 byte log entry
0709 12:58:46.986900 (+ 33636us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.113295 (+126395us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:47.113354 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:47.113404 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.113471 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.113585 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86269,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":77,"spinlock_wait_cycles":1920,"thread_start_us":243557,"threads_started":3,"wal-append.queue_time_us":152176}
I20260709 12:58:47.060101  5667 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:47.120246  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.069836  5787 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:47.061444  5889 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:47.146513  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 240694us
I20260709 12:58:47.149174  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:47.063259  5780 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:58:47.166478  5780 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:47.167451  5780 consensus_queue.cc:1059] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:47.153991  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2103) took 1208 ms. Trace:
I20260709 12:58:47.168908  1564 rpcz_store.cc:276] 0709 12:58:45.947508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.970142 (+ 22634us) service_pool.cc:224] Handling call
0709 12:58:47.149825 (+1179683us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400113854. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:47.153915 (+  4090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980834048}
I20260709 12:58:47.064426  5550 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 12:58:47.170271  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 101205us
I20260709 12:58:47.062247  5460 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.177918  5558 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:47.122310  5620 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:47.117544  5873 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:47.190889  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.134907  5890 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.113538  5868 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:58:47.171712  5550 raft_consensus.cc:3055] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:58:47.199240  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 138729us
I20260709 12:58:47.124465  5689 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:58:47.207114  1640 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:47.155953  5787 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:47.209053  1537 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.208361  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:47.213181  1640 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:58:47.213758  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.215391  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.215975  1641 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:47.218703  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:47.218315  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.219513  1645 raft_consensus.cc:2393] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:47.219659  1638 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:47.217372  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.220376  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.220984  1647 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:47.221379  1537 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.189327  5903 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:47.223577  5878 log.cc:927] Time spent T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.458s	user 0.004s	sys 0.000s
W20260709 12:58:47.224303  5896 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:58:47.199208  5550 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:47.198817  5873 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:47.231370  1537 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:47.234615  1714 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:58:47.235318  1721 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:46.974047  5885 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.844973  5881 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:46.829299  5863 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.251525  5873 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.253399  5863 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:47.255007  2346 raft_consensus.cc:2376] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13. Re-sending same reply.
I20260709 12:58:46.845077  5871 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:46.880069  5840 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.257086  5871 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:47.258189  5900 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:58:47.258507  2340 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:46.841117  5845 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.117154  5852 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.119115  5874 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.015096  5899 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.215317  5558 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:47.251214  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 605) took 2044 ms. Trace:
I20260709 12:58:47.269552  1640 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:58:47.277278  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.227433  5841 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:47.279456  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.276399  1639 rpcz_store.cc:276] 0709 12:58:45.206708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.041436 (+834728us) service_pool.cc:224] Handling call
0709 12:58:46.056220 (+ 14784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.060872 (+  4652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.060915 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:46.121980 (+ 61065us) log.cc:844] Serialized 26 byte log entry
0709 12:58:46.831193 (+709213us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:46.831232 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:46.831294 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:47.155779 (+324485us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:47.250914 (+ 95135us) raft_consensus.cc:1685] finished
0709 12:58:47.250935 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.251158 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4127,"raft.queue_time_us":4222,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2871,"spinlock_wait_cycles":8048512,"thread_start_us":687032,"threads_started":1,"wal-append.queue_time_us":622770}
I20260709 12:58:47.238654  5657 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:47.214429  5820 consensus_queue.cc:1059] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:58:47.237282  5847 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:47.241470  5850 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:47.200235  5890 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:47.297539  5897 log.cc:927] Time spent T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:58:47.298372  5890 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.298604  5885 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.299278  5787 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.300510  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1922) took 1205 ms. Trace:
I20260709 12:58:47.251611  5550 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.300961  1644 rpcz_store.cc:276] 0709 12:58:46.095167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.868385 (+773218us) service_pool.cc:224] Handling call
0709 12:58:46.951794 (+ 83409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.997444 (+ 45650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.052219 (+ 54775us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b540040c4d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:47.300323 (+248104us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b540040c4d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:47.300453 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210826240}
I20260709 12:58:47.307726  5822 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.275632  5903 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:47.208112  5811 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.151084  5788 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.309445  5852 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.313606  5899 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.314296  5810 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:47.314680  5774 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:47.315336  5774 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.315783  5774 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.280000  5558 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.317037  5558 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:47.283602  5912 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:58:47.279291  5839 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:47.326206  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 55769.1us
W20260709 12:58:47.328433  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 202327us
I20260709 12:58:47.284801  5881 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:47.247468  5823 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:47.332309  5847 consensus_queue.cc:1059] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:47.332839  1715 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:47.334035  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.325562  5667 raft_consensus.cc:697] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:47.337308  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.337906  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.340955  1570 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:47.338182  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.327253  5839 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.326138  5867 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:47.345921  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:47.347139  1564 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.347414  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.348129  1563 raft_consensus.cc:2393] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:47.349277  1567 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:58:47.352520  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.352957  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:47.353808  1572 raft_consensus.cc:2410] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:58:47.358482  5550 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.359567  5811 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:47.360286  5776 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:47.361641  5774 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:47.366287  5825 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.367173  5905 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.385372  5905 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.386482  5825 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.387425  5905 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:47.368587  5914 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:58:47.399262  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.399468  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:47.400704  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.403297  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.403471  5827 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.403921  1638 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:58:47.404991  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.405696  1647 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 15: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:47.335729  5809 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.406394  1564 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:58:47.406605  5809 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.407519  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.375751  5821 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:47.346231  5839 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:47.380596  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.409945  2340 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
W20260709 12:58:47.410601  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.414032  1713 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:47.453363  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:47.456614  1717 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:47.409089  5460 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.461310  5899 raft_consensus.cc:1064] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
W20260709 12:58:47.461723  5899 raft_consensus.cc:1068] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Unable to promote non-voter c05ea12435084ad9b281ed3a0a2ecebe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:58:47.462291  5805 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.464843  5919 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.465343  5919 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.467344  5919 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:47.471956  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.472571  5776 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.473129  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.473587  5922 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.474107  5922 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.474391  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.475220  1716 raft_consensus.cc:2410] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:58:47.476173  5922 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:47.473145  5776 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.477365  1721 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:47.478372  5776 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:47.478732  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.478379  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:47.490240  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.489984  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 128763us
I20260709 12:58:47.491521  5825 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.491694  5867 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.492057  5825 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.432142  5823 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:47.491736  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:47.493458  5823 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.494036  5809 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.352030  5558 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.604295  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:47.496407  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.614504  1714 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
W20260709 12:58:47.606014  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 111923us
I20260709 12:58:47.450518  5850 raft_consensus.cc:3055] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:47.614187  1719 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:47.619545  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:47.626806  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:47.627924  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:47.632797  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.633989  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.634377  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.464502  5805 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:47.638017  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.527138  5920 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:58:47.640168  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.490528  5792 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:47.473263  5774 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:47.666932  5792 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.667366  5792 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.667140  5774 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.642416  1571 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 15: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:47.668855  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.669450  1563 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:47.669528  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.644285  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.670797  1717 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
W20260709 12:58:47.644824  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 442404us
I20260709 12:58:47.642983  1719 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:47.645226  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:47.645918  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 495481us
I20260709 12:58:47.674592  1646 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:47.675113  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:47.679056  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1933) took 1533 ms. Trace:
I20260709 12:58:47.679591  1642 rpcz_store.cc:276] 0709 12:58:46.145227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.001360 (+856133us) service_pool.cc:224] Handling call
0709 12:58:47.025445 (+ 24085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.217067 (+191622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.217098 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.225542 (+  8444us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.327256 (+101714us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:47.327300 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.327375 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:47.678832 (+351457us) raft_consensus.cc:1685] finished
0709 12:58:47.678854 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.678992 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":197248,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":262526,"threads_started":2,"wal-append.queue_time_us":161701}
I20260709 12:58:47.667171  5847 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:47.695487  5847 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.697365  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:47.697947  1563 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:47.698112  1570 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:47.699705  1570 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:47.706532  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.707890  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.708467  1717 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:47.709508  1563 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:47.709656  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.647025  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:47.648168  1569 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:47.494164  5825 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.648394  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.494356  5786 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:47.650278  1714 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:58:47.651953  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.494570  5689 consensus_queue.cc:1059] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.158s
I20260709 12:58:47.652801  5558 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.528349  5818 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.634215  5776 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:47.494485  5522 consensus_queue.cc:1059] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 12:58:47.641664  5886 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:47.653380  5839 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.521960  5780 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:47.522199  5841 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 12:58:47.654834  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:47.483769  5807 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.164s
I20260709 12:58:47.597575  5667 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.658033  5923 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.649737  5515 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:47.626005  5850 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:47.495285  5827 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:47.656512  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:47.664572  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.717108  1715 raft_consensus.cc:2410] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:58:47.718994  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:47.742635  1646 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:47.726183  5786 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:47.743302  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:47.735127  5932 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:58:47.744977  1571 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:47.745127  5931 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:47.745864  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:47.746290  5841 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:47.746450  1565 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.746747  5841 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:47.747644  5841 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:47.719942  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 73032.2us
I20260709 12:58:47.721256  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.749572  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.750149  5841 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.749554  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:47.751612  5689 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:47.752005  5689 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:47.752333  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:47.721984  1563 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:58:47.752954  5674 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:47.753309  5809 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:47.726881  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.753656  5674 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:47.753813  5809 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:47.754462  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.754773  5809 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.755537  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.647951  5434 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:47.756824  5434 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.757195  5434 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.757252  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.758589  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.759562  5868 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:47.753654  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.734387  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.759059  1535 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.761873  1719 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:47.762169  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:47.737038  1686 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.721238  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.673839  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:47.719516  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 44461.3us
I20260709 12:58:47.752398  5689 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:47.763523  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:47.767616  1565 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:47.730345  5886 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:47.786135  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.773195  2346 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:47.750530  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:47.737857  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.763981  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:47.787647  1568 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:47.735658  5822 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:47.772583  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 98819.4us
I20260709 12:58:47.788264  5822 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.772600  1717 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:47.789791  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:47.790277  5822 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.779246  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.790782  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.791031  1713 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:47.763226  1719 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:47.785374  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:47.792092  1713 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:58:47.792387  5811 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:47.792912  5811 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:47.793296  5811 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.793452  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:47.794291  5899 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:47.795006  5906 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:47.795457  5906 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:47.793500  5661 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:58:47.795651  5899 consensus_queue.cc:1059] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:47.787712  2345 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:47.796526  5905 raft_consensus.cc:3055] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:47.796957  5905 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:47.783648  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:47.797955  1715 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:47.797822  5905 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.798588  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:47.799249  2343 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:47.798705  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:47.795977  5906 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:47.800158  2341 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:58:47.802276  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:47.805878  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.806516  1612 leader_election.cc:400] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15.
I20260709 12:58:47.806273  5661 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:47.806834  1612 leader_election.cc:403] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:58:47.782063  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 54478.2us
I20260709 12:58:47.807368  5910 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:47.738164  5818 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:47.815227  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.739281  5515 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.810891  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:47.818688  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:47.744984  5895 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:47.754491  5840 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:47.731105  5776 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:47.838693  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 63401.1us
I20260709 12:58:47.828306  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:47.849278  1565 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:47.849479  1563 pending_rounds.cc:85] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 4
I20260709 12:58:47.849784  1563 pending_rounds.cc:107] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:58:47.850008  1563 raft_consensus.cc:2889] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:47.850373  1537 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:47.872359  1537 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:47.776919  5460 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:47.851027  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:47.784209  5446 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:47.737665  5780 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.810611  5886 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.784222  5617 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:47.885803  2312 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:47.811442  5922 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:47.810797  5825 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:47.857851  5792 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.858366  5921 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
W20260709 12:58:47.859799  5924 log.cc:927] Time spent T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:58:47.867324  5899 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.817131  5931 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:58:47.868213  5850 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.827057  5811 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.828620  5515 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:47.816579  5911 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15.
I20260709 12:58:47.880884  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.934655  1646 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:47.883277  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:47.740967  5923 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.877208  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:47.851742  5895 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:47.943813  5792 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:47.944195  5895 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.945528  5780 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:47.948287  5774 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:47.872400  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.948967  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.816956  5852 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:58:47.854897  5919 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:47.953657  5919 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:47.909837  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.915582  5330 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.910115  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.854708  5839 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.855144  5661 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.913661  1639 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:58:47.886096  5820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.014s	sys 0.009s
I20260709 12:58:47.916182  1684 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:47.916285  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.919659  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.921530  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:47.922639  1712 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:58:47.967327  1647 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:47.868954  5786 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:47.910631  5460 consensus_queue.cc:1059] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:58:47.927838  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.974589  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.925364  5922 raft_consensus.cc:697] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:47.916713  5932 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.937673  5946 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:47.941572  5776 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:47.912320  5847 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:47.975617  5820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.014s	sys 0.010s
I20260709 12:58:47.918957  5805 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:58:47.961738  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 88299.2us
I20260709 12:58:47.967252  5774 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:47.974797  1645 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:47.907553  5446 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:47.975235  1646 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:47.989612  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:47.990109  1646 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:47.975721  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 59604.5us
I20260709 12:58:47.943712  5923 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:47.978789  5887 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:47.955513  1644 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:47.979586  5931 raft_consensus.cc:3055] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:47.928755  5899 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.982450  5946 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:47.963349  5852 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:47.992147  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:48.038689  1646 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:47.986160  5460 consensus_queue.cc:1243] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:47.987984  1686 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:48.061481  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:47.981185  5943 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:47.963486  5330 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.976207  5661 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.085029  1644 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:48.081225  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:48.081175  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 89103.5us
W20260709 12:58:48.043568  5929 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:58:48.032099  5931 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:47.981257  5906 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:47.996263  5887 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:47.954752  5919 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:48.062271  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 183708us
W20260709 12:58:48.086483  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 98578.4us
I20260709 12:58:47.983182  5932 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.093397  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:48.090323  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:47.995735  5776 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:58:48.081449  5898 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.102291  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:47.994292  5774 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:48.103036  1646 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:48.092881  5945 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.281s	user 0.003s	sys 0.000s
I20260709 12:58:48.104328  1642 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:48.086205  5827 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:48.031463  5550 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:58:48.108887  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:48.090925  5780 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:48.062093  5657 consensus_queue.cc:1059] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:58:48.113016  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:48.114845  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:48.114975  1645 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:48.117009  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:48.117089  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:48.107573  1684 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:48.095032  5943 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.114827  5774 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:48.097627  5887 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:48.121507  1535 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:48.032191  5805 raft_consensus.cc:697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:48.132156  1535 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:48.125931  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 2119) took 1130 ms. Trace:
I20260709 12:58:48.129344  1646 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:48.130347  1644 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
W20260709 12:58:48.123591  5936 log.cc:927] Time spent T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:58:48.117799  5827 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.094492  5852 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.144255  1569 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:58:48.144604  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:48.194968  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:48.196350  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:48.197047  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 324727us
W20260709 12:58:48.124434  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 213088us
W20260709 12:58:48.202183  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.207526  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.132863  1566 rpcz_store.cc:276] 0709 12:58:46.995105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.997182 (+  2077us) service_pool.cc:224] Handling call
0709 12:58:47.021285 (+ 24103us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.047449 (+ 26164us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:58:47.071578 (+ 24129us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.403955 (+332377us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800397840. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f629e07 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d423a 00007f6a4273ea2a
0709 12:58:47.679917 (+275962us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.865912 (+185995us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b2c00000708. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4102da11 00007f6a4103d372 00007f6a4276fa01 00007f6a4273443a 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2
0709 12:58:47.866356 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.866513 (+   157us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:58:47.866732 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.866884 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.866953 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.125761 (+258808us) raft_consensus.cc:1685] finished
0709 12:58:48.125779 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.125880 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3207,"prepare.queue_time_us":24506,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":6901,"raft.queue_time_us":104294,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":42487,"spinlock_wait_cycles":43919104,"thread_start_us":275808,"threads_started":1,"wal-append.queue_time_us":657090}
I20260709 12:58:48.119697  5617 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:48.106134  5867 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:58:48.125384  5943 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:48.087472  5446 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.257220  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:48.259896  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:48.236058  5617 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.260847  5617 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:48.234575  5823 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:48.205261  5809 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:48.182773  5946 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.237582  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:48.238675  5950 log.cc:927] Time spent T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:58:48.097289  5922 consensus_queue.cc:237] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.203195  1537 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:48.285094  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 85924.5us
I20260709 12:58:48.286278  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:48.248184  5932 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:48.249553  1572 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 12:58:48.141530  5939 log.cc:927] Time spent T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
W20260709 12:58:48.255329  5937 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 12:58:48.193186  5827 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:48.288810  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:48.314268  1645 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:48.118003  5898 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:48.303171  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.232064  5811 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:48.267599  5841 consensus_meta.cc:287] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.002s
I20260709 12:58:48.277511  5823 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.320245  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:48.283195  5940 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
W20260709 12:58:48.328547  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 220650us
I20260709 12:58:48.274866  5809 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.317325  1646 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:48.328156  1645 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:48.283690  5821 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:48.327631  1612 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:48.275102  5949 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.313032  5874 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:48.342034  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:48.343163  1645 raft_consensus.cc:2410] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:58:48.345690  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 59465.2us
I20260709 12:58:48.332177  5823 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:48.228129  5931 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.333410  5809 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:48.353828  5841 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:48.347092  5780 raft_consensus.cc:697] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:48.371304  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 43760.3us
I20260709 12:58:48.371402  1537 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:48.358906  5899 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.321242  5805 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.370846  5661 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.384387  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:48.411067  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:48.413388  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:48.414192  2343 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:58:48.386874  5852 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.421731  5954 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:48.401001  5899 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.384750  5820 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:58:48.383720  5955 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 12:58:48.393699  5434 consensus_meta.cc:287] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.003s
I20260709 12:58:48.437350  5434 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.439442  5434 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.441941  5780 consensus_queue.cc:237] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.442446  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:48.401459  5661 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:48.445145  5617 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.447062  5807 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:58:48.464965  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.453981  5776 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:48.468976  1570 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:58:48.455822  5827 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.427466  5899 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.457207  5515 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.432116  5895 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.459028  1644 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:48.492288  1644 pending_rounds.cc:85] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:58:48.492594  1644 pending_rounds.cc:107] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:48.459555  1642 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:48.370563  5330 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:48.451203  5823 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.483834  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:48.496258  1570 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:48.490474  1718 raft_consensus.cc:2393] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 15: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:48.348098  5949 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.418045  5906 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.499239  1644 raft_consensus.cc:2889] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:48.485502  5661 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:48.467425  5955 consensus_queue.cc:1243] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:48.471673  5776 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:48.482865  5807 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:48.530989  2346 raft_consensus.cc:2368] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10.
I20260709 12:58:48.396292  5886 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.537598  1566 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:48.482826  5957 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:48.537820  1570 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:48.540134  2314 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:48.506775  5558 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.568250  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:48.570138  1644 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:48.569129  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:48.571393  1572 raft_consensus.cc:2393] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:48.469753  5852 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:58:48.570339  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:48.498615  5671 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:58:48.540386  5954 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.587682  2345 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:48.577333  5962 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:48.573156  5906 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:48.568452  5957 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.604398  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:48.606444  2340 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:48.609555  5895 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:48.611213  5689 consensus_meta.cc:287] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.796s	user 0.011s	sys 0.000s
I20260709 12:58:48.611593  5689 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.611992  5887 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.615234  5617 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.616343  5887 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.581772  5673 raft_consensus.cc:2804] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:48.530383  5774 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.612708  1567 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:48.613530  5852 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.614027  5949 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.614652  1572 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:58:48.618435  5874 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:48.624128  1572 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:48.583550  5558 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.594206  5667 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.584172  5434 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.600371  5906 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.624055  5874 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:48.625895  5969 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.084s	user 0.003s	sys 0.002s
I20260709 12:58:48.594481  5898 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.618506  5673 raft_consensus.cc:697] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:48.617239  5957 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:48.625869  5776 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.621110  5661 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:48.630194  5962 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.663406  5776 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:48.663578  5962 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.666110  5962 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.666415  5867 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:48.667083  5827 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.666936  5867 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.668217  5823 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.670497  5515 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.671219  5821 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:48.672142  5821 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:48.673720  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.674644  5968 log.cc:927] Time spent T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:58:48.674933  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:48.675659  1714 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:48.675742  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:48.676115  5970 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:58:48.676367  1721 raft_consensus.cc:3060] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:48.660827  5661 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.661458  5899 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.662489  5931 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:48.662683  5874 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.662973  5774 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:48.676682  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:48.676978  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:48.677891  5558 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.679076  5673 consensus_queue.cc:237] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.631431  5692 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:48.605319  5954 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.631208  5807 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.680410  1565 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:58:48.627681  5852 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:48.685351  5967 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:58:48.685636  5890 raft_consensus.cc:3055] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:48.636545  5667 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.687249  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 554) took 1066 ms. Trace:
I20260709 12:58:48.733340  1718 rpcz_store.cc:276] 0709 12:58:47.624253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.256978 (+632725us) service_pool.cc:224] Handling call
0709 12:58:48.687056 (+430078us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400213c54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:48.687182 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534612864}
I20260709 12:58:48.687994  5689 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.688731  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:48.734644  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 61975us
I20260709 12:58:48.736023  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:48.736842  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:48.648588  5906 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.738220  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:48.691039  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:48.684526  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:48.697090  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 286098us
I20260709 12:58:48.739176  1714 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:48.739524  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:48.698014  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:48.705022  1713 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:48.705641  1720 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:48.699622  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:48.708413  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.708590  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:48.707976  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:48.709878  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:48.742492  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.742494  2341 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:48.710688  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:48.718443  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.718534  5874 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.638780  5434 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.748462  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:48.737449  1721 raft_consensus.cc:2468] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:48.731791  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:48.742252  1571 raft_consensus.cc:2368] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11.
I20260709 12:58:48.749871  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:48.750159  2347 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:48.743538  1719 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:58:48.740845  1612 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:48.666945  5550 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.689019  5943 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.762902  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:48.759873  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:48.763571  1571 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:48.760509  1537 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:48.766129  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:48.766811  1645 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:58:48.730746  5890 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:48.721709  5692 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.751958  5780 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:48.761169  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 76721.8us
I20260709 12:58:48.738296  5932 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:48.751763  5845 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:48.805670  5850 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:48.777872  1719 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:48.770812  1714 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:48.756847  5874 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:48.794907  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.794808  1684 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:48.798012  2347 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:48.762470  5617 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:48.773548  5657 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:58:48.807603  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 66826.8us
I20260709 12:58:48.814975  5774 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:48.808141  1568 raft_consensus.cc:2368] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12.
I20260709 12:58:48.807433  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:48.822983  5852 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.823911  1719 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:48.797488  5780 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.849005  5874 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.850500  5661 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.773557  5988 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.851550  5988 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.854269  5434 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.857713  5667 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.814656  5867 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:48.818120  5657 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.861354  5657 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:48.864132  1645 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:58:48.814975  2341 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:58:48.819860  5965 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:48.774475  5840 consensus_meta.cc:287] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.921s	user 0.013s	sys 0.000s
I20260709 12:58:48.826639  5917 consensus_queue.cc:1059] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:48.868767  5805 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:48.826668  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:48.869613  5984 raft_consensus.cc:2764] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:58:48.808750  5886 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.840510  5809 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.836303  5954 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.847539  5845 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:48.870656  5787 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.871243  5787 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:48.848348  5967 log.cc:927] Time spent T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:58:48.872823  1565 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:48.813308  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:48.746639  5982 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:48.762313  5550 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:48.815062  1571 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:58:48.823629  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:48.869623  5852 raft_consensus.cc:2764] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:48.870121  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:48.871976  5809 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.848963  5780 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:48.841266  5986 consensus_queue.cc:1059] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:48.875504  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 1998) took 1211 ms. Trace:
I20260709 12:58:48.882026  1563 rpcz_store.cc:276] 0709 12:58:47.664324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.784382 (+120058us) service_pool.cc:224] Handling call
0709 12:58:47.829897 (+ 45515us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:48.101469 (+271572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.101499 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:48.102034 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 12:58:48.368659 (+266625us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:48.383779 (+ 15120us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.384197 (+   418us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.408028 (+ 23831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.408101 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.875250 (+467149us) raft_consensus.cc:1685] finished
0709 12:58:48.875276 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.875428 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51846,"prepare.queue_time_us":53776,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":149359,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":35482,"spinlock_wait_cycles":26260096,"thread_start_us":351991,"threads_started":2,"wal-append.queue_time_us":398805}
I20260709 12:58:48.878872  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:48.880458  5550 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:48.879068  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:48.885831  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:48.890973  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 77778.1us
I20260709 12:58:48.893607  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:48.894232  1571 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:48.905895  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:48.905026  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:48.915359  1645 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:48.916194  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:48.920656  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:48.922317  1563 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:58:48.887027  5661 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:48.889076  5982 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:48.928166  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:48.892700  5965 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:48.906912  5667 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:48.938573  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:48.940366  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:48.933751  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:48.905565  5986 raft_consensus.cc:3055] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:48.927363  5550 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:58:48.936167  1571 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:48.947131  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:48.931304  5943 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:48.928918  5874 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:48.949317  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:48.934840  5821 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:48.953492  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:48.900776  5657 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.956883  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:48.939817  5899 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:48.946528  5807 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:48.948449  5932 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:48.963653  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2048) took 1011 ms. Trace:
I20260709 12:58:48.931879  5852 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:58:48.946213  5617 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.948114  5986 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:48.982421  1642 rpcz_store.cc:276] 0709 12:58:47.952389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.441057 (+488668us) service_pool.cc:224] Handling call
0709 12:58:48.441422 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.493303 (+ 51881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.963392 (+470089us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b54002666d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:48.963581 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41209216}
I20260709 12:58:48.961308  5988 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:48.970026  5938 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.055s	user 0.003s	sys 0.000s
I20260709 12:58:48.974431  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:49.008426  1640 raft_consensus.cc:2410] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:58:48.955976  5821 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.013252  5986 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.014248  5821 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:49.014906  5986 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:48.905299  5890 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.952070  5667 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:48.981932  5990 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:48.981971  5807 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.985874  1571 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:58:48.996068  5943 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.996994  5810 raft_consensus.cc:3055] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:49.000854  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:49.003948  5957 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:48.957835  5917 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:48.953275  5982 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:49.008275  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:49.055456  1645 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:49.007393  5617 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.012815  5954 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.016523  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.040717  5807 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:49.025065  5890 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:49.007620  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:49.054414  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:49.062971  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 55659.9us
I20260709 12:58:49.031481  5776 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.031989  5852 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:49.049547  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:49.015925  5932 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:49.068692  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:49.056136  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:47.495280   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:49.063890  1567 raft_consensus.cc:2368] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12.
I20260709 12:58:49.044142  5810 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:49.071201  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.063992  1535 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:49.064666  1684 leader_election.cc:400] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10.
I20260709 12:58:49.072402  1684 leader_election.cc:403] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:49.026544  5667 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.043604  5984 consensus_queue.cc:1059] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:58:49.073628  1714 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:49.059002  5917 raft_consensus.cc:697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:49.047727  5943 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.075774  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:49.062275  5982 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.090045  5982 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:49.065400  5946 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:49.092063  5780 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.092417  5917 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.096408  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:49.097247  1645 raft_consensus.cc:2410] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 12:58:49.081774  5993 log.cc:927] Time spent T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:58:49.082113  5810 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.066573  5889 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:49.099262  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.099661  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:49.101588  1571 raft_consensus.cc:2393] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:49.113250  1721 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:49.086457  5867 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10.
I20260709 12:58:49.086580  5809 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:49.115744  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.070959  5852 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.098673  5780 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:49.064320  5954 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:49.122444  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.126883  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.129143  5522 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:49.129994  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.149211  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.151428  1572 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:49.154542  1713 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:49.156842  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:49.119410  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44582.7us
I20260709 12:58:49.069904  5776 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.169754  5953 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:58:49.172466  5852 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:49.177349  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:49.179605  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:49.153963  5809 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:49.154765  5889 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:49.188220  5943 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:49.189841  5954 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:49.190564  5657 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:49.190173  5776 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:49.191676  5850 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:49.193063  5957 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:49.194576  5617 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:49.182796  5522 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:49.220005  5850 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:49.195859  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.196569  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:49.200098  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.167543  5810 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:49.203061  5977 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.493s	user 0.007s	sys 0.000s
W20260709 12:58:49.206904  5994 log.cc:927] Time spent T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 12:58:49.207507  5905 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:49.210676  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:49.210467  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:49.226127  1645 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:58:49.213057  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.214311  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:49.209978  5809 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:49.173424  5932 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.228334  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.227197  1713 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:49.230669  1571 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:49.234038  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.224311  5889 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.217571  5821 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.231776  5957 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:49.244684  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.245113  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:49.241878  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.249400  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2049) took 1144 ms. Trace:
I20260709 12:58:49.249848  1640 rpcz_store.cc:276] 0709 12:58:48.105230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.017616 (+912386us) service_pool.cc:224] Handling call
0709 12:58:49.017975 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.018268 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:49.044162 (+ 25894us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.248998 (+204836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.249049 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:49.249179 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.249242 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.249348 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28984,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"thread_start_us":204504,"threads_started":1}
I20260709 12:58:49.251263  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:49.251770  1640 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 7.
I20260709 12:58:49.252565  1645 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
W20260709 12:58:49.276842  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.252889  1640 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:49.281888  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2050) took 1167 ms. Trace:
I20260709 12:58:49.282270  1640 rpcz_store.cc:276] 0709 12:58:48.114229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.252320 (+1138091us) service_pool.cc:224] Handling call
0709 12:58:49.252575 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.280463 (+ 27888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.281824 (+  1361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.284046  1721 raft_consensus.cc:2393] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:49.288465  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2053) took 1164 ms. Trace:
I20260709 12:58:49.288853  1640 rpcz_store.cc:276] 0709 12:58:48.123981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.283008 (+1159027us) service_pool.cc:224] Handling call
0709 12:58:49.287970 (+  4962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.288169 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.288193 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.288234 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:49.288264 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.288315 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.288415 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.297950  1640 raft_consensus.cc:1240] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:49.298539  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2054) took 1172 ms. Trace:
I20260709 12:58:49.298841  1640 rpcz_store.cc:276] 0709 12:58:48.126461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.297504 (+1171043us) service_pool.cc:224] Handling call
0709 12:58:49.297784 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.298299 (+   515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.298490 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.299897  1640 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:49.349164  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2056) took 1207 ms. Trace:
I20260709 12:58:49.349606  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.349637  1640 rpcz_store.cc:276] 0709 12:58:48.141982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.299506 (+1157524us) service_pool.cc:224] Handling call
0709 12:58:49.299751 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.348863 (+ 49112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.349094 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.350360  1571 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:49.352068  1640 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:58:49.352427  1640 pending_rounds.cc:85] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:58:49.352638  1640 pending_rounds.cc:107] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:58:49.352922  1640 raft_consensus.cc:2889] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:49.363293  1640 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:49.366340  1640 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:58:49.366719  1640 pending_rounds.cc:85] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:58:49.366961  1640 pending_rounds.cc:107] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:58:49.367161  1640 raft_consensus.cc:2889] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:49.368095  1640 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:49.246639  5957 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:49.253718  5990 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:49.371454  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:49.351450  5845 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:49.375967  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:49.379810  6001 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:58:49.383374  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.240527  5850 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.364223  5825 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:49.388530  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.373678  5957 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:49.391530  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.375056  5990 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.393846  1719 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:49.377381  5852 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:49.385905  5814 raft_consensus.cc:3055] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:49.406226  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.385951  5821 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:49.390368  5822 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.429606  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.430266  1571 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:49.412472  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.431592  1713 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
W20260709 12:58:49.452759  5999 log.cc:927] Time spent T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:58:49.455210  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.406169  5953 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:49.485050  5953 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.384326  5845 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.495360  5845 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:49.411195  5814 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:49.508333  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.509179  1569 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:49.397114  5990 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:49.502599  5852 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.431051  5822 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.460116  5807 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.528381  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.396669  5825 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.522384  5852 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:49.555365  2346 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:49.569337  5822 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:49.569527  2340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 541) took 1125 ms. Trace:
I20260709 12:58:49.569875  2340 rpcz_store.cc:276] 0709 12:58:48.444059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.460128 (+ 16069us) service_pool.cc:224] Handling call
0709 12:58:48.460477 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.606967 (+146490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.569271 (+962304us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54004d8ad4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:49.569466 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335112960}
I20260709 12:58:49.533403  5814 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:49.572006  5814 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:49.575141  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:49.576290  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:49.579023  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.579463  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 624) took 1613 ms. Trace:
I20260709 12:58:49.582773  1563 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:49.584434  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.585127  1571 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 8.
I20260709 12:58:49.581816  1641 rpcz_store.cc:276] 0709 12:58:47.965678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.458242 (+492564us) service_pool.cc:224] Handling call
0709 12:58:48.458531 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.458715 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:48.484264 (+ 25549us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.579037 (+1094773us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b18003c8ce0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287
0709 12:58:49.579141 (+   104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.579189 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:49.579239 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.579301 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.579413 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5992,"prepare.queue_time_us":26177,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":50500,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4643,"spinlock_wait_cycles":74921216,"thread_start_us":172224,"threads_started":2,"wal-append.queue_time_us":227381}
I20260709 12:58:49.586251  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:49.589378  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:49.590453  5984 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:49.593915  1572 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:58:49.647498  1572 pending_rounds.cc:85] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 10
I20260709 12:58:49.647814  1572 pending_rounds.cc:107] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:58:49.584334  5988 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:49.598305  1571 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:58:49.615893  2340 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:49.616488  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:49.656421  2342 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:49.616703  1564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 634) took 1983 ms (client timeout 2063 ms). Trace:
W20260709 12:58:49.657624  1564 rpcz_store.cc:269] 0709 12:58:47.633307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.634159 (+   852us) service_pool.cc:224] Handling call
0709 12:58:49.616493 (+1982334us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b5400093654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:49.616628 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260482816}
I20260709 12:58:49.615952  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:49.586611  5986 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:58:49.630188  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.635506  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:49.661535  2349 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:49.636869  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:49.639405  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:49.643687  2343 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:49.666061  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:49.666714  1719 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:49.645591  1569 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:49.688228  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:49.667768  5986 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:49.648087  1572 raft_consensus.cc:2889] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:49.670496  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.672065  1571 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:58:49.676963  1639 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:58:49.696357  1639 pending_rounds.cc:85] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 5
I20260709 12:58:49.696727  1639 pending_rounds.cc:107] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:58:49.697021  1639 raft_consensus.cc:2889] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:49.646697  5984 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.650396  5988 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.683981  1719 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:49.684335  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:49.709892  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.710940  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:49.711419  1719 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:49.683383  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:49.705468  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:49.714413  1572 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:49.714576  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:49.713255  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:49.709731  2348 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:58:49.703298  5905 raft_consensus.cc:1064] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:58:49.721493  1719 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
W20260709 12:58:49.711992  5944 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.856s	user 0.004s	sys 0.000s
I20260709 12:58:49.723857  1647 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:49.701920  5818 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.708624  5984 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:49.728116  1647 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:49.712872  5988 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:49.727388  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:49.703661  5986 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:49.746459  1647 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:49.754298  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:49.762596  1719 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:58:49.749461  5818 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.771306  1647 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:58:49.771675  1647 pending_rounds.cc:85] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 5
W20260709 12:58:49.736627  5991 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.917s	user 0.007s	sys 0.002s
I20260709 12:58:49.771907  1647 pending_rounds.cc:107] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:58:49.775413  1647 raft_consensus.cc:2889] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:49.775566  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.709352  5820 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:58:49.708949  5958 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:58:49.712239  5671 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:58:49.794539  1571 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [7.4-10.5]
I20260709 12:58:49.714087  5890 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:49.799242  1719 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:58:49.805362  5811 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:49.805881  5811 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.805918  5825 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:49.806710  5811 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:49.815984  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2125) took 1703 ms. Trace:
I20260709 12:58:49.816502  1568 rpcz_store.cc:276] 0709 12:58:48.112200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.114574 (+  2374us) service_pool.cc:224] Handling call
0709 12:58:49.815761 (+1701187us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54001658d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:49.815917 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521274240}
I20260709 12:58:49.821800  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.745395  5809 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:49.827267  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:49.784883  5807 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:49.797268  5820 consensus_queue.cc:1243] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer c05ea12435084ad9b281ed3a0a2ecebe log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:58:49.849306  1571 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 11. Current term is 12. Ops: []
W20260709 12:58:49.866948  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.822615  1719 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:58:49.946509  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 623) took 1993 ms. Trace:
I20260709 12:58:49.952541  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:49.947077  1638 rpcz_store.cc:276] 0709 12:58:47.956337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.455108 (+498771us) service_pool.cc:224] Handling call
0709 12:58:48.455477 (+   369us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:58:48.470288 (+ 14811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.470333 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:58:48.471206 (+   873us) log.cc:844] Serialized 78 byte log entry
0709 12:58:48.726503 (+255297us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:48.726539 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.726600 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.736040 (+1009440us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:49.946126 (+210086us) raft_consensus.cc:1685] finished
0709 12:58:49.946154 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.946428 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14320,"raft.queue_time_us":130157,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11118,"spinlock_wait_cycles":14661504,"thread_start_us":243336,"threads_started":1,"wal-append.queue_time_us":298749}
I20260709 12:58:49.964699  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2022) took 1119 ms. Trace:
I20260709 12:58:49.969790  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:49.965194  1564 rpcz_store.cc:276] 0709 12:58:48.845521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.679976 (+834455us) service_pool.cc:224] Handling call
0709 12:58:49.689545 (+  9569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.689794 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:49.821749 (+131955us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.964351 (+142602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.964400 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:49.964451 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.964519 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.964628 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"thread_start_us":247894,"threads_started":2}
I20260709 12:58:49.970412  1719 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:49.984331  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 171320us
I20260709 12:58:49.985180  1571 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:49.985879  1612 leader_election.cc:400] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12.
I20260709 12:58:49.986213  1612 leader_election.cc:403] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:50.013847  2342 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:58:50.014950  2347 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:49.982625  5845 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:50.027400  6005 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:58:50.024257  5990 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.028843  5852 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.030993  5852 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.032131  1572 raft_consensus.cc:2468] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
W20260709 12:58:50.041905  5957 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.635s	user 0.004s	sys 0.007s
I20260709 12:58:50.042363  5957 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.047469  5953 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.003185  5807 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:50.049145  5807 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.050029  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 565) took 1387 ms. Trace:
I20260709 12:58:50.051057  5807 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:50.050388  1712 rpcz_store.cc:276] 0709 12:58:48.662812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.674990 (+ 12178us) service_pool.cc:224] Handling call
0709 12:58:48.675323 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:48.876957 (+201634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.876986 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:48.913515 (+ 36529us) log.cc:844] Serialized 52 byte log entry
0709 12:58:49.211303 (+297788us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:49.211342 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.049640 (+838298us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54000eecd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.049691 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.049736 (+    45us) raft_consensus.cc:1685] finished
0709 12:58:50.049748 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.049968 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18670,"raft.queue_time_us":264,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":10655,"spinlock_wait_cycles":462803200,"thread_start_us":263309,"threads_started":1,"wal-append.queue_time_us":313141}
I20260709 12:58:50.060520  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 2289) took 1118 ms. Trace:
W20260709 12:58:50.061216  6008 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:58:50.061861  2341 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:58:50.062814  1645 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:50.065068  5809 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.025981  5905 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.003012  6012 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12.
I20260709 12:58:50.069633  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2012) took 1391 ms. Trace:
I20260709 12:58:50.070012  1563 rpcz_store.cc:276] 0709 12:58:48.677979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.939692 (+261713us) service_pool.cc:224] Handling call
0709 12:58:48.945854 (+  6162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.583105 (+637251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.069370 (+486265us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54001856d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.069557 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464016768}
I20260709 12:58:50.070660  5845 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:50.072913  5845 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:50.073048  2345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 534) took 2275 ms. Trace:
I20260709 12:58:50.073395  2345 rpcz_store.cc:276] 0709 12:58:47.797248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.797387 (+   139us) service_pool.cc:224] Handling call
0709 12:58:47.797639 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.604771 (+807132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.072807 (+1468036us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54005c4254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.072967 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816318336}
I20260709 12:58:50.078222  5811 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.078662  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 627) took 2095 ms. Trace:
I20260709 12:58:50.079003  1642 rpcz_store.cc:276] 0709 12:58:47.982794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.007975 (+1025181us) service_pool.cc:224] Handling call
0709 12:58:49.034883 (+ 26908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.173071 (+138188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.173101 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.173155 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:49.173204 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.078439 (+905235us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54000f8cd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.078481 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.078591 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317329280}
I20260709 12:58:50.080241  5811 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.081225  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1942) took 2342 ms. Trace:
W20260709 12:58:50.081602  5810 consensus_meta.cc:287] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.858s	user 0.008s	sys 0.004s
I20260709 12:58:50.081583  1717 rpcz_store.cc:276] 0709 12:58:47.739242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.791542 (+ 52300us) service_pool.cc:224] Handling call
0709 12:58:47.791779 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:47.919164 (+127385us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:47.931513 (+ 12349us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.327000 (+395487us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.660599 (+333599us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b18003b8900. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a3f649a40 00007f6a3f6444e4 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287 00007f6a4274f208
0709 12:58:48.661133 (+   534us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.661305 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.661343 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:48.661392 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.080971 (+1419579us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001752d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.081013 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.081170 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324081,"prepare.queue_time_us":13968,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":338601,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":12391,"spinlock_wait_cycles":322269568,"thread_start_us":394646,"threads_started":1,"wal-append.queue_time_us":555321,"wal-append.run_cpu_time_us":7739,"wal-append.run_wall_time_us":1186787}
I20260709 12:58:50.083770  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:50.085650  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:50.087520  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 558) took 2458 ms. Trace:
I20260709 12:58:50.087936  1716 rpcz_store.cc:276] 0709 12:58:47.629283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.629400 (+   117us) service_pool.cc:224] Handling call
0709 12:58:47.629689 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:47.881817 (+252128us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:58:47.889762 (+  7945us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.091663 (+201901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.091709 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:48.091748 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.833872 (+1742124us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b18004358e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6152a6 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419
0709 12:58:50.087276 (+253404us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400277ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.087329 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.087457 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10193,"prepare.queue_time_us":8419,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":5103,"raft.queue_time_us":373,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4148,"spinlock_wait_cycles":582817920,"thread_start_us":201178,"threads_started":1,"wal-append.queue_time_us":354996,"wal-append.run_cpu_time_us":992,"wal-append.run_wall_time_us":1001087}
I20260709 12:58:50.090629  1716 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:50.091181  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 2295) took 1145 ms. Trace:
I20260709 12:58:50.091480  1716 rpcz_store.cc:276] 0709 12:58:48.945497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.090066 (+1144569us) service_pool.cc:224] Handling call
0709 12:58:50.090381 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:50.090950 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.091131 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:50.100485  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:50.101338  1572 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:50.108999  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.052420  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:50.110909  1712 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:50.060928  1713 rpcz_store.cc:276] 0709 12:58:48.942121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.525621 (+583500us) service_pool.cc:224] Handling call
0709 12:58:49.552000 (+ 26379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.552453 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:49.633139 (+ 80686us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.848870 (+215731us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:49.924240 (+ 75370us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.924429 (+   189us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:49.924478 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.924581 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.060323 (+135742us) raft_consensus.cc:1685] finished
0709 12:58:50.060341 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.060465 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9428,"prepare.queue_time_us":32098,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2961,"raft.queue_time_us":385,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":78927,"thread_start_us":167019,"threads_started":1,"wal-append.queue_time_us":321233}
I20260709 12:58:50.121169  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:50.121750  2345 raft_consensus.cc:2376] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14. Re-sending same reply.
I20260709 12:58:50.126704  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:50.108762  5911 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.127884  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:50.129622  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 2017) took 1450 ms. Trace:
I20260709 12:58:50.129985  1565 rpcz_store.cc:276] 0709 12:58:48.679167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.720925 (+ 41758us) service_pool.cc:224] Handling call
0709 12:58:50.129457 (+1408532us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400133654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:50.129566 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307447040}
I20260709 12:58:50.136906  1610 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:50.143114  5911 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.144225  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:50.128928  5852 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.145052  5852 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.145787  5984 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.147162  5852 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.147719  5852 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:50.149819  5957 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.151662  5988 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.153546  1720 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:50.118750  5811 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.154487  1571 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:50.155843  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:50.168788  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 575) took 1087 ms. Trace:
I20260709 12:58:50.170017  1713 rpcz_store.cc:276] 0709 12:58:49.081667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.127458 (+1045791us) service_pool.cc:224] Handling call
0709 12:58:50.168138 (+ 40680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.168354 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:50.168390 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:50.168443 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:50.168489 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.168576 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.168720 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:50.157940  1717 raft_consensus.cc:1240] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:50.178431  1717 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:58:50.152779  6012 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.148310  6010 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:50.190572  1571 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:58:50.148144  5852 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:50.192612  1720 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:58:50.192797  5889 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:50.193310  5958 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:58:50.193866  5890 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:50.195492  5898 raft_consensus.cc:3055] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:50.174536  5957 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:50.235069  5957 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:50.147732  5984 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.181100  5809 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:50.234575  5898 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:50.236914  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:50.239275  1563 raft_consensus.cc:1275] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:58:50.237727  1565 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:50.243811  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 644) took 1994 ms. Trace:
I20260709 12:58:50.174341  5811 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.244325  1566 rpcz_store.cc:276] 0709 12:58:48.249264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.261913 (+ 12649us) service_pool.cc:224] Handling call
0709 12:58:48.262187 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.539084 (+276897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.243513 (+1704429us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400094f54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.243733 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632981888}
I20260709 12:58:50.199203  5953 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:58:50.230217  5852 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:50.252415  1719 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:50.252820  1572 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:50.261900  1713 raft_consensus.cc:3055] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:50.262270  1713 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:50.265166  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.240412  5957 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:50.263057  1713 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.283257  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 2142) took 1039 ms. Trace:
I20260709 12:58:50.283680  1570 rpcz_store.cc:276] 0709 12:58:49.244100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.747723 (+503623us) service_pool.cc:224] Handling call
0709 12:58:49.748035 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.748293 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:49.963886 (+215593us) log.cc:844] Serialized 14 byte log entry
0709 12:58:50.282928 (+319042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:50.282986 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:50.283027 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.283088 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.283199 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13138,"prepare.queue_time_us":254248,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":519245,"threads_started":2}
I20260709 12:58:50.248607  5809 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:50.225869  6012 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.269170  5692 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:50.241588  5889 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.301865  1713 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:50.284996  5990 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.232620  6010 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:50.326996  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46027.3us
W20260709 12:58:50.321746  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 184950us
I20260709 12:58:50.331111  1610 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:50.335747  5809 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.339838  6012 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.341325  6012 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:50.341713  6012 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:50.341945  5985 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.523s	user 0.003s	sys 0.006s
W20260709 12:58:50.328457  5917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.000s	sys 0.014s
I20260709 12:58:50.324916  5988 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.351074  1713 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:50.352975  5910 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:58:50.354363  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.342043  6012 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:50.289896  5898 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:50.350579  5917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.000s	sys 0.014s
W20260709 12:58:50.359638  6017 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:58:50.373219  6010 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:50.378894  5852 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.380919  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46160 (request call id 2300) took 1339 ms. Trace:
I20260709 12:58:50.381352  1716 rpcz_store.cc:276] 0709 12:58:49.041601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.092170 (+1050569us) service_pool.cc:224] Handling call
0709 12:58:50.092470 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:50.200412 (+107942us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:50.200453 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:50.225356 (+ 24903us) log.cc:844] Serialized 26 byte log entry
0709 12:58:50.355200 (+129844us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:50.355241 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.355303 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.380730 (+ 25427us) raft_consensus.cc:1685] finished
0709 12:58:50.380750 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.380865 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13602,"raft.queue_time_us":13725,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":22436,"thread_start_us":94439,"threads_started":1,"wal-append.queue_time_us":129434}
W20260709 12:58:50.383021  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 51981.8us
I20260709 12:58:50.385805  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:50.362941  5911 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.386385  1646 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:50.387265  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:50.389217  1640 raft_consensus.cc:2393] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:50.389792  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:50.390601  1647 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:50.392098  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:50.392629  1641 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:50.392834  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:50.394057  1647 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:50.395349  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:50.396050  1638 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:50.398206  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:50.398787  1647 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:50.385090  5898 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:50.402444  5811 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:50.417541  2345 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:50.417582  1646 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:50.421161  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:50.426403  1641 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:50.428067  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:50.431243  1641 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:58:50.417968  5986 consensus_meta.cc:287] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.644s	user 0.013s	sys 0.000s
I20260709 12:58:50.411111  5852 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:50.432565  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:50.433691  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 625) took 2453 ms. Trace:
I20260709 12:58:50.434047  1644 rpcz_store.cc:276] 0709 12:58:47.979948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.618725 (+638777us) service_pool.cc:224] Handling call
0709 12:58:48.624999 (+  6274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.710098 (+ 85099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.710129 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.710168 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:48.710198 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.433478 (+1723280us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b5400096ad4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.433519 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.433626 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195299200}
I20260709 12:58:50.436230  2346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 547) took 1350 ms. Trace:
I20260709 12:58:50.436571  2346 rpcz_store.cc:276] 0709 12:58:49.086038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.086308 (+   270us) service_pool.cc:224] Handling call
0709 12:58:49.086635 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.555922 (+469287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.436019 (+880097us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54006decd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.436179 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077385984}
I20260709 12:58:50.441949  5787 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:50.442152  6024 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:58:50.443490  1571 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:50.443846  1571 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:50.444555  1571 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.445603  1571 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:50.446858  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:50.449790  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.453881  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:50.446936  1647 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:50.468149  1571 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:58:50.473465  1571 pending_rounds.cc:85] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 10
W20260709 12:58:50.459858  6028 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:58:50.465255  6026 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:58:50.437987  5986 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.473881  1571 pending_rounds.cc:107] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:58:50.460880  5811 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:50.488989  5811 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:50.490809  6019 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:58:50.491374  5811 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.480180  1571 raft_consensus.cc:2889] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:50.487816  5762 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:50.480175  6022 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:58:50.453182  5889 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:50.494629  5927 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:50.492177  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 130404us
I20260709 12:58:50.497007  5889 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:50.497871  5986 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.512691  2314 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:50.512262  5762 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:50.512743  5957 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.519450  5667 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:50.518652  6012 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.516948  5818 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.520967  5957 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:50.517324  5762 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:50.523790  5667 raft_consensus.cc:2804] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:50.525332  5667 raft_consensus.cc:697] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:50.526585  5667 consensus_queue.cc:237] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.531930  6012 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:50.631677  5983 log.cc:927] Time spent T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 1.810s	user 0.000s	sys 0.003s
I20260709 12:58:50.641377  2347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 559) took 1025 ms. Trace:
I20260709 12:58:50.641886  2347 rpcz_store.cc:276] 0709 12:58:49.615631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.615739 (+   108us) service_pool.cc:224] Handling call
0709 12:58:50.641178 (+1025439us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54006df954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:50.641311 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712507648}
W20260709 12:58:50.643087  1567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 2018) took 1963 ms (client timeout 2028 ms). Trace:
W20260709 12:58:50.643489  1567 rpcz_store.cc:269] 0709 12:58:48.679396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.888710 (+209314us) service_pool.cc:224] Handling call
0709 12:58:50.642885 (+1754175us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001fed54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:50.643026 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346640768}
I20260709 12:58:50.655908  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:50.656996  5917 consensus_queue.cc:1048] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:50.658448  5917 consensus_queue.cc:1059] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:50.659353  5917 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:50.659672  5917 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:50.660030  5917 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:50.660842  5910 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:50.661283  5910 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:50.662184  5910 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.663391  5910 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:50.667188  5792 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:50.687647  5917 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.695073  5917 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:50.703398  5850 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 12:58:50.730077  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:50.748572  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:50.757745  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.780930  1610 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:50.802224  5847 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.006s	sys 0.001s
W20260709 12:58:50.802690  5847 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.006s	sys 0.001s
I20260709 12:58:50.804191  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2043) took 2853 ms. Trace:
I20260709 12:58:50.804685  1643 rpcz_store.cc:276] 0709 12:58:47.951168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.426752 (+475584us) service_pool.cc:224] Handling call
0709 12:58:48.463157 (+ 36405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.471638 (+  8481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.471682 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.489689 (+ 18007us) log.cc:844] Serialized 26 byte log entry
0709 12:58:48.703310 (+213621us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:48.703345 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.703406 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.630995 (+1927589us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:50.802899 (+171904us) raft_consensus.cc:1685] finished
0709 12:58:50.802914 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.803920 (+  1006us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5400336150. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:50.804058 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11393,"raft.queue_time_us":141367,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":11466,"spinlock_wait_cycles":91843072,"thread_start_us":164092,"threads_started":1,"wal-append.queue_time_us":259415}
W20260709 12:58:50.832595  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 336881us
I20260709 12:58:50.832772  6037 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:50.833669  1686 leader_election.cc:400] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11.
I20260709 12:58:50.833982  1686 leader_election.cc:403] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:58:50.834849  6037 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11.
I20260709 12:58:50.835417  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:50.839573  1717 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:50.839933  1717 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:50.840688  1717 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:50.841657  1717 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:50.869246  1535 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:43269 timed out after 1.801s (SENT) [suppressed 5 similar messages]
W20260709 12:58:50.880508  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 45164.3us
I20260709 12:58:50.892908  5847 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.893534  5847 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:50.894307  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.895606  5847 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.898067  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:50.898669  6035 log.cc:927] Time spent T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.393s	user 0.002s	sys 0.000s
I20260709 12:58:50.898739  1565 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:50.900167  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:50.900698  1565 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:50.905472  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1963) took 1886 ms. Trace:
I20260709 12:58:50.905866  1639 rpcz_store.cc:276] 0709 12:58:49.019046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.629227 (+610181us) service_pool.cc:224] Handling call
0709 12:58:49.629465 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.697521 (+ 68056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.905239 (+1207718us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b5400209ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.905414 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108517120}
I20260709 12:58:50.907683  1565 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
W20260709 12:58:50.908558  6020 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.617s	user 0.003s	sys 0.000s
I20260709 12:58:50.909384  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:50.909973  1569 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:50.910317  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 662) took 1095 ms. Trace:
I20260709 12:58:50.910679  1564 rpcz_store.cc:276] 0709 12:58:49.814570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.983988 (+169418us) service_pool.cc:224] Handling call
0709 12:58:50.003511 (+ 19523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:50.003837 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:50.003868 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:50.004360 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:58:50.179562 (+175202us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:50.179635 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.179721 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.908111 (+728390us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:50.910061 (+  1950us) raft_consensus.cc:1685] finished
0709 12:58:50.910082 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.910261 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2495,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4497,"spinlock_wait_cycles":4470656,"thread_start_us":174837,"threads_started":1,"wal-append.queue_time_us":253701}
I20260709 12:58:50.914113  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2052) took 2795 ms. Trace:
I20260709 12:58:50.914450  1645 rpcz_store.cc:276] 0709 12:58:48.118401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.253411 (+1135010us) service_pool.cc:224] Handling call
0709 12:58:49.253751 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.063181 (+809430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.913903 (+850722us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b5400290254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.914055 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1860237568}
I20260709 12:58:50.916617  1569 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:50.918345  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:50.919039  1569 raft_consensus.cc:2410] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:50.919777  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:50.920290  1565 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:50.922013  1567 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:50.923496  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:50.923638  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:50.924268  1564 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:50.925371  1572 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:50.930506  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:50.931066  1563 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:50.937045  6036 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:50.960330  6036 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:50.945765  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.941342  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:51.983652  1572 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:51.984136  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2155) took 1057 ms. Trace:
I20260709 12:58:50.942687  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:51.986217  1567 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:50.946517  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:51.989266  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 581) took 1151 ms. Trace:
I20260709 12:58:51.989682  1564 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:51.990254  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2156) took 1048 ms. Trace:
I20260709 12:58:51.990526  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 582) took 1152 ms. Trace:
I20260709 12:58:51.990659  5927 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.967335  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:51.984442  1572 rpcz_store.cc:276] 0709 12:58:50.926384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.941076 (+ 14692us) service_pool.cc:224] Handling call
0709 12:58:51.984080 (+1043004us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:51.992491  2347 raft_consensus.cc:2368] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
I20260709 12:58:51.992969  2347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 550) took 1026 ms. Trace:
I20260709 12:58:51.993278  2347 rpcz_store.cc:276] 0709 12:58:50.966919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.967072 (+   153us) service_pool.cc:224] Handling call
0709 12:58:51.992911 (+1025839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:50.968696  2348 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:50.940618  1563 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:51.990581  1564 rpcz_store.cc:276] 0709 12:58:50.942015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.946262 (+  4247us) service_pool.cc:224] Handling call
0709 12:58:51.990201 (+1043939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:51.996351  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 673) took 1305 ms. Trace:
I20260709 12:58:50.973516  6036 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:50.977959  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1951) took 2277 ms. Trace:
W20260709 12:58:51.304306  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 77686.4us
I20260709 12:58:51.996977  1714 rpcz_store.cc:276] 0709 12:58:48.701556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.808006 (+106450us) service_pool.cc:224] Handling call
0709 12:58:48.808305 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.074082 (+265777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.977705 (+1903623us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54002774d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:50.977900 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609422080}
W20260709 12:58:51.771958  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080012aa40 after lost signal to thread 431
I20260709 12:58:51.880481  5805 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:58:51.998893  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08000388e0 after lost signal to thread 434
W20260709 12:58:51.999351  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080012a420 after lost signal to thread 1464
I20260709 12:58:51.999750  5805 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:52.000108  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080012a860 after lost signal to thread 1504
W20260709 12:58:52.000550  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080013a480 after lost signal to thread 1524
I20260709 12:58:52.000245  5805 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:52.001720  1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800038a20 after lost signal to thread 1596
I20260709 12:58:52.002352  5805 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:51.877813  5807 consensus_queue.cc:1059] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:58:51.960594  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 1.07871e+06us
W20260709 12:58:51.890935  1537 connection.cc:256] RPC call timeout handler was delayed by -1.9038831690000393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:58:52.058760  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:52.059274  1537 connection.cc:256] RPC call timeout handler was delayed by -1.7193831690000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 12:58:52.059831  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.918256  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 1.13726e+06us
I20260709 12:58:52.062126  6053 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.062755  6053 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:51.921332  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.945039  1570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.005s	sys 0.025s
W20260709 12:58:52.065418  1570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.006s	sys 0.025s
I20260709 12:58:52.066095  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 2159) took 1122 ms. Trace:
I20260709 12:58:52.066447  1570 rpcz_store.cc:276] 0709 12:58:50.943578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.951546 (+  7968us) service_pool.cc:224] Handling call
0709 12:58:50.951857 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.952059 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:50.952550 (+   491us) log.cc:844] Serialized 14 byte log entry
0709 12:58:52.065794 (+1113244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:52.065839 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:52.065884 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:52.065947 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:52.066041 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":99,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":1112937,"threads_started":1,"wal-append.queue_time_us":10608,"wal-append.run_cpu_time_us":1002,"wal-append.run_wall_time_us":1001426}
I20260709 12:58:52.068225  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:51.952430  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.069028  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2158) took 1125 ms. Trace:
I20260709 12:58:52.069346  1569 rpcz_store.cc:276] 0709 12:58:50.943312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.945160 (+  1848us) service_pool.cc:224] Handling call
0709 12:58:52.068975 (+1123815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:52.069732  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:52.070169  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.071341  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:52.071851  1569 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:52.072160  6053 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:52.072901  6053 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:51.961659  6045 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:52.073480  6045 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.076187  6045 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:51.978539  6057 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:52.076848  6057 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.078936  6057 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:51.996703  1563 rpcz_store.cc:276] 0709 12:58:50.690721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.930256 (+239535us) service_pool.cc:224] Handling call
0709 12:58:51.996295 (+1066039us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:52.071362  1566 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:52.079998  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.080633  1563 raft_consensus.cc:2368] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
I20260709 12:58:52.080536  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.081579  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.081979  1570 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:52.082342  1563 raft_consensus.cc:2410] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:58:51.913244  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 2292) took 2969 ms (client timeout 2435 ms). Trace:
W20260709 12:58:52.085556  1721 rpcz_store.cc:269] 0709 12:58:48.943996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.234704 (+290708us) service_pool.cc:224] Handling call
0709 12:58:51.912983 (+2678279us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b54001068d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:51.913133 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3172736}
I20260709 12:58:51.962687  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:51.959777  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 580) took 1122 ms. Trace:
I20260709 12:58:52.261016  1717 rpcz_store.cc:276] 0709 12:58:50.837533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.839169 (+  1636us) service_pool.cc:224] Handling call
0709 12:58:50.839459 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.959433 (+1119974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.959462 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.959499 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:51.959532 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.959600 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.959717 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1103868,"raft.queue_time_us":1104702,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88}
I20260709 12:58:51.963220  5762 consensus_queue.cc:1059] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:51.949173  5823 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:50.965426  5671 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.272805  5823 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.273455  5671 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.274912  5823 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:52.275709  5671 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:51.998359  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:51.979445  5776 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.281483  5776 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.283398  5776 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:51.981045  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.919703  5955 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:51.947297  5957 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:52.288786  5957 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.291090  5957 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.007249  5807 raft_consensus.cc:3055] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:52.294642  5807 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:51.971524  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:51.970769  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:51.880899  6052 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:51.888509  5780 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:51.962225  5889 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:51.994962  2348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 552) took 1027 ms. Trace:
I20260709 12:58:51.979085  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:51.969975  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:51.969048  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:51.991086  1715 rpcz_store.cc:276] 0709 12:58:50.838082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.321237 (+483155us) service_pool.cc:224] Handling call
0709 12:58:51.321624 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:51.982889 (+661265us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:51.983166 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 12:58:51.984519 (+  1353us) log.cc:844] Serialized 14 byte log entry
0709 12:58:51.984686 (+   167us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:51.985184 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:58:51.985306 (+   122us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:51.985338 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.985404 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:51.990353 (+  4949us) raft_consensus.cc:1685] finished
0709 12:58:51.990370 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.990475 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":645921,"prepare.queue_time_us":1830,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":49,"raft.queue_time_us":661080,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":220,"thread_start_us":15727,"threads_started":2,"wal-append.queue_time_us":1178}
I20260709 12:58:51.991254  5927 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.303069  1713 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:52.303736  5927 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:52.094069  6045 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:52.121928  5899 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:51.989753  1718 rpcz_store.cc:276] 0709 12:58:50.837825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.844738 (+  6913us) service_pool.cc:224] Handling call
0709 12:58:50.845032 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.845250 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:58:50.845528 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 12:58:51.960685 (+1115157us) log.cc:844] Serialized 14 byte log entry
0709 12:58:51.988875 (+ 28190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.988923 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:51.988974 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.989052 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.989199 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1091745,"prepare.queue_time_us":1042364,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":1092449,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":171,"thread_start_us":50758,"threads_started":2,"wal-append.queue_time_us":52626,"wal-append.run_cpu_time_us":1018,"wal-append.run_wall_time_us":1001106}
I20260709 12:58:52.158177  6066 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.309036  5899 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.158604  6053 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.309439  6066 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.310168  6053 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.311478  6066 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.311596  5899 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:52.171706  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 78368.7us
I20260709 12:58:52.211095  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:52.211788  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:52.312156  6053 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.312598  2346 raft_consensus.cc:2376] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12. Re-sending same reply.
I20260709 12:58:52.213594  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:52.221494  5805 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.229626  5661 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:52.313321  2345 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:52.313369  1686 leader_election.cc:400] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12.
I20260709 12:58:52.313848  1686 leader_election.cc:403] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:58:52.313670  5661 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.315649  5661 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:52.230247  5818 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:52.232250  5984 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.316884  5984 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.317157  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:52.317430  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:52.318503  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:52.319067  5984 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.319275  1720 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 9: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:52.232880  5988 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.319731  5988 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.320003  6045 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:52.320966  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:52.321434  6045 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12.
I20260709 12:58:52.233460  6012 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:52.322232  2345 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:52.232321  5990 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.234301  6023 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:52.316990  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:52.323068  5990 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.323470  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:52.322620  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:52.323939  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:52.324244  1713 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:52.241057  5852 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.238168  5986 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:52.324604  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:52.002847  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08000c20c0 after lost signal to thread 1671
W20260709 12:58:52.325285  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080026e6e0 after lost signal to thread 1672
I20260709 12:58:52.259464  5845 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:52.325152  5986 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.276577  2349 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:58:52.325999  5990 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:52.326483  1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800376de0 after lost signal to thread 1745
W20260709 12:58:52.326771  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08000a84a0 after lost signal to thread 1746
I20260709 12:58:52.327006  5986 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.327204  2349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 551) took 1360 ms. Trace:
I20260709 12:58:52.276983  6057 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:58:52.258968  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 296336us
I20260709 12:58:52.242000  5911 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.295552  5807 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.328495  1684 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:52.328920  5807 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.329205  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:52.321652  5988 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.330204  6057 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:52.276602  1721 raft_consensus.cc:3055] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:52.331067  1721 raft_consensus.cc:740] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:52.328006  5805 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.328512  5911 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.297991  6052 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.331881  1721 consensus_queue.cc:260] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.162199  2314 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:52.295814  1719 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:52.333072  1721 raft_consensus.cc:3060] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:52.333348  5910 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:52.235416  6029 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:52.249110  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:52.334462  6029 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.335759  6068 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:52.333860  5910 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:52.337044  6037 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:52.327574  2349 rpcz_store.cc:276] 0709 12:58:50.967236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.967343 (+   107us) service_pool.cc:224] Handling call
0709 12:58:50.967642 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:52.326064 (+1358422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:52.327010 (+   946us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54004ba0d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:52.327153 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3009464704}
I20260709 12:58:52.337399  5910 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.338330  6056 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:52.338910  6056 consensus_queue.cc:1243] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:52.327907  5671 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.339762  5671 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.340010  6056 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:52.316251  5818 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.298533  2348 rpcz_store.cc:276] 0709 12:58:50.968019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.968138 (+   119us) service_pool.cc:224] Handling call
0709 12:58:50.968397 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.994715 (+1026318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.994908 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:52.332984  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 170860us
I20260709 12:58:52.341313  6056 consensus_queue.cc:1059] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:52.341964  6056 consensus_queue.cc:1243] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:52.324926  5852 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.343853  5852 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.323172  6023 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.344246  5671 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:52.345645  6023 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:52.345716  5671 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.347534  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:52.342183  5818 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.334648  6058 consensus_queue.cc:1059] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:52.348532  6058 raft_consensus.cc:3055] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:52.348896  6058 raft_consensus.cc:740] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:52.348994  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:52.349577  1718 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:52.349689  6058 consensus_queue.cc:260] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.350865  6058 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:52.330708  5845 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:58:52.351411  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:52.297933  5889 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.330741  6057 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:52.353029  6057 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:52.323299  1715 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:52.353901  5889 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:52.354506  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:52.346872  1719 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:52.331936  6052 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.346892  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:52.347862  5671 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.358891  6052 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.336433  6029 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.332935  5805 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.360773  6037 raft_consensus.cc:3055] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:52.361207  6037 raft_consensus.cc:740] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:52.362002  6037 consensus_queue.cc:260] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.363185  6037 raft_consensus.cc:3060] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:52.363663  5671 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:52.365247  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:52.366207  1720 raft_consensus.cc:2410] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:58:52.346325  1721 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:58:52.366855  1721 pending_rounds.cc:85] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 8
I20260709 12:58:52.367118  1721 pending_rounds.cc:107] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:58:52.367362  1721 raft_consensus.cc:2889] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:52.367669  1721 pending_rounds.cc:107] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:58:52.367897  1721 raft_consensus.cc:2889] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:52.368475  5762 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 12:58:52.369488  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.332960  5911 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.371381  6058 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.371851  6058 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.374159  6058 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:52.377089  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:52.327869  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080005a080 after lost signal to thread 2373
I20260709 12:58:52.370195  1715 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:58:52.381145  2344 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:52.389117  6057 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.391239  6057 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:52.022782  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.433606  1465 catalog_manager.cc:5697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 6 to 9, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.159376  1535 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:52.114403  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44754.4us
I20260709 12:58:52.441584  1564 raft_consensus.cc:1275] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:52.441915  1537 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:52.443682  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.445145  1564 raft_consensus.cc:2410] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:58:52.446369  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.447329  1564 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:52.448483  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.450420  1564 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
W20260709 12:58:52.046051  1565 consensus_meta.cc:287] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 1.125s	user 0.020s	sys 0.000s
I20260709 12:58:52.451843  1565 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:52.081607  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.186241  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.465719  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:52.151815  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 668) took 1495 ms. Trace:
I20260709 12:58:52.483672  6081 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:52.482885  1571 rpcz_store.cc:276] 0709 12:58:50.656543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.150928 (+1494385us) service_pool.cc:224] Handling call
0709 12:58:52.151195 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:52.151510 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:52.151537 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:52.151576 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:52.151609 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:52.151662 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:52.151762 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104}
I20260709 12:58:52.019142  1567 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:52.484587  6081 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:52.485102  1567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2157) took 1542 ms (client timeout 1969 ms). Trace:
W20260709 12:58:52.485515  1567 rpcz_store.cc:269] 0709 12:58:50.942363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.942465 (+   102us) service_pool.cc:224] Handling call
0709 12:58:52.484930 (+1542465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:51.961119  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 669) took 1298 ms. Trace:
I20260709 12:58:52.090032  1569 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:52.486573  1568 rpcz_store.cc:276] 0709 12:58:50.662894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.960318 (+1297424us) service_pool.cc:224] Handling call
0709 12:58:51.960622 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.960798 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.960821 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.960856 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:51.960883 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.960942 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.961043 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:52.488056  6081 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.488241  1563 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:52.230316  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 169002us
I20260709 12:58:52.231289  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:52.494704  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 263358us
W20260709 12:58:52.123901  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.456331  1465 catalog_manager.cc:5697] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 4 to 6, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.498270  5911 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:52.130968  1638 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:58:52.260128  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.138959  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 1979) took 1750 ms. Trace:
I20260709 12:58:52.133971  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.126159  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.128516  1643 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:52.145838  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.127573  1645 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:58:52.131866  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.132908  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:52.461314  5957 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:52.513015  5957 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:52.500589  1465 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:52.515172  6011 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.514700  1465 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 6 to 8, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 8 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:52.515947  6011 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.502368  1639 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:52.517915  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.518721  1639 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:52.519626  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.520047  6011 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:52.461823  6053 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:52.471346  6057 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.459115  5823 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:52.477451  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 308308us
I20260709 12:58:52.525063  6057 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.526834  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:52.504664  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:52.520542  1639 raft_consensus.cc:2410] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:58:52.509644  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.512583  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.503805  1641 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 14: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:58:52.502111  1463 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58424 (request call id 232) took 24387 ms (client timeout 15000 ms). Trace:
I20260709 12:58:52.504768  1642 raft_consensus.cc:2393] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 10: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:52.508239  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.502760  1640 rpcz_store.cc:276] 0709 12:58:50.390151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.390312 (+   161us) service_pool.cc:224] Handling call
0709 12:58:50.390555 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.488534 (+ 97979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:50.488589 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:50.488674 (+    85us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:50.488723 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:52.138705 (+1649982us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b54002661d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:52.138775 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:52.138899 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224688512}
I20260709 12:58:52.452732  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2149) took 1544 ms. Trace:
I20260709 12:58:52.525099  5823 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.506174  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.537611  1643 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:52.537379  5823 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.541286  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.530550  1565 rpcz_store.cc:276] 0709 12:58:50.908714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.919568 (+ 10854us) service_pool.cc:224] Handling call
0709 12:58:52.452569 (+1533001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:52.501578  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:52.511215  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:52.542178  1643 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
W20260709 12:58:52.548544  1684 connection.cc:256] RPC call timeout handler was delayed by -1.3487147090000349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 12:58:52.549126  1684 connection.cc:256] RPC call timeout handler was delayed by -1.1050188410000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 12:58:52.548472  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 55739.6us
I20260709 12:58:52.537949  5953 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.521971  1465 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:52.556109  1647 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:52.557158  1646 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:52.558437  1643 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:52.558569  1646 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:58:52.559537  1647 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:58:52.559955  1610 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:52.559485  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.560078  1647 pending_rounds.cc:85] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 6
I20260709 12:58:52.559609  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.560997  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:52.565866  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.567540  1640 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:58:52.570184  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 74487us
I20260709 12:58:52.571447  6051 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:52.573156  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.574213  1642 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:52.575911  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:52.565637  6066 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:52.577239  1646 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:52.577489  6052 consensus_queue.cc:1048] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:52.580778  5953 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.585914  1645 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:58:52.587956  5953 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:52.588928  1644 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:58:52.514717  5957 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.593852  1640 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:52.561316  6057 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:52.595326  1638 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:52.599705  6011 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:52.600630  6011 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:52.571449  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:52.603910  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:52.604164  6011 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:52.605240  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 44470.6us
I20260709 12:58:52.605890  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:52.608053  1535 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:52.609302  6082 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:52.585058  1647 pending_rounds.cc:107] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:58:52.610728  1647 raft_consensus.cc:2889] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:52.622311  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:52.622803  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:52.623891  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:52.625012  6053 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:52.625721  6053 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:52.628711  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 187248us
I20260709 12:58:52.628973  5823 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:52.629136  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 53483.7us
I20260709 12:58:52.613096  6082 raft_consensus.cc:697] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:58:52.633477  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 62320.4us
I20260709 12:58:52.633205  6082 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.633950  5911 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:52.634720  1612 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:52.634768  5911 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.609833  6066 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:52.638756  6066 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.617972  6051 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:52.627566  6053 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.639335  1465 catalog_manager.cc:5697] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 3 to 5, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.643234  1643 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
W20260709 12:58:52.530926  1463 rpcz_store.cc:269] 0709 12:58:28.114166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:28.114360 (+   194us) service_pool.cc:224] Handling call
0709 12:58:28.635839 (+521479us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269e090 00007f6a4273cf3a 00007f6a484f31cc 00007f6a485f137e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:28.719258 (+ 83419us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b54001c0610. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f610640 00007f6a484e7b76 00007f6a485f1c3e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:52.501783 (+23782525us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:44.544796 (+     0us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a3f62a0ac 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4616916c
0709 12:58:44.638954 (+ 94158us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:44.639656 (+   702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:44.639699 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:58:44.639724 (+    25us) tablet.cc:662] Decoding operations
0709 12:58:44.641576 (+  1852us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:44.641651 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:44.641668 (+    17us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:58:44.643518 (+  1850us) tablet.cc:701] Row locks acquired
0709 12:58:44.643558 (+    40us) write_op.cc:260] PREPARE: finished
0709 12:58:44.643678 (+   120us) write_op.cc:270] Start()
0709 12:58:44.643849 (+   171us) write_op.cc:276] Timestamp: P: 1783601924643631 usec, L: 0
0709 12:58:44.643865 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:58:44.644425 (+   560us) log.cc:844] Serialized 10640 byte log entry
0709 12:58:45.754087 (+1109662us) op_driver.cc:464] REPLICATION: finished
0709 12:58:46.041760 (+287673us) write_op.cc:301] APPLY: starting
0709 12:58:46.041863 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:46.157125 (+115262us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b18004381c0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:46.309461 (+152336us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:46.309518 (+    57us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:46.989373 (+679855us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:46.990057 (+   684us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0709 12:58:46.990123 (+    66us) write_op.cc:312] APPLY: finished
0709 12:58:46.990906 (+   783us) log.cc:844] Serialized 236 byte log entry
0709 12:58:47.203491 (+212585us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:47.224584 (+ 21093us) write_op.cc:454] Released schema lock
0709 12:58:47.248004 (+ 23420us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:47.333950 (+ 85946us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:47.337088 (+  3138us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":310178,"reported_tablets":51,"spinlock_wait_cycles":53447936,"child_traces":[["op",{"apply.queue_time_us":275610,"apply.run_cpu_time_us":52598,"apply.run_wall_time_us":1248917,"cfile_cache_hit":106,"cfile_cache_hit_bytes":110876,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":1,"lbm_read_time_us":28258,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":7,"num_ops":27,"prepare.queue_time_us":1161104,"prepare.run_cpu_time_us":47565,"prepare.run_wall_time_us":143508,"raft.queue_time_us":376786,"raft.run_cpu_time_us":34160,"raft.run_wall_time_us":256133,"replication_time_us":1096264,"spinlock_wait_cycles":263837184,"thread_start_us":1701835,"threads_started":5,"wal-append.queue_time_us":386630,"wal-append.run_cpu_time_us":17949,"wal-append.run_wall_time_us":2913751}]]}
I20260709 12:58:52.656122  2312 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:52.656390  5818 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:52.656670  1535 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:52.657002  5911 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.657207  5818 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:52.657727  5953 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:52.658159  5805 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:52.659823  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:52.660059  5852 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:52.660907  5852 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.661701  6081 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:52.664521  5852 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:52.653234  6051 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:58:52.673720  6029 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.673837  5910 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:58:52.673307  1465 catalog_manager.cc:5697] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 5 to 6, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.674506  6029 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.681723  5953 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:52.682657  5953 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:52.683923  5953 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.686450  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:52.689417  6029 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:52.689536  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:52.654716  5823 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:52.692965  1638 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:52.689458  1684 leader_election.cc:400] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
I20260709 12:58:52.695430  1684 leader_election.cc:403] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:52.701229  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:52.701927  6081 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:52.706410  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.707692  6057 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
I20260709 12:58:52.707845  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.708750  1640 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:52.708659  6057 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:52.708913  5762 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:52.703938  5957 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:52.715793  5807 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:52.715983  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.717113  1645 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:52.718207  6051 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:52.718742  6051 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.719162  6051 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:52.721036  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:52.721889  1647 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:52.722968  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:52.724891  2312 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:52.721908  2344 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:52.725811  5910 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:58:52.725958  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 91446.2us
I20260709 12:58:52.726711  1537 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:52.727102  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:52.729547  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 75136.8us
I20260709 12:58:52.745380  6053 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:52.747407  2312 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:52.763160  1644 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:58:52.772099  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.772908  1639 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:52.773936  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:52.775092  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.775652  1639 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 8.
I20260709 12:58:52.776443  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:52.777201  1639 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:52.779572  1639 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:52.783883  1641 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:58:52.784693  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:52.796933  1646 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:58:52.767292  5957 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:58:52.813468  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 56547.9us
W20260709 12:58:52.814054  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 60599.3us
W20260709 12:58:52.818429  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 91935us
I20260709 12:58:52.814263  1647 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:58:52.801033  5805 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:52.815477  1645 pending_rounds.cc:85] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 3
I20260709 12:58:52.822868  1645 pending_rounds.cc:107] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:58:52.816181  5910 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:58:52.815012  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 123297us
I20260709 12:58:52.815357  5852 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:52.823205  1645 raft_consensus.cc:2889] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:52.822801  5805 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:52.831367  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 63587.6us
I20260709 12:58:52.819695  5957 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:52.824354  5910 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:52.835391  5823 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:52.836769  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.834649  5957 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:52.843096  6023 consensus_queue.cc:1059] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:58:52.843483  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:52.844254  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 117358us
I20260709 12:58:52.833806  5805 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:52.853008  5852 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:52.854318  5852 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:52.841354  5910 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:52.856869  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:52.858042  1684 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:52.859308  1537 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:52.859668  6045 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:52.860072  6045 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:52.860491  6045 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:52.860838  6023 consensus_queue.cc:1243] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer c05ea12435084ad9b281ed3a0a2ecebe log is divergent from this leader: its last log entry 12.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:58:52.861485  6023 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:52.861843  6023 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:52.862840  6023 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.861487  1537 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:52.860350  6103 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:52.851722  5807 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:52.870397  6058 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:52.871311  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:52.871714  6058 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.872232  6058 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:52.870772  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:52.880523  2344 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:58:52.881567  6037 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:58:52.883069  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:52.884560  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:52.878453  6081 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:52.889910  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:52.884786  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.892045  1537 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:52.892874  6027 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:52.893849  6029 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:58:52.894153  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 50760.7us
I20260709 12:58:52.894337  6029 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:52.894815  6029 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:52.895234  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.896843  6103 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:52.897571  6103 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:52.888309  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:52.911387  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:52.892871  6023 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:52.945734  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.946842  6057 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:52.948766  5990 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:52.949239  5990 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:52.949648  5990 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:52.953931  6037 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:52.954399  6037 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:52.955084  5953 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:52.955366  6037 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.965490  5910 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:52.968480  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:53.007059  1537 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:53.007628  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 92547.8us
W20260709 12:58:53.008977  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 120809us
W20260709 12:58:53.028127  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 124986us
I20260709 12:58:53.034302  5910 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:53.035173  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.980945  6051 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:53.041736  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf900 after lost signal to thread 431
I20260709 12:58:53.037680  6058 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.044853  5762 raft_consensus.cc:3055] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:53.056239  5762 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:53.045953  6045 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.057881  6058 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.058323  6045 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.047273  1537 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:53.059427  5953 raft_consensus.cc:2764] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:58:53.059656  1537 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:53.060670  5953 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:53.061043  5953 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.061432  5953 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:53.063462  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:53.065629  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:53.066256  5805 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:53.066557  6058 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:53.067713  1719 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:53.068173  6058 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:53.025867  6066 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:53.069597  5762 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.071199  5762 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:53.071980  1716 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:53.071981  5953 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.074307  5953 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:53.049384  6029 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.050588  5957 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:53.022589  6081 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:53.076700  6029 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:53.077418  5957 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:53.079599  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.081990  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.082669  2347 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:53.083914  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:53.084769  6058 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.085594  6051 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.085438  6058 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.086024  6045 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:53.086344  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08000c88c0 after lost signal to thread 434
W20260709 12:58:53.086922  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800219f00 after lost signal to thread 1464
W20260709 12:58:53.087951  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080009b0a0 after lost signal to thread 1504
I20260709 12:58:53.088174  6058 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:53.088423  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080039bba0 after lost signal to thread 1524
W20260709 12:58:53.097232  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 161745us
I20260709 12:58:53.123179  6029 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.123772  6029 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.101583  5805 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.126010  6029 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:53.126384  6101 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.219s	user 0.005s	sys 0.000s
I20260709 12:58:53.095546  5818 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:53.125926  6058 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:58:53.102954  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.131999  1716 raft_consensus.cc:2410] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:53.132037  1684 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:53.139091  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 130749us
W20260709 12:58:53.140479  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 119777us
I20260709 12:58:53.135281  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.097855  6011 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:58:53.164464  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:53.164247  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 100882us
I20260709 12:58:53.167677  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:53.168318  1638 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:58:53.171213  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.172254  6113 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:53.173043  6058 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:53.174321  6113 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:53.174714  6113 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:53.174759  6058 consensus_queue.cc:1059] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:53.176968  1719 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:58:53.179257  5762 raft_consensus.cc:3055] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:53.179706  5762 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:53.180068  1646 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 12:58:53.180225  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003bf200 after lost signal to thread 1596
I20260709 12:58:53.140146  6045 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:58:53.180770  1572 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 12:58:53.182433  6107 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:58:53.182590  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 134771us
I20260709 12:58:53.169909  1720 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:53.171320  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:53.188269  1644 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:58:53.175199  6113 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:53.185853  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080032cc00 after lost signal to thread 1597
I20260709 12:58:53.190467  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:53.220630  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.225777  6105 log.cc:927] Time spent T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:58:53.226367  1571 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:58:53.229483  1569 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:53.169811  5953 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.231985  1719 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:58:53.231266  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:53.242141  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 91323.6us
I20260709 12:58:53.183753  5990 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.192119  5823 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:53.240901  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 112506us
I20260709 12:58:53.248854  1638 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:58:53.249889  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:53.233201  6023 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.248613  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:53.251587  1569 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:53.252593  1567 raft_consensus.cc:1240] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: [7.4-11.5]
I20260709 12:58:53.253330  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:53.258040  1566 raft_consensus.cc:1240] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:53.269150  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:53.274233  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:53.244011  5667 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
W20260709 12:58:53.277999  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.278622  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 79590.6us
I20260709 12:58:53.262050  6029 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:58:53.286639  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba2c0 after lost signal to thread 1671
I20260709 12:58:53.253197  5953 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:53.290619  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.287840  1567 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:58:53.290565  1564 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:53.292876  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:53.258193  5762 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.274618  6023 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.296994  6023 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:53.297572  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 55064.8us
I20260709 12:58:53.298091  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.298918  1572 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:53.299876  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.255833  2347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:53.301270  2347 raft_consensus.cc:606] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:53.301651  2347 raft_consensus.cc:614] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:53.301834  6109 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:58:53.288712  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003ada00 after lost signal to thread 1672
I20260709 12:58:53.300390  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:53.332433  6079 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:58:53.277312  5823 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.334321  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:53.335268  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 62742.6us
I20260709 12:58:53.336028  1684 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:53.338253  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 94653.8us
I20260709 12:58:53.337656  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.341739  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.340498  5818 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:53.344133  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:53.345093  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:53.345224  5818 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:53.346334  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:53.346959  1570 raft_consensus.cc:2376] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13. Re-sending same reply.
I20260709 12:58:53.347841  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.347939  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:53.338282  6061 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:53.349018  5818 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:53.349506  6045 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:53.349591  5818 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.349953  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.350529  5818 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:53.351258  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.351999  1570 raft_consensus.cc:2393] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:53.359910  1564 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:53.350083  6045 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:53.361145  6045 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:53.361295  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:53.365247  1568 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:58:53.365620  1568 pending_rounds.cc:85] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 4
I20260709 12:58:53.365865  1568 pending_rounds.cc:107] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:58:53.366093  1568 raft_consensus.cc:2889] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:53.366377  6023 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:53.366757  5823 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:53.366878  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:53.367292  6124 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:53.367746  6124 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.368110  6124 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:53.368408  6023 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:53.368978  5953 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:53.368991  6023 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:53.370103  6037 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:53.370221  6023 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.376031  1567 raft_consensus.cc:1240] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260709 12:58:53.389123  1570 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:58:53.391178  1644 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
W20260709 12:58:53.394882  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52697.7us
W20260709 12:58:53.411648  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.358666  6081 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:53.422386  1569 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:58:53.428866  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:53.436419  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080036a2a0 after lost signal to thread 1745
W20260709 12:58:53.436829  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800385240 after lost signal to thread 1746
I20260709 12:58:53.432331  5990 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:53.452491  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 75974.4us
W20260709 12:58:53.453615  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 96189.3us
I20260709 12:58:53.458019  2312 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:53.462404  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.432910  6113 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.465619  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.505359  1569 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:53.508760  1643 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:53.476531  6061 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:53.518867  2349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:53.519604  2349 raft_consensus.cc:606] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:58:53.525259  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7d60 after lost signal to thread 2373
W20260709 12:58:53.525218  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 72392.6us
I20260709 12:58:53.521656  6117 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:53.504516  6123 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
W20260709 12:58:53.590214  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.513182  6057 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:58:53.598399  6133 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:58:53.599041  6128 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:58:53.601643  6130 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 12:58:53.606639  6132 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:58:53.609722  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.610848  1643 raft_consensus.cc:2393] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 14: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:53.609269  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:53.613708  6127 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:58:53.613778  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:53.614128  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:53.614430  2344 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 15. Current term is 16. Ops: []
W20260709 12:58:53.625541  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 98702.8us
I20260709 12:58:53.613135  1715 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:53.631374  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.529042  6045 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:53.593256  6117 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:53.637094  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.527815  6126 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.201s
I20260709 12:58:53.641196  6117 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:53.644827  6140 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.645179  1647 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:53.645537  6140 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.646176  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.647383  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.647962  1642 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:53.644865  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:53.650315  6113 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.650641  6037 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:53.651211  6037 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.651793  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.655079  6037 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.528517  6115 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.199s
I20260709 12:58:53.660601  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:53.661471  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:53.662468  6124 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.664048  2346 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:58:53.636466  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:53.672832  1612 connection.cc:256] RPC call timeout handler was delayed by -1.7796774039999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 12:58:53.678968  1612 connection.cc:256] RPC call timeout handler was delayed by -1.7369699499999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 12:58:53.648299  6140 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.664516  6045 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:53.678321  1646 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:53.687440  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:53.689555  1719 raft_consensus.cc:2393] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:53.690150  1644 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:53.688179  1646 raft_consensus.cc:2376] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13. Re-sending same reply.
W20260709 12:58:53.693740  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 184670us
W20260709 12:58:53.679613  1612 connection.cc:256] RPC call timeout handler was delayed by -1.7171699499999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 12:58:53.695312  1612 connection.cc:256] RPC call timeout handler was delayed by -1.5081573680000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 12:58:53.675778  6029 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.697678  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:53.704814  1646 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:53.705681  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1984072979999496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 12:58:53.706857  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.714766  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:53.715375  1644 raft_consensus.cc:2393] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 9: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:58:53.709352  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0457366619999675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 12:58:53.719264  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.719177  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.721477  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.717276  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.725450  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.725862  1644 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:53.707885  6123 consensus_queue.cc:1243] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:58:53.730430  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.731467  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:53.732920  6057 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.733325  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.733475  6057 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.735656  6057 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.723673  6029 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:53.737556  6090 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:53.738360  6090 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:53.739486  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.740803  6138 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.741559  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.741394  6138 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.742246  1721 raft_consensus.cc:2393] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:53.743450  6138 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.743641  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.744223  1721 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:53.745311  2345 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:58:53.746133  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.675840  6061 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:53.748567  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.751664  5818 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.751868  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.752833  1641 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:58:53.754649  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.755959  1721 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:53.757818  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.758880  1721 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:53.760829  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.764014  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.765306  6115 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:53.765235  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.766342  1721 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:53.765198  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:53.766781  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.775805  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.776537  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:53.778326  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.778898  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:53.779165  1565 raft_consensus.cc:2410] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:53.785080  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.788594  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.790181  1644 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:53.727042  5957 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:58:53.740571  6090 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:53.794265  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:53.795631  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.796442  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.796223  1644 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:53.797343  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 70658us
I20260709 12:58:53.798735  6141 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:53.799186  6141 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:53.799599  6141 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:53.801294  6029 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:53.801707  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:53.802737  6029 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:53.803246  6029 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:53.803401  5818 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:53.785404  6103 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:58:53.787505  5823 consensus_queue.cc:1059] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:58:53.810045  1721 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:53.817320  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:53.818260  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.783908  6115 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.815279  1721 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:53.826455  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:53.832733  1684 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:53.833909  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:53.834545  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:53.834919  6122 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:58:53.835829  6138 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:53.836551  6138 raft_consensus.cc:697] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:53.837754  6138 consensus_queue.cc:237] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.839568  6123 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:53.844149  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:53.845989  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.853322  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.845372  6122 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:53.804270  6029 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.866406  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.883216  1646 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:53.862660  6145 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:58:53.881982  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.885185  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:53.896957  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:53.832477  6150 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:58:53.889439  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:53.904999  1715 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:53.900147  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:53.888780  6011 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:53.913012  6120 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.573s	user 0.003s	sys 0.000s
I20260709 12:58:53.914620  6148 raft_consensus.cc:3055] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:58:53.914848  6121 log.cc:927] Time spent T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.625s	user 0.003s	sys 0.006s
I20260709 12:58:53.915050  6148 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:53.916062  6148 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.917397  6148 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:53.917447  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 602) took 1020 ms. Trace:
I20260709 12:58:53.917964  1712 rpcz_store.cc:276] 0709 12:58:52.896596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.898882 (+  2286us) service_pool.cc:224] Handling call
0709 12:58:52.899247 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.127052 (+227805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.127099 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:53.127617 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.166822 (+ 39205us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:53.166885 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.166971 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.914437 (+747466us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b24000d8bd8. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f4cd9c4 00007f6a3f4cbacb 00007f6a3f686dc9 00007f6a3f686a55 00007f6a3f68609d 00007f6a422b810e 00007f6a422cf88c 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221
0709 12:58:53.917021 (+  2584us) raft_consensus.cc:1685] finished
0709 12:58:53.917040 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.917255 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33441,"raft.queue_time_us":44363,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"spinlock_wait_cycles":24876928,"thread_start_us":203686,"threads_started":2,"wal-append.queue_time_us":127239}
I20260709 12:58:53.921698  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.922390  1641 raft_consensus.cc:2393] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:53.923447  1641 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:53.923900  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.925235  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.916513  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 655) took 1029 ms. Trace:
I20260709 12:58:53.925357  1572 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:53.927223  6045 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:53.927608  6045 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:53.929517  6153 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:58:53.931566  6115 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:53.932085  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:53.931599  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 46101.8us
I20260709 12:58:53.932981  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.933337  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:53.900599  5852 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:53.934904  5852 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:53.935289  5852 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:53.939131  1568 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:53.926338  1639 rpcz_store.cc:276] 0709 12:58:52.887335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.908062 (+ 20727us) service_pool.cc:224] Handling call
0709 12:58:52.934825 (+ 26763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:52.968992 (+ 34167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:52.969034 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:52.969610 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.035546 (+ 65936us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b4800112758. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4765daa1 00007f6a47654b37 00007f6a476549ca 00007f6a4774c26f 00007f6a4774bf37 00007f6a4776055c 00007f6a47760508 00007f6a47760488 00007f6a47760443 00007f6a4775f6ec 00007f6a46689a96
0709 12:58:53.189973 (+154427us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:58:53.239672 (+ 49699us) log.cc:844] Serialized 14 byte log entry
0709 12:58:53.239891 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.239983 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.298509 (+ 58526us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18004439e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:53.864486 (+565977us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:53.896603 (+ 32117us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b18004439e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:53.916292 (+ 19689us) raft_consensus.cc:1685] finished
0709 12:58:53.916316 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.916454 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5060,"prepare.queue_time_us":49962,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":174,"raft.run_cpu_time_us":2971,"raft.run_wall_time_us":69214,"spinlock_wait_cycles":127476608,"thread_start_us":219905,"threads_started":1,"wal-append.queue_time_us":343634}
W20260709 12:58:53.942543  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 57098.7us
I20260709 12:58:53.923398  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:53.945331  1644 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:53.947155  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.948293  1646 raft_consensus.cc:2410] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:53.949118  6122 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:53.951146  6125 consensus_queue.cc:1059] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:58:53.953217  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:53.958488  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:53.957783  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:53.959836  1646 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:53.880025  6147 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 12:58:53.901988  1721 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:53.965369  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:53.967974  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:53.969566  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:53.975001  1647 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:53.959656  6052 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:58:53.984216  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 200423us
I20260709 12:58:53.959836  6122 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:53.988368  1721 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:53.928416  6045 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.989599  6145 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:53.990029  6045 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:53.988435  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:53.968078  6125 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:58:53.953982  6011 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:53.973306  5818 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:53.986370  6052 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:54.004818  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:54.000089  6150 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:54.014775  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 49523.2us
I20260709 12:58:53.998215  6149 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.162s
I20260709 12:58:54.018983  6149 consensus_queue.cc:1243] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 2af567a273d44ca89d2b3b0f7c815bd1 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:54.016602  5818 raft_consensus.cc:697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:54.021857  6090 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:54.021880  5818 consensus_queue.cc:237] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.022462  6090 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.024797  2342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:54.025456  2342 raft_consensus.cc:606] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:54.025764  2342 raft_consensus.cc:614] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:54.026150  1647 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:58:54.026081  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:54.024427  6090 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:54.044837  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:53.992484  1537 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:54.051465  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 59027us
I20260709 12:58:54.024847  6150 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:54.096271  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 43503.5us
I20260709 12:58:54.098335  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:54.032979  6115 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:54.101284  1646 raft_consensus.cc:2468] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:54.104871  1717 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:54.136804  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:54.143239  1717 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:54.097103  6081 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:54.147328  1715 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:58:54.154909  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 221654us
W20260709 12:58:54.155076  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 121033us
I20260709 12:58:54.146325  6058 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:54.159509  2342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:54.160096  2342 raft_consensus.cc:606] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:54.160455  2342 raft_consensus.cc:614] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:54.160790  1718 raft_consensus.cc:3055] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:54.158517  1684 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:54.161154  1718 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:54.158874  1717 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:58:54.161587  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 62081.5us
I20260709 12:58:54.162307  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:54.178396  1720 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:54.153753  6147 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:54.134634  5957 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:58:54.146454  5823 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:58:54.175997  6152 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:58:54.196786  1718 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.197698  5990 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:54.181697  6057 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:54.203378  1684 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:54.216518  6158 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 12:58:54.220669  6176 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:54.221647  5852 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.222916  1646 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:54.224017  5823 raft_consensus.cc:3055] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:54.224371  6122 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:54.224820  2347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:58:54.225419  2347 raft_consensus.cc:606] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:54.225628  1715 raft_consensus.cc:1240] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:54.227290  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 65048.7us
W20260709 12:58:54.234906  6164 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:58:54.176383  6052 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.238190  1642 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:54.238307  6052 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:54.239609  1642 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:58:54.205798  6057 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.240928  6057 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.199194  6150 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.224388  5823 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:54.244863  6122 raft_consensus.cc:2804] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:54.199836  5990 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:54.245623  5823 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.245451  6122 raft_consensus.cc:697] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:54.247985  6139 log.cc:927] Time spent T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.773s	user 0.002s	sys 0.000s
I20260709 12:58:54.247680  6122 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.224041  5852 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:54.251379   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:54.246397  5990 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.255517  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:54.257393  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.253329   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:58:54.266090  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.268286  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:54.289001  6162 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:58:54.296416  2341 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:58:54.297226  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.298207  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:54.298118  6173 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:58:54.299495  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:54.299675  6141 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.282545  5852 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:54.300765  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 85542.6us
I20260709 12:58:54.280121  6170 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:54.298503  5762 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.300252  6029 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:54.284759  6058 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:54.363116  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.304309  6170 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:54.313959  6081 raft_consensus.cc:697] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:54.374838  1721 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:58:54.375236  1721 pending_rounds.cc:85] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 8
I20260709 12:58:54.378469  1721 pending_rounds.cc:107] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:58:54.378734  1721 raft_consensus.cc:2889] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:54.378955  1686 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:54.386816  6081 consensus_queue.cc:237] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.391592  6124 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:54.392715  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.396513  1567 raft_consensus.cc:3055] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:58:54.397185  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 97753.4us
I20260709 12:58:54.396879  1567 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:54.343288  6057 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.403134  1567 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.410320  1567 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:54.403741  6178 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:54.406448  6113 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:58:54.408735  6115 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:54.432184  1568 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:58:54.497165  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 297638us
I20260709 12:58:54.615963  5823 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.488945  6178 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:54.490236  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 74810us
W20260709 12:58:54.520022  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.426471  6173 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:54.476296  6117 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.492363  6170 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.398723  6058 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:58:54.508984  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:54.474442  6148 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:54.518136  1567 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:58:54.636796  1567 pending_rounds.cc:85] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 10
I20260709 12:58:54.631960  1535 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:54.637051  1567 pending_rounds.cc:107] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:58:54.637480  1567 raft_consensus.cc:2889] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:54.643020  6182 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:58:54.654577  6170 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:54.660406  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 151507us
I20260709 12:58:54.642990  6029 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:54.633808  6117 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.643497  6141 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:54.654009  6066 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:54.684792  1686 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:54.664779  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:54.687772  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:58:54.690340  6187 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:58:54.647392  6148 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.695170  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:54.701356  1716 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:58:54.698616  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:54.704807  1717 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:54.691566  6058 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:54.686892  6057 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:54.656358  6126 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:58:54.663972  6029 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:54.701574  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.708307  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:54.697093  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:54.709110  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:54.712877  6158 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:54.712992  6179 consensus_queue.cc:1059] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:58:54.713970  6178 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:54.708983  6066 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.714782  6066 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:54.715358  6180 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:58:54.716395  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 665) took 1019 ms. Trace:
I20260709 12:58:54.714124  6147 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:54.717756  6147 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:54.716781  1641 rpcz_store.cc:276] 0709 12:58:53.697085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.924200 (+227115us) service_pool.cc:224] Handling call
0709 12:58:53.924476 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.953671 (+ 29195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.953698 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:53.966347 (+ 12649us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.302969 (+336622us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:58:54.303006 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.303068 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:54.716194 (+413126us) raft_consensus.cc:1685] finished
0709 12:58:54.716215 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.716341 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12012,"raft.queue_time_us":4825,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4850,"thread_start_us":301132,"threads_started":1,"wal-append.queue_time_us":417713}
I20260709 12:58:54.718124  6147 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.719602  1565 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:54.714027  6172 raft_consensus.cc:3055] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:54.725677  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:54.704373  6141 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:54.694676  6081 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:54.705247  6058 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.716572  6066 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:54.698508  6189 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.705860  6011 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:54.709846  6029 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.736446  6172 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:54.737617  5823 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:58:54.743933  6058 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:54.742610  6081 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.756042  6081 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:54.754405  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.757932  6137 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 1.283s	user 0.006s	sys 0.000s
I20260709 12:58:54.752965  6189 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.738948  6141 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:54.759761  6141 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:54.740549  6179 consensus_queue.cc:1059] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:58:54.761798  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:54.762135  6189 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:54.762580  6011 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:54.763170  1612 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:54.763231  6011 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:54.764219  6193 raft_consensus.cc:2804] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:54.764603  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.764794  6193 raft_consensus.cc:697] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:54.765321  6011 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.765709  6193 consensus_queue.cc:237] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.766522  6148 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:54.774000  6117 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:54.777041  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:54.753469  6172 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.780402  1717 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
W20260709 12:58:54.785807  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.786703  6166 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:54.786619  6066 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:54.787232  6166 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:54.787647  6166 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.787917  6191 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:58:54.790469  6190 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:58:54.813702  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:54.799814  6149 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:54.812564  5990 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:54.826028  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 82903.5us
I20260709 12:58:54.828604  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:54.832162  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 55185.1us
I20260709 12:58:54.817987  6172 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.833586  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:54.836158  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:54.838199  1717 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:54.819674  6115 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.838991  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:54.821373  6178 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.840127  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:54.840270  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:54.836766  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:54.843472  1566 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:54.844734  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 119128us
I20260709 12:58:54.845371  1535 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:54.846897  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:54.847323  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:54.832448  5823 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:54.848030  1537 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:58:54.856753  6194 log.cc:927] Time spent T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:58:54.859364  6058 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.861953  1566 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:54.863382  6081 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.864252  1569 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:58:54.854947  5823 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.866990  5823 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:54.867514  5823 consensus_queue.cc:1059] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:54.850011  6178 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.869773  6179 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:54.870249  6179 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:54.870560  6178 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:54.870882  6141 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.871119  6179 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.873054  6029 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.873914  6172 raft_consensus.cc:3055] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:54.832325  6149 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.849550  5953 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:54.875746  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:54.876747  1566 raft_consensus.cc:1240] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:54.844424  6115 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.877664  1563 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:54.878757  6081 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:54.884110  1563 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:54.879163  6192 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.879215  6151 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.849649  6011 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:54.875140  6029 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:54.890313  6197 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:54.875444  6172 raft_consensus.cc:740] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:54.890686  6192 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.892565  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:54.880143  6166 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.880997  5953 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.868482  5823 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:58:54.904940  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52767.9us
I20260709 12:58:54.905761  6204 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:54.907188  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:54.908097  6172 consensus_queue.cc:260] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.899053  1563 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.903254  5990 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:54.925765  6118 raft_consensus.cc:993] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:58:54.917845  6204 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:54.926263  6118 raft_consensus.cc:1081] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:58:54.922331  6058 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:54.924278  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:54.927690  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:54.927729  6204 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:54.927853  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:54.928707  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2173) took 1008 ms. Trace:
I20260709 12:58:54.928794  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:54.929009  1570 rpcz_store.cc:276] 0709 12:58:53.919891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.924766 (+  4875us) service_pool.cc:224] Handling call
0709 12:58:54.927725 (+1002959us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:58:54.928616 (+   891us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2841344}
I20260709 12:58:54.929755  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:54.930928  1714 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:54.912523  5953 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.932721  1563 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.921245  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:54.926294  6172 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.923714  6115 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:54.938035  1719 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:54.941838  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:54.944820  1714 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:58:54.948884  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.898106  6151 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.951896  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:54.921197  6011 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:54.955587  1716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:58:54.956278  1716 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:54.956715  1716 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:54.956777  6192 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:54.958207  5823 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:54.958750  5823 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.962301  6197 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.962781  6197 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.920871  6158 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:58:54.956476  6166 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:54.966112  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:54.967674  6113 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:54.951465  6103 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:58:54.968253  6113 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:54.968919  6103 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:54.969295  6103 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:54.969399  6113 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.970186  6103 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:54.970731  6113 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:54.971423  6103 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:54.967805  1719 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:58:55.002460  1719 pending_rounds.cc:85] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 4
W20260709 12:58:54.996690  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44795.9us
I20260709 12:58:55.002969  1719 pending_rounds.cc:107] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:58:55.003342  1719 raft_consensus.cc:2889] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:54.974565  6029 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:54.977480  1715 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:54.952867  6201 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.950044  5990 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:54.946993  6141 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:55.017963  6118 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:55.018545  6118 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:55.019110  6175 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.769s	user 0.002s	sys 0.000s
I20260709 12:58:55.021346  1645 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:55.021749  6118 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:55.021987  6161 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.771s	user 0.000s	sys 0.002s
I20260709 12:58:55.023327  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2106) took 1296 ms. Trace:
I20260709 12:58:55.023687  1647 rpcz_store.cc:276] 0709 12:58:53.726927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.027030 (+300103us) service_pool.cc:224] Handling call
0709 12:58:54.027343 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:54.028315 (+   972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.028342 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.028761 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.144356 (+115595us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:54.144391 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.144450 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.018559 (+874109us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:55.023053 (+  4494us) raft_consensus.cc:1685] finished
0709 12:58:55.023072 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.023273 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":513,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":9733504,"thread_start_us":115257,"threads_started":1,"wal-append.queue_time_us":220646}
I20260709 12:58:54.979925  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:55.025285  1714 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
W20260709 12:58:54.997637  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 55872.1us
I20260709 12:58:55.026266  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:55.026979  6204 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:55.027348  6204 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:55.027719  6204 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:55.029505  6177 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.783s	user 0.003s	sys 0.000s
I20260709 12:58:55.031262  2345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 561) took 1078 ms. Trace:
I20260709 12:58:55.031605  2345 rpcz_store.cc:276] 0709 12:58:53.953060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.959374 (+  6314us) service_pool.cc:224] Handling call
0709 12:58:53.961198 (+  1824us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:53.967343 (+  6145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.967372 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:53.996081 (+ 28709us) log.cc:844] Serialized 52 byte log entry
0709 12:58:54.187108 (+191027us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:58:54.317139 (+130031us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.317371 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.317450 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:54.482632 (+165182us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:55.029070 (+546438us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b24002e49a8. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f4cd9c4 00007f6a3f4cbacb 00007f6a3f686dc9 00007f6a3f686a55 00007f6a3f68609d 00007f6a422b810e 00007f6a422cf88c 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221
0709 12:58:55.031059 (+  1989us) raft_consensus.cc:1685] finished
0709 12:58:55.031079 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.031207 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6439,"prepare.queue_time_us":239114,"prepare.run_cpu_time_us":252,"prepare.run_wall_time_us":8704,"raft.queue_time_us":5981,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":11459,"spinlock_wait_cycles":35492992,"thread_start_us":264189,"threads_started":2,"wal-append.queue_time_us":242292}
I20260709 12:58:55.033843  6141 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:55.034375  6141 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.003611  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:55.006309  1641 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:55.036350  1686 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:55.002715  6011 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.025599  2346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59826 (request call id 558) took 1329 ms. Trace:
I20260709 12:58:55.043740  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.049306  1641 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:55.044111  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:55.037391  1716 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.052852  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:55.053249  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 49750.9us
I20260709 12:58:55.054240  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:55.054580  1714 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:55.037261  2346 rpcz_store.cc:276] 0709 12:58:53.695803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.695933 (+   130us) service_pool.cc:224] Handling call
0709 12:58:53.696248 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:53.727463 (+ 31215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.727484 (+    21us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:53.792512 (+ 65028us) log.cc:844] Serialized 52 byte log entry
0709 12:58:54.089571 (+297059us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:54.089809 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.089877 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.021327 (+931450us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:55.025305 (+  3978us) raft_consensus.cc:1685] finished
0709 12:58:55.025326 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.025525 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2849,"spinlock_wait_cycles":8238976,"thread_start_us":280700,"threads_started":1,"wal-append.queue_time_us":444018}
W20260709 12:58:55.011485  6122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.010s	sys 0.014s
I20260709 12:58:54.949432  6126 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 12:58:55.057760  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.057659  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:55.002199  6115 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:55.053406  1643 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:58:55.036067  6081 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.952571  5957 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:58:55.010785  5823 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:55.010046  5990 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:55.072885  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 224943us
I20260709 12:58:55.052796  6058 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:55.055114  5818 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:55.081060  1612 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:55.061456  6122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.010s	sys 0.015s
I20260709 12:58:55.078804  1537 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:55.082595  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:55.084086  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:55.086802  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.138564  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:55.141528  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2115) took 1311 ms. Trace:
I20260709 12:58:55.078584  5990 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:55.053411  6011 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.057659  6204 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.140815  6117 raft_consensus.cc:993] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:58:55.088083  6193 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:55.146987  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 70981.1us
I20260709 12:58:55.145641  1646 rpcz_store.cc:276] 0709 12:58:53.830612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.102298 (+271686us) service_pool.cc:224] Handling call
0709 12:58:54.102698 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.223260 (+120562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.141211 (+917951us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540020a3d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:55.141454 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276065792}
I20260709 12:58:55.157783  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:55.158401  1646 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:55.069770  6029 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:55.063504  6201 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:55.160920  6156 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 1.090s	user 0.005s	sys 0.000s
I20260709 12:58:55.164441  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:55.080677  6081 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.173535  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:55.192047  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 108014us
I20260709 12:58:55.192476  1535 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:55.178395  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:55.150363  5823 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:55.195113  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:55.154160  6216 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.192854  1641 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:58:55.166245  6117 raft_consensus.cc:1081] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Signalling peer 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:58:55.200443  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:55.202045  1646 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:55.202873  1535 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:55.199517  2346 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:55.163261  6197 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:55.204622  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:55.204144  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:55.197916  1686 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:55.207590  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:55.208897  1646 raft_consensus.cc:3060] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:55.216631  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:55.218221  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:55.219844  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:55.219266  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:55.198874  5818 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:55.222549  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:55.199281  5823 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.221083  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:55.220315  6124 raft_consensus.cc:2804] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:55.242962  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:55.210318  6176 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:55.210054  5957 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.210532  6158 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.223059  6151 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:55.224095  6141 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:55.235664  6147 consensus_meta.cc:287] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.517s	user 0.015s	sys 0.000s
I20260709 12:58:55.254043  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:55.255025  1646 raft_consensus.cc:2468] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:55.235807  5823 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:55.311908  6171 log.cc:927] Time spent T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.962s	user 0.002s	sys 0.003s
I20260709 12:58:55.313908  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:55.262084  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 61725.1us
I20260709 12:58:55.327858  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:55.234154  6029 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.233331  6115 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:55.336632  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 121525us
I20260709 12:58:55.208554  6216 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.316860  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:55.317584  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:55.318965  6212 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:58:55.247076  6124 raft_consensus.cc:697] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:55.247231  6140 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.332883  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.254274  6179 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:58:55.334154  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.356565  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:55.333974  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.336720  1718 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:55.316752  6222 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:58:55.337152  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.368216  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:55.313395  6189 raft_consensus.cc:3055] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:55.368739  1643 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:55.334002  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:55.267113  6220 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:55.346830  6029 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.380847  6220 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:55.346496  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:55.357954   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:55.358896  1640 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
W20260709 12:58:55.359305  6207 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 12:58:55.360006  6214 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:58:55.359915  1642 raft_consensus.cc:1240] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:55.360509  6201 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:55.360953  6140 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.319599  6215 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:55.363862  6124 consensus_queue.cc:237] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.365397  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:55.266136  5957 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:55.366894  6184 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.855s	user 0.002s	sys 0.000s
W20260709 12:58:55.382155  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 48663.2us
I20260709 12:58:55.390987  1641 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:58:55.401880  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.336103  6196 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:58:55.358932  6210 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:58:55.399076  1569 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:55.366798  1718 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:58:55.399652  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 53235us
I20260709 12:58:55.415568  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:55.416021  1535 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:55.333461  6166 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:58:55.419672  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:55.331838  6147 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:58:55.420464  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1999) took 1254 ms. Trace:
I20260709 12:58:55.355465  6115 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.395975  6170 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:55.389443  6189 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:55.424206  1718 rpcz_store.cc:276] 0709 12:58:54.160281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.160409 (+   128us) service_pool.cc:224] Handling call
0709 12:58:54.160682 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:55.291003 (+1130321us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b58006a52d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426900aa 00007f6a42712447 00007f6a4272afe7 00007f6a4272c7de 00007f6a42736b49 00007f6a42737416 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4
0709 12:58:55.414327 (+123324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.414517 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568225024}
I20260709 12:58:55.398641  6215 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.434768  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2104) took 1728 ms. Trace:
W20260709 12:58:55.420921  6037 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:58:55.437551  1569 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:55.435220  1644 rpcz_store.cc:276] 0709 12:58:53.699033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.956491 (+257458us) service_pool.cc:224] Handling call
0709 12:58:53.956820 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:53.985921 (+ 29101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.985953 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:53.994429 (+  8476us) log.cc:844] Serialized 52 byte log entry
0709 12:58:54.140890 (+146461us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:54.160482 (+ 19592us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.160817 (+   335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.160930 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:55.061665 (+900735us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:55.412863 (+351198us) raft_consensus.cc:1685] finished
0709 12:58:55.426986 (+ 14123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:55.427133 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26434,"prepare.queue_time_us":18776,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":28760,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":14435,"spinlock_wait_cycles":9809664,"thread_start_us":122120,"threads_started":1,"wal-append.queue_time_us":246504}
I20260709 12:58:55.326578  6158 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.412854  6204 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:55.448256  1644 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:58:55.448666  1644 pending_rounds.cc:85] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 4
I20260709 12:58:55.448937  1644 pending_rounds.cc:107] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:58:55.449229  1644 raft_consensus.cc:2889] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:55.450205  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.452147  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.453236  1570 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:55.452986  1571 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:58:55.452924  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:55.451116  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:55.426774  6201 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:55.461926  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:55.469976  6115 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:55.457685  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:55.454720  2341 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:58:55.472892  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.434705  6081 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:55.434643  6011 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.434446  6215 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:55.456720  6172 consensus_meta.cc:287] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.000s
I20260709 12:58:55.458246  5762 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.489046  1571 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:55.489086  1563 raft_consensus.cc:2410] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:55.456808  6029 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.459089  6193 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:55.459115  6170 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:55.491671  1610 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:58:55.494357  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 91558.7us
I20260709 12:58:55.504195  1612 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:55.490726  5762 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.506198  1639 raft_consensus.cc:3055] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:55.506587  1639 raft_consensus.cc:740] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:55.507591  5762 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:55.507385  1639 consensus_queue.cc:260] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.508437  1639 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:55.493090  6204 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.492892  6172 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:55.495785  6170 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:55.501327  5953 consensus_meta.cc:287] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.009s
I20260709 12:58:55.522101  1639 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:55.496587  6081 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:58:55.523779  6170 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:55.522579  6232 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:55.536087  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:55.539597  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.540246  1639 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:58:55.528141  6220 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:55.536495  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:55.500398  6189 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.524291  6011 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:58:55.525369  5953 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.541739  6232 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.530566  6029 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:58:55.557024  6230 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:55.557991  6227 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:55.558506  6227 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:55.560227  6113 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.007s
I20260709 12:58:55.533507  6172 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:58:55.529011  6204 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.565356  6209 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:55.557560  6230 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.560456  6227 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:55.569173  1565 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:58:55.540907  6193 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:58:55.574136  6233 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:58:55.575901  6227 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:55.581228  6158 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.582084  6148 raft_consensus.cc:3055] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:55.582973  1716 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.555976  6232 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:55.597743  5953 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:55.598944  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.547186  6201 consensus_queue.cc:1059] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:58:55.566231  6140 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:55.716025  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 150620us
I20260709 12:58:55.572088  6230 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:55.562407  6220 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.159s
W20260709 12:58:55.746786  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 199953us
I20260709 12:58:55.608462  6227 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:55.757972  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:55.759181  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:55.845592  1568 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
W20260709 12:58:55.846148  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 87092.9us
I20260709 12:58:55.846225  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:55.747066  6170 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.768406  6240 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.847781  6240 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.850466  6240 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:55.721057  6148 raft_consensus.cc:740] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:55.845068  1571 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:55.751350  6011 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.856364  6011 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.856820  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:55.858525  1571 raft_consensus.cc:1240] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: []
W20260709 12:58:55.807848  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.860080  1571 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:58:55.861265  6103 consensus_meta.cc:287] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.850s	user 0.011s	sys 0.004s
I20260709 12:58:55.862665  6193 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.863610  6193 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.783926  6204 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.781270  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:55.870939  1719 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:58:55.852921  6170 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:55.854884  6227 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.869057  1721 raft_consensus.cc:1275] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:58:55.874433  1717 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:55.869395  1567 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
W20260709 12:58:55.864498  5990 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.004s
I20260709 12:58:55.869843  6197 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:55.882995  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:55.883812  1568 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:55.859092  6011 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.890652  6243 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:55.897722  6243 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.900067  6243 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:55.875936  6140 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.883741  5990 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:55.900938  6238 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:58:55.901516  6244 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.902928  5990 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:55.902702  6244 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.903919  1641 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:55.904052  1647 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:55.905963  6193 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.907829  6149 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:55.914423  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.916189  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:55.916970  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 2071) took 1081 ms. Trace:
I20260709 12:58:55.917265  1564 rpcz_store.cc:276] 0709 12:58:54.835913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.836058 (+   145us) service_pool.cc:224] Handling call
0709 12:58:55.916021 (+1079963us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a476fa0a0 00007f6a476f9984 00007f6a40c746d4 00007f6a40c74662
0709 12:58:55.916914 (+   893us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3002240}
I20260709 12:58:55.918262  6215 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.900939  6140 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:55.885325  6197 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.922488  6197 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:58:55.923022  6188 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.285s	user 0.001s	sys 0.002s
I20260709 12:58:55.925719  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2077) took 1078 ms. Trace:
I20260709 12:58:55.926192  1565 rpcz_store.cc:276] 0709 12:58:54.847317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.882292 (+ 34975us) service_pool.cc:224] Handling call
0709 12:58:54.882555 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:55.572743 (+690188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.925408 (+352665us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54001a8454. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:55.925656 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573353728}
W20260709 12:58:55.926798  5823 consensus_meta.cc:287] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 12:58:55.927316  5823 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.930351  1571 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:55.928118  6227 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:55.933100  6215 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.949805  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:55.957222  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:55.951184  6029 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:55.973637  5823 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.974859  6029 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.977751  6029 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.978410  5667 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.979027  5667 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.982211  6232 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.983394  5957 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:55.987255  5957 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.987680  5957 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:55.989369  1563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:53576
I20260709 12:58:55.989956  1563 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:55.992722  1563 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:55.999631  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:56.000201  1565 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:56.001432  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:56.004268  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.950307  6148 consensus_queue.cc:260] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.015352  1563 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.016435  1564 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:56.019129  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:56.006953  6243 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:56.000577  6029 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:56.034691  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:56.013295  6126 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.051892  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:56.053726  1639 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:56.054412  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:56.064698  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:56.068285  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:56.047644  5823 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.044152  6246 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:56.047926  6249 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.050881  6232 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:56.160665  6245 log.cc:927] Time spent T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:58:56.187698  6179 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:56.144721  6185 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 1.537s	user 0.000s	sys 0.003s
I20260709 12:58:56.050369  6250 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:56.163662  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53576 (request call id 722) took 1127 ms. Trace:
I20260709 12:58:56.219976  1570 rpcz_store.cc:276] 0709 12:58:55.036534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.037180 (+   646us) service_pool.cc:224] Handling call
0709 12:58:56.163397 (+1126217us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400165dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:56.163586 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876884224}
W20260709 12:58:56.066572  6242 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:58:56.188299  1639 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
W20260709 12:58:56.197621  6247 log.cc:927] Time spent T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:58:56.164913  1569 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:58:56.051033  6029 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:56.124596  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.132683  2348 raft_consensus.cc:2955] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 3 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:56.193058  6103 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.065147  6230 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.073755  6243 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:56.052979  6126 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.065330  6193 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:56.145587  6236 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.386s	user 0.002s	sys 0.000s
I20260709 12:58:56.123996  6244 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.077045  5823 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:56.197142  6254 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:58:56.197811  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:58:56.212621  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 144423us
W20260709 12:58:56.157032  6253 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:58:56.215075  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 188404us
I20260709 12:58:56.222784  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.252635  1643 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:58:56.124804  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:56.077872  5667 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.236481  6138 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:56.257011  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.257301  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.241580  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 624) took 1383 ms. Trace:
I20260709 12:58:56.257011  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.188489  6248 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:56.245473  6150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.000s	user 0.001s	sys 0.026s
I20260709 12:58:56.239641  6197 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.254061  1644 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:56.255460  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:56.224041  6179 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.257877  1720 rpcz_store.cc:276] 0709 12:58:54.858416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.860800 (+  2384us) service_pool.cc:224] Handling call
0709 12:58:54.861072 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.896982 (+ 35910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.897028 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:54.897080 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:54.897125 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.241297 (+1344172us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54002ddf54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:56.241358 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:56.241509 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82061696}
I20260709 12:58:56.275353  2312 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:56.265233  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:56.293839  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.294538  2348 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:58:56.244385  6103 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:56.263298  6150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.017s	user 0.002s	sys 0.026s
W20260709 12:58:56.262691  6134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.650s	user 0.021s	sys 0.005s
I20260709 12:58:56.266006  6232 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:56.257189  6173 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:58:56.275540  6248 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:56.309023  1712 raft_consensus.cc:1240] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:56.256122  6227 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:58:56.294968  6252 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.295207  6172 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:56.261660  6244 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:58:56.296746  5990 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.335384  6248 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.340318  6250 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:56.308204  6134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.696s	user 0.024s	sys 0.015s
I20260709 12:58:56.293861  5957 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.302114  6241 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:58:56.325647  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2070) took 1478 ms. Trace:
I20260709 12:58:56.263479  6243 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:58:56.327113  6036 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:58:56.328691  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.274956  6246 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:58:56.352128  6216 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:56.355149  6235 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.607s	user 0.003s	sys 0.000s
I20260709 12:58:56.343243  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:56.263723  6138 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.344575  1565 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:56.312510  6224 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.347690  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1995) took 2179 ms. Trace:
I20260709 12:58:56.362761  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 2029) took 1212 ms. Trace:
I20260709 12:58:56.350085  1568 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:58:56.363549  6179 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.363992  6252 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:56.363898  6224 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.364560  5823 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.350385  6172 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.361404  6243 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:56.365547  6029 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.366667  6172 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.369645  6197 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.371377  6140 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:56.372089  6230 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.372339  6140 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.372925  6140 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.373373  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:56.346132  1572 rpcz_store.cc:276] 0709 12:58:54.834889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.835048 (+   159us) service_pool.cc:224] Handling call
0709 12:58:55.928892 (+1093844us) spinlock_profiling.cc:243] Waited 958 us on lock 0x7b5800000098. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fb71 00007f6a3f60fa22 00007f6a48528c09 00007f6a47682ee0 00007f6a4774c0ab 00007f6a4774c131 00007f6a4770dfc0 00007f6a476f8929 00007f6a476f83d2 00007f6a40c6fbd4
0709 12:58:55.929141 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:55.930368 (+  1227us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:55.930411 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:55.931464 (+  1053us) log.cc:844] Serialized 26 byte log entry
0709 12:58:55.998467 (+ 67003us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:55.998512 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.998576 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:56.308383 (+309807us) raft_consensus.cc:1685] finished
0709 12:58:56.308404 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:56.313083 (+  4679us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1455,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":2856,"spinlock_wait_cycles":2202880,"thread_start_us":64786,"threads_started":1,"wal-append.queue_time_us":116059}
I20260709 12:58:56.364537  6252 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.363282  1646 rpcz_store.cc:276] 0709 12:58:55.150665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.391870 (+241205us) service_pool.cc:224] Handling call
0709 12:58:55.392234 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:55.403856 (+ 11622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:55.403904 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:55.429911 (+ 26007us) log.cc:844] Serialized 52 byte log entry
0709 12:58:55.522500 (+ 92589us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:55.522543 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.522611 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:56.354578 (+831967us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:56.359501 (+  4923us) raft_consensus.cc:1685] finished
0709 12:58:56.359522 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:56.362701 (+  3179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1404,"raft.queue_time_us":8072,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":15944,"spinlock_wait_cycles":2938752,"thread_start_us":51995,"threads_started":1,"wal-append.queue_time_us":108890}
I20260709 12:58:56.377408  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2178) took 1239 ms. Trace:
I20260709 12:58:56.379961  1567 rpcz_store.cc:276] 0709 12:58:55.138110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.138275 (+   165us) service_pool.cc:224] Handling call
0709 12:58:56.377251 (+1238976us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54001860d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:56.377350 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647459200}
I20260709 12:58:56.349448  6260 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:58:56.385303  6209 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.386449  1644 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:56.388829  1646 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:56.389458  1644 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:58:56.386992  6209 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.362509  1713 rpcz_store.cc:276] 0709 12:58:54.146844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.147288 (+   444us) service_pool.cc:224] Handling call
0709 12:58:54.157985 (+ 10697us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:54.179490 (+ 21505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:54.179536 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:54.186678 (+  7142us) log.cc:844] Serialized 52 byte log entry
0709 12:58:54.407877 (+221199us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:54.428719 (+ 20842us) log.cc:844] Serialized 14 byte log entry
0709 12:58:55.035075 (+606356us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b18002498e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:55.427312 (+392237us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b18002498e0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287
0709 12:58:55.555217 (+127905us) log.cc:844] Serialized 14 byte log entry
0709 12:58:55.561282 (+  6065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.561424 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:56.144004 (+582580us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:56.326189 (+182185us) raft_consensus.cc:1685] finished
0709 12:58:56.326209 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:56.326319 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33521,"prepare.queue_time_us":175636,"prepare.run_cpu_time_us":1008,"prepare.run_wall_time_us":21043,"raft.queue_time_us":7348,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":51733,"spinlock_wait_cycles":60899840,"thread_start_us":556672,"threads_started":3,"wal-append.queue_time_us":288961}
I20260709 12:58:56.399732  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:56.372414  6224 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:56.409068  6263 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:58:56.398849  6195 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:56.413015  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.415674  1567 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 16.
I20260709 12:58:56.420053  1563 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.392274  6126 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:56.426079  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.428262  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.429191  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:56.425799  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:56.433399  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.425514  5667 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:58:56.436079  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.437029  1572 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 14: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:56.437291  6140 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:56.411491  6260 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:56.441470  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.442283  1644 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:58:56.414915  6036 consensus_queue.cc:1059] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:58:56.443976  6036 raft_consensus.cc:3055] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:56.444329  6036 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:56.438010  6134 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:56.444878  6134 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.445258  6134 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:56.448130  6147 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.449295  6036 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.450639  6036 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:56.454097  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 2182) took 1308 ms. Trace:
I20260709 12:58:56.454475  1569 rpcz_store.cc:276] 0709 12:58:55.146003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.439138 (+293135us) service_pool.cc:224] Handling call
0709 12:58:56.164417 (+725279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.223913 (+ 59496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.453914 (+230001us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400165dd0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:56.454039 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666460032}
I20260709 12:58:56.471148  1535 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:56.476902  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.438943  6103 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.440963  6260 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.482702  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.484962  6209 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:56.486966  6221 log.cc:927] Time spent T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 1.111s	user 0.003s	sys 0.000s
I20260709 12:58:56.489120  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 2031) took 1334 ms. Trace:
I20260709 12:58:56.489614  1641 rpcz_store.cc:276] 0709 12:58:55.154402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.403785 (+249383us) service_pool.cc:224] Handling call
0709 12:58:55.404063 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:55.904498 (+500435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.488815 (+584317us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54001b58d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:56.489048 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148941056}
I20260709 12:58:56.491183  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:56.493597  6134 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.494514  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:56.495227  1647 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:56.474222  5667 consensus_queue.cc:1059] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:58:56.496691  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:56.496778  5667 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:56.497382  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:56.497750  5667 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:56.497579  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:56.498544  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:56.498904  6140 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:56.499416  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.499473  6140 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:56.500149  6140 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.500350  2349 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 17: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:58:56.500829  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.501348  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.502735  6134 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:56.497390  1564 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:56.498809  5667 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.498817  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:56.504667  5667 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.505081  6260 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:56.505344  5818 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:56.505801  5818 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.507270  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:58:56.496762  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.508539  6209 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:56.508879  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.509406  6209 raft_consensus.cc:3055] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:56.509745  6209 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:56.509959  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.510948  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:56.511466  1640 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:58:56.511762  6123 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:56.512300  6123 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:56.513378  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:56.513196  6123 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.501435  1642 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:56.514547  6193 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.515163  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.515942  6138 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.516458  1646 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:58:56.520087  6220 raft_consensus.cc:2955] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 3 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:56.505081  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:56.479777  6147 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:56.523326  6147 raft_consensus.cc:697] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:56.524205  6147 consensus_queue.cc:237] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.525511  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 1991) took 2437 ms. Trace:
I20260709 12:58:56.525892  1712 rpcz_store.cc:276] 0709 12:58:54.088318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.088555 (+   237us) service_pool.cc:224] Handling call
0709 12:58:54.139246 (+ 50691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.312448 (+2173202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.525283 (+212835us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54001752d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:56.525446 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4984114048}
I20260709 12:58:56.492508  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.538932  6243 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.510588  6209 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.541714  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:58:56.542858  6124 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:56.544872  1567 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:56.549355  6193 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:56.549824  6193 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:56.550457  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:56.545328  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 63316us
I20260709 12:58:56.550614  6027 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:58:56.550696  6193 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.551641  6027 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:56.552002  6027 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:56.540052  5818 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.546599  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2075) took 1700 ms. Trace:
I20260709 12:58:56.552688  1566 rpcz_store.cc:276] 0709 12:58:54.845722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.862573 (+ 16851us) service_pool.cc:224] Handling call
0709 12:58:54.862842 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:54.881237 (+ 18395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.546404 (+1665167us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5400133b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:56.546546 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31399808}
I20260709 12:58:56.552847  6027 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.558213  1647 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:58:56.561533  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.544792  6150 consensus_queue.cc:1059] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:58:56.554841  6124 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.556175  6027 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:56.554593  6011 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:58:56.576323  6224 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:56.569545  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:56.569343  6243 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:56.577158  6201 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:56.577076  6243 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.577685  6201 raft_consensus.cc:697] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:56.578482  6201 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.579156  6243 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.569883  1644 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:56.576887  6224 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.582906  1564 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 17.
I20260709 12:58:56.587728  2346 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:56.584378  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:56.589704  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:56.590446  2342 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:56.570106  2344 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:56.564764  6209 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:56.585327  1535 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:56.613950  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.615114  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:56.615850  1565 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.616786  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.626151  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.601352  5910 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:58:56.627586  5910 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 17 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:56.627750  5818 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.591773  6179 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:58:56.628866  6216 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:56.629402  6216 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:56.630323  6216 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:56.631994  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 46731.9us
I20260709 12:58:56.632383  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.632969  1572 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:56.633394  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:56.634260  5953 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.628510  5910 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.634752  5953 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.635725  6103 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:56.636137  6103 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.595399  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.636932  1568 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:58:56.637751  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.638314  1568 raft_consensus.cc:2468] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:56.639057  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.639575  6215 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:56.639709  1568 raft_consensus.cc:2393] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 15: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:56.640100  6215 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:56.599438  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.641007  6215 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.641791  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.600539  1567 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:56.571390  6124 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:56.633770  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.646462  6224 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.609019  1564 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:56.647976  1563 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:56.648699  5953 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.633713  6140 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.650650  6140 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:56.651151  6140 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:56.651631  6140 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.636479  6103 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:56.655601  6045 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:56.657212  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.658025  1610 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:56.658242  6113 raft_consensus.cc:3055] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:56.658640  6113 raft_consensus.cc:740] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:56.658890  5818 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.659871  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.640492  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:56.662014  6255 raft_consensus.cc:3055] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:56.662410  6255 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:56.663261  6255 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.665724  6189 raft_consensus.cc:3060] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.672952  6140 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.671118  6113 consensus_queue.cc:260] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.680120  6113 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:56.680806  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.678553  1568 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:56.668141  6103 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:56.682696  6260 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.683483  6118 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:56.683295  6103 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:56.689198  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:56.715024  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.689587  6124 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.656132  6045 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.693364  6216 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:56.701171  2342 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:58:56.701239  5818 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:56.708201  6145 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.718498  1686 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:56.592103  1640 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 17.
I20260709 12:58:56.701807  6224 consensus_queue.cc:1048] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:56.706032  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.707096  1565 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:56.664548  6255 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.725020  1610 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:56.713331  6122 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:56.756095  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 211202us
I20260709 12:58:56.760572  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:56.723628  6224 consensus_queue.cc:1243] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:56.727880  6123 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:56.779690  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.780480  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.728706  6243 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:56.717665  6118 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:58:56.788632  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 155286us
I20260709 12:58:56.792737  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:56.793680  1643 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:56.793949  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.798892  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.733870  6122 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:56.802029  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.803534  1571 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:56.804874  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.805547  2346 raft_consensus.cc:2368] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 15. Current term is 16.
W20260709 12:58:56.803454  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.806703  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:56.807308  1638 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:56.728833  6145 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.811385  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.814864  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.811981  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.808573  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:56.816983  6282 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:58:56.818627  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.819046  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:56.819572  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.819679  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:56.826457  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.790267  6052 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:58:56.830372  1641 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:56.800947  6115 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.831663  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.790433  6036 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:58:56.837478  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:56.837594  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:56.836164  1643 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:56.841715  1535 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:56.844485  1638 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
W20260709 12:58:56.846750  6274 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:58:56.796548  6280 consensus_queue.cc:1059] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:58:56.865355  1714 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:56.857399  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:56.859571  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.866825  1563 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:56.867304  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:56.856999  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 131322us
I20260709 12:58:56.789275  6123 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:56.889827  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:56.891264  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:56.892230  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.834574  5953 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:56.896083  1720 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 12:58:56.897430  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:56.901361  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:56.965976  6123 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.964066  6145 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:56.965580  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:56.960961  6260 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:56.830080  6191 consensus_queue.cc:1059] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:58:56.962785  6122 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:56.945151  6281 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:56.960664  6272 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:58:56.956799  6140 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:56.869447  6172 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:56.928959  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:56.977325  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.053572  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:57.054000  1721 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:58:57.054191  1567 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:56.887445  6235 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:58:56.919891  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:56.834237  6278 consensus_queue.cc:1059] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:58:56.962608  6291 raft_consensus.cc:3055] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:58:56.954414  6223 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 1.559s	user 0.000s	sys 0.005s
I20260709 12:58:56.947052  6124 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:57.004129  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 115205us
I20260709 12:58:56.945225  6170 consensus_queue.cc:1059] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 12:58:57.000315  6286 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:58:57.013310  5667 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 12:58:57.016239  6271 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:58:56.967237  6290 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:56.920699  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52515.7us
I20260709 12:58:57.039790  1720 pending_rounds.cc:85] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 4
W20260709 12:58:57.027374  1686 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.505s (SENT) [suppressed 8 similar messages]
I20260709 12:58:57.088555  1720 pending_rounds.cc:107] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 12:58:57.089525  1720 raft_consensus.cc:2889] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:57.049503  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:57.048763  6027 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:57.050576  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.964977  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:57.068780  1535 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:57.057102  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:57.057164  1719 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.019454  6036 consensus_queue.cc:1059] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:58:57.086995  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.095434  1716 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:57.092124  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:57.098129  1643 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:58:57.100697  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.053231  6172 raft_consensus.cc:697] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:57.103086  2312 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:57.053656  6280 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.101356  1720 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:58:57.105160  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:57.111253  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.113427  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.114184  1714 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:58:57.115895  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 88543.5us
I20260709 12:58:57.115677  6280 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.116678  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:57.068192  6291 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:57.118129  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.102473  5667 consensus_queue.cc:1243] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer 2af567a273d44ca89d2b3b0f7c815bd1 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:58:57.119904  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:57.125478  1716 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:57.121553  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:57.126219  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.123211  1571 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:58:57.123207  1718 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:58:57.066061  6140 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.170228  1720 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:57.170478  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.173558  1721 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:57.130946  1567 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 16.
I20260709 12:58:57.120618  6066 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:57.128981  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.180550  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.106658  6027 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.127318  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.184916  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:57.124111  6195 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:57.066100  6281 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:57.178450  6310 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:58:57.193343  6066 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:57.198836  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:57.205924  1720 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:58:57.201217  1715 raft_consensus.cc:2955] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 3 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:58:57.180843  6191 raft_consensus.cc:3055] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:57.210474  6122 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:57.211340  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:57.211642  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.213606  6304 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:57.206573  1721 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 15: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:57.215178  1684 leader_election.cc:400] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 15. Current term is 16.
I20260709 12:58:57.211169  6122 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.215478  1684 leader_election.cc:403] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:57.216804  6304 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:58:57.218092  6122 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:57.190418  6279 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:58:57.207474  6191 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:57.222443  6191 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.223969  6191 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.095721  6290 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.231997  1714 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:57.192222  6195 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:57.127085  6299 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:57.232975  6216 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 12:58:57.289362  1717 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
W20260709 12:58:57.295936  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.295974  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44072.4us
I20260709 12:58:57.303380  1716 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
W20260709 12:58:57.306245  6303 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 12:58:57.309438  6301 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:58:57.309631  6260 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:57.310317  6260 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:57.310868  6298 raft_consensus.cc:3055] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:57.311437  6298 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:57.311244  6260 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.259518  6195 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:57.287544  6284 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:58:57.306288  6027 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:57.293767  6299 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:57.293538  6312 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:58:57.288110  6291 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.345748  6066 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.256572  6172 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.312613  6298 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.408252  1715 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:57.398268  1719 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
W20260709 12:58:57.403214  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 283829us
I20260709 12:58:57.397886  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:57.345141  6178 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:57.411078  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.419404  6280 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:57.428733  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 731) took 1114 ms. Trace:
I20260709 12:58:57.429286  1570 rpcz_store.cc:276] 0709 12:58:56.314511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.314634 (+   123us) service_pool.cc:224] Handling call
0709 12:58:56.329022 (+ 14388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.367310 (+ 38288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.367341 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:56.367381 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:56.367410 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.428410 (+1061000us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b54002be654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:57.428481 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.428663 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87644928}
I20260709 12:58:57.430788  6299 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:57.439319  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.429473  6311 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.083s	user 0.002s	sys 0.004s
W20260709 12:58:57.450939  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53160.9us
I20260709 12:58:57.453647  2346 raft_consensus.cc:3055] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:57.454093  2346 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:57.454181  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:57.457842  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:57.455114  2346 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.460875  2341 raft_consensus.cc:2393] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 15: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:57.464185  2346 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:57.451395  6298 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:57.469564  6143 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:57.470692  6276 consensus_queue.cc:1059] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:58:57.482112  6140 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:57.486447  6277 raft_consensus.cc:3055] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:57.487079  6277 raft_consensus.cc:740] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:58:57.488591  6189 consensus_meta.cc:287] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.822s	user 0.015s	sys 0.001s
I20260709 12:58:57.437729  6178 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.491226  6296 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:57.492062  6178 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:57.472440  6276 raft_consensus.cc:3055] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:57.492015  6296 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.467458  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:57.488294  6277 consensus_queue.cc:260] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.493508  1715 raft_consensus.cc:1240] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:57.519667  2346 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:58:57.521163  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 336340us
I20260709 12:58:57.525467  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:57.526564  2341 raft_consensus.cc:2393] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:58:57.528275  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.462742  6280 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:57.509775  6291 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:57.494817  6252 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:57.495905  6315 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:57.520533  6276 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:57.462050  6122 consensus_queue.cc:1059] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:58:57.548822  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:57.562917  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.548380  6277 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:57.564116  6264 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:58:57.566254  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:57.586386  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 683) took 1198 ms. Trace:
I20260709 12:58:57.586934  1644 rpcz_store.cc:276] 0709 12:58:56.388134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.480062 (+ 91928us) service_pool.cc:224] Handling call
0709 12:58:56.559764 (+ 79702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.581174 (+ 21410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.586134 (+1004960us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b54001b4ed0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:57.586307 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10171264}
I20260709 12:58:57.590718  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.591566  1718 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:58:57.594393  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.599200  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.603535  1572 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:57.606561  1566 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:58:57.594990  6280 raft_consensus.cc:3055] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:57.619444  6280 raft_consensus.cc:740] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:57.620361  6280 consensus_queue.cc:260] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.620749  6045 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:57.621668  6280 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:57.573698  6315 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.624668  6315 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:57.630448  6304 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 15. Current term is 16.
I20260709 12:58:57.633777  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:57.617988  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:57.605549  6255 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.877s	user 0.011s	sys 0.003s
I20260709 12:58:57.639276  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:57.640091  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:57.641091  1720 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:58:57.651089  2342 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
W20260709 12:58:57.657866  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.659042  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.660311  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.653702  6304 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:57.673846  6195 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.674031  6304 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.675400  2346 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:57.679184  6051 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:58:57.661233  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.610250  6276 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:57.688079  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.684612  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:57.690310  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 681) took 1429 ms. Trace:
I20260709 12:58:57.715528  1639 rpcz_store.cc:276] 0709 12:58:56.261145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.396117 (+134972us) service_pool.cc:224] Handling call
0709 12:58:56.405484 (+  9367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.405691 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:58:56.547997 (+142306us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.689960 (+1141963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.690016 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:58:57.690067 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.690141 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.690255 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":903262,"prepare.queue_time_us":5893,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":906749,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":374608,"threads_started":2,"wal-append.queue_time_us":272449}
I20260709 12:58:57.700274  1720 raft_consensus.cc:1240] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:58:57.701812  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:57.685575  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:57.728230  1537 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:57.731794  1537 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:57.759136  1537 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:57.695701  6276 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.690588  6249 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:57.698311  5990 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:57.688609  6011 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:57.687326  6225 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:58:57.795222  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.689811  6243 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:57.689719  6193 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:57.831882  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:57.801100  1712 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 16.
I20260709 12:58:57.725973  6317 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:57.803683  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 118208us
I20260709 12:58:57.838701  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:57.796685  6045 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.738287  6201 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:57.737970  6172 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:57.851082  1639 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:57.799214  6268 raft_consensus.cc:3055] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:57.823370  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 64459.6us
W20260709 12:58:57.823936  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.767422  6066 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:57.821806  6224 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.738096  5667 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:57.847136  1645 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:58:57.847157  1612 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:57.798828  6036 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:57.782763  6266 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:57.800966  5957 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.820096  1713 raft_consensus.cc:1240] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:57.824133  6250 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:57.855695  1537 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:57.830017  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.864867  6148 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.851826  6045 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.845048  6170 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:57.829857  6248 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:57.818295  5990 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.889783  6250 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:57.882146  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:57.853377  6268 raft_consensus.cc:740] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:57.828462  6225 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.889990  1640 raft_consensus.cc:1275] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:57.823868  6011 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.909162  6243 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.873526  6224 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.911131  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:57.886250  6266 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.848560  6220 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.849431  6193 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.914633  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:57.873275  5667 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:58:57.921878  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.950459  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.951272  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.951555  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.932529  6250 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:57.895167  6304 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:57.933938  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:57.931355  6170 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.940742  6268 consensus_queue.cc:260] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.889653  5957 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.881726  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:57.851364  6317 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.954483  6298 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:57.949312  6266 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:57.955617  6118 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:57.948596  6193 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:57.957106  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:57.994182  1641 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:58:57.957252  6290 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:57.949549  5667 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.952527  6220 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:57.959239  6011 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:57.960881  6225 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:57.961710  6296 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:57.966059  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.970010  5990 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:57.980060  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:57.980592  1719 raft_consensus.cc:1217] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.3->[7.4-12.6]   Dedup: 7.4->[10.5-12.6]
I20260709 12:58:58.010119  1719 pending_rounds.cc:85] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 4
I20260709 12:58:58.010541  1719 pending_rounds.cc:107] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 12:58:58.010828  1719 raft_consensus.cc:2889] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:57.983492  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.011948  1645 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:57.928563  6248 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.988999  6266 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:57.990589  6317 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:57.991233  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.953955  6195 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.014057  6011 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:58:58.023154  1638 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:58:57.953878  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 98289.9us
W20260709 12:58:58.008718  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.013583  1640 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:57.982333  6170 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:57.259912   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:58.018303  6220 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:58.019044  6224 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.027427  1684 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:58.032451  1537 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.034767  6045 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:58.035252  6224 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:58.035735  6224 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.036213  5957 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:58.036816  6304 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.038239  6248 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.029982  6057 consensus_queue.cc:1048] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:58:58.040346  6225 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:58.022392  6266 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.047864  6170 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.047752  6266 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.050074  6266 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.052234  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 2060) took 1260 ms. Trace:
I20260709 12:58:58.052798  1647 rpcz_store.cc:276] 0709 12:58:56.791636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.791771 (+   135us) service_pool.cc:224] Handling call
0709 12:58:56.792027 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.792215 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:56.801317 (+  9102us) log.cc:844] Serialized 14 byte log entry
0709 12:58:58.051550 (+1250233us) log.cc:844] Serialized 14 byte log entry
0709 12:58:58.051880 (+   330us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:58.051940 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:58.051981 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.052037 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.052137 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":891160,"prepare.queue_time_us":9172,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":897510,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":332947,"threads_started":1}
I20260709 12:58:57.996310  6268 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:58.063513  1537 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:58.063918  2342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59826 (request call id 565) took 1295 ms (client timeout 1694 ms). Trace:
I20260709 12:58:58.064225  2341 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:58:58.064338  2342 rpcz_store.cc:269] 0709 12:58:56.760071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.760266 (+   195us) service_pool.cc:224] Handling call
0709 12:58:58.055277 (+1295011us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54005e01d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:58.055392 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2023740672}
I20260709 12:58:58.003772  6255 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:58:58.069821  1684 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:58.069839  1537 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:58.074400  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46160 (request call id 2353) took 1179 ms. Trace:
W20260709 12:58:58.065662  6291 consensus_meta.cc:287] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.008s
I20260709 12:58:58.073693  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:58.075316  1717 rpcz_store.cc:276] 0709 12:58:56.888536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.888680 (+   144us) service_pool.cc:224] Handling call
0709 12:58:58.068004 (+1179324us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000ee7d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:58.068099 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542132992}
I20260709 12:58:58.064975  6103 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:58.077188  6319 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:58.071231  5957 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:58.081908  5762 consensus_queue.cc:1059] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:58:58.087244  5762 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:58.087666  5762 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:58.080535  6045 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:58:58.077631  6225 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:58.092433  6281 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:58.092576  6224 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.084935  5957 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.097767  6225 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:58.122184  6281 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:58.124533  6225 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:58.123091  5957 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:58.109068  5762 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.184809  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:58.185127  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.187373  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.188246  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:58.206437  1684 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:58.205533  1647 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:58:58.074579  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.214248  1716 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:58:58.216522  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.221904  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:58.222059  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 147538us
W20260709 12:58:58.189320  6277 consensus_meta.cc:287] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.007s
I20260709 12:58:58.222963  1537 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.223645  6298 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.224411  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:58.192755  6297 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.224918  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:58.225224  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.225878  1566 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:58:58.229156  1537 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.234002  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:58.218484  6276 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:58.235754  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 690) took 1367 ms. Trace:
I20260709 12:58:58.218567  6045 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:58.221762  6249 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.240120  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:58.242866  2342 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:58.184684  5818 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.195982  5667 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.239051  6276 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:58.267612  5762 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:58.267557  6264 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:58:58.237816  6297 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.272881  6103 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.273418  6103 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.274132  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:58.275447  6103 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.231014  6296 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.267644  6276 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:58.234485  6189 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:58.283754  6189 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:58.239560  6045 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.284394  6045 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:58.241219  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.236169  1646 rpcz_store.cc:276] 0709 12:58:56.868188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.868335 (+   147us) service_pool.cc:224] Handling call
0709 12:58:56.868574 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.700778 (+832204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.700846 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.762180 (+ 61334us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.977325 (+215145us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:58.234719 (+257394us) log.cc:844] Serialized 14 byte log entry
0709 12:58:58.235432 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.235504 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.235544 (+    40us) raft_consensus.cc:1685] finished
0709 12:58:58.235558 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.235689 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":895064,"prepare.queue_time_us":161794,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":832684,"raft.run_cpu_time_us":478,"raft.run_wall_time_us":16725,"thread_start_us":409835,"threads_started":2,"wal-append.queue_time_us":284779}
I20260709 12:58:58.288434  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.290036  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.290709  1646 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:58:58.291668  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.233763  6148 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.245623  1537 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.235373  6224 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.234225  6317 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:58:58.293107  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 399169us
I20260709 12:58:58.296736  1717 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 16.
I20260709 12:58:58.241766  6334 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.261941  6298 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:58.306674  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:58.300923  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 55381.9us
I20260709 12:58:58.308363  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:58:58.322396  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.238023  6172 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:58:58.293349  6277 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:58.304008  6197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.005s	sys 0.023s
I20260709 12:58:58.336971  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:58.338124  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:58:58.339781  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.345844  1569 raft_consensus.cc:1240] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:58.304949  6066 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:58.303532  6243 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:58.265870  5818 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.260434  6249 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.349025  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:58.364275  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.350616  1569 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:58.338913  6197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.005s	sys 0.023s
I20260709 12:58:58.361774  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:58.368198  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:58.368992  1713 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:58:58.372025  1713 pending_rounds.cc:85] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 6
I20260709 12:58:58.372123  1718 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:58.372586  1713 pending_rounds.cc:107] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:58:58.372958  1713 raft_consensus.cc:2889] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:58.372025  1715 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:58.333033  6103 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:58.348500  6262 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.017s	sys 0.025s
I20260709 12:58:58.368852  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.352056  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:58.367748  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.388058  1720 raft_consensus.cc:1240] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:58.392215  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.301925  6148 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.390395  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.347492  6298 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:58.306818  6224 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.398082  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.346108  6170 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.400203  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:58.399485  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 52188.9us
I20260709 12:58:58.401798  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:58.401885  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:58.402433  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:58.394948  6262 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.018s	sys 0.026s
I20260709 12:58:58.344892  6277 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.335518  6201 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:58:58.317373  6334 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.410888  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.352540  6189 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.412743  6224 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.412794  6148 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.413066  6249 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.371567  6243 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.404565  6298 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.415117  1716 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:58.402459  1713 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:58:58.427187  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.454185  1638 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:58.427367  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.439960  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.447036  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:58.399735  6066 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:58.455973  1569 raft_consensus.cc:2376] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13. Re-sending same reply.
I20260709 12:58:58.462399  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.470791  1639 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:58.473578  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.474222  1638 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:58.439258  6281 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:58.478556  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.490434  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.493947  1715 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:58.496776  1718 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:58.414376  6170 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:58.520565  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 246475us
W20260709 12:58:58.521288  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.521807  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.513743  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:58.522476  1569 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:58:58.530750  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:58.489909  6341 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:58:58.534864  1569 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:58.534945  1641 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:58.544489  1641 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:58.546986  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.549253  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.549892  1571 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
W20260709 12:58:58.550907  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 149092us
I20260709 12:58:58.469534  6316 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:58:58.552286  1641 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:58:58.554214  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:58:58.555939  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.557837  6298 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:58.559253  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.560287  1641 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:58.560465  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.561920  1566 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:58.569351  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:58:58.570922  6346 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:58:58.573021  6336 log.cc:927] Time spent T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:58:58.473436  6066 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.477325  6250 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:58.581211  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 177751us
I20260709 12:58:58.583796  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.589504  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:58.526407  6281 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.534323  6197 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:58.576193  6148 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.575712  6335 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.615322  1564 raft_consensus.cc:2410] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:58:58.619529  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.621424  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.624724  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 686) took 2181 ms. Trace:
I20260709 12:58:58.624933  1570 raft_consensus.cc:2393] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:58.595463  6172 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:58.579074  5957 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.619432  6193 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:58.678272  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.595592  6103 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:58:58.682762  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:58.683581  1718 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:58.682789  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.612622  6201 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:58:58.687141  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.688443  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:58.629593  6172 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.695161  1686 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:58.696297  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.625254  1642 rpcz_store.cc:276] 0709 12:58:56.438002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.516023 (+ 78021us) service_pool.cc:224] Handling call
0709 12:58:56.516335 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.516727 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:58:56.517037 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 12:58:56.728883 (+211846us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.679014 (+950131us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b1800014aa0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f5c1c0a 00007f6a48d01219 00007f6a3f649a40 00007f6a3f6444e4 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287 00007f6a4274f208
0709 12:58:58.072954 (+393940us) log.cc:844] Serialized 14 byte log entry
0709 12:58:58.362015 (+289061us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:58.362485 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:58:58.362604 (+   119us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:58:58.363156 (+   552us) log.cc:844] Serialized 14 byte log entry
0709 12:58:58.618813 (+255657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.618917 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.618959 (+    42us) raft_consensus.cc:1685] finished
0709 12:58:58.618974 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.619121 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1071182,"prepare.queue_time_us":466239,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":156,"raft.queue_time_us":1180656,"raft.run_cpu_time_us":848,"raft.run_wall_time_us":41655,"spinlock_wait_cycles":84501760,"thread_start_us":1038772,"threads_started":4,"wal-append.queue_time_us":643541,"wal-append.run_cpu_time_us":1708,"wal-append.run_wall_time_us":1062420}
I20260709 12:58:58.693151  1563 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:58.616030  6197 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.619204  6148 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.700254  1686 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.741250  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.698244  6172 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:58.715348  6319 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:58.708781  6037 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:58.686769  6226 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:58:58.692719  6350 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:58:58.753731  6291 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:58.741659  6224 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:58.738869  6358 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.754705  6224 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.756884  6356 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:58.757298  6356 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:58.758137  6356 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.759080  6297 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.759505  6356 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:58.761353  6347 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:58:58.762826  6225 consensus_meta.cc:287] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.000s
I20260709 12:58:58.763303  6225 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.764479  1565 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:58.766943  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.767766  1565 raft_consensus.cc:2410] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:58:58.768673  6319 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.769373  1563 pending_rounds.cc:85] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 6
I20260709 12:58:58.787513  1563 pending_rounds.cc:107] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:58:58.787858  1563 raft_consensus.cc:2889] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:58.772361  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:58:58.779587  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 165188us
W20260709 12:58:58.790899  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.791385  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.788203  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:58.789949  1570 raft_consensus.cc:2376] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11. Re-sending same reply.
I20260709 12:58:58.748370  6266 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:58.763262  6354 log.cc:927] Time spent T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:58:58.794661  6224 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.793377  6250 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.793262  6045 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.799886  6255 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:58.800405  6255 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.800894  6255 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:58.801259  6320 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 1.163s	user 0.006s	sys 0.000s
I20260709 12:58:58.801607  6045 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:58.750041  6334 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.802444  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 2199) took 1944 ms. Trace:
I20260709 12:58:58.802809  1568 rpcz_store.cc:276] 0709 12:58:56.858529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.858689 (+   160us) service_pool.cc:224] Handling call
0709 12:58:56.893439 (+ 34750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.101173 (+207734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.101204 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.114277 (+ 13073us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.532390 (+418113us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:57.532444 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.532536 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.800672 (+1268136us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:58.802133 (+  1461us) raft_consensus.cc:1685] finished
0709 12:58:58.802151 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.802377 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27223,"raft.queue_time_us":52290,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":5678,"spinlock_wait_cycles":30974848,"thread_start_us":509558,"threads_started":2,"wal-append.queue_time_us":446081}
I20260709 12:58:58.747433  6243 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:58.813398  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 247101us
I20260709 12:58:58.858417  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.859061  1647 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:58.859408  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:58:58.860275  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 160101us
I20260709 12:58:58.861732  1686 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:58.863327  1686 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.866621  1647 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:58:58.845407  6170 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.869840  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:58:58.870779  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 184767us
I20260709 12:58:58.872979  1647 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:58.795470  6319 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.874858  5957 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.875907  6319 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:58.874094  6051 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.876749  6051 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.877377  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.879999  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:58.880772  1537 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.851969  5762 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:58.885444  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2147) took 1021 ms. Trace:
I20260709 12:58:58.883888  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:58.886910  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:58.885841  1644 rpcz_store.cc:276] 0709 12:58:57.863838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.871125 (+  7287us) service_pool.cc:224] Handling call
0709 12:58:57.890936 (+ 19811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:58.037010 (+146074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:58.037041 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:58.037080 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:58.037114 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.885218 (+848104us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540040ced4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:58.885261 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.885376 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335516416}
I20260709 12:58:58.814653  6266 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.884764  1537 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.857697  6243 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.889508  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:58:58.884517  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.891528  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:58.899132  1686 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:58.869222  6045 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:58.888679  6170 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:58.886399  6367 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:58.896624  6334 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:58:58.953176  6371 log.cc:927] Time spent T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.097s	user 0.003s	sys 0.000s
W20260709 12:58:58.913231  6355 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:58:58.958400  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 67047.4us
I20260709 12:58:58.910327  1537 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.959106  2341 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:58:58.959779  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 49550.3us
I20260709 12:58:58.960492  1537 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.961443  6250 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:58.962258  6297 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.962385  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.963227  6298 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:58.964124  6380 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:58.918277  6148 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.868983  6363 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:58:58.918711  6243 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.959151  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:58.967834  6248 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:58.921653  6281 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:58.927253  6225 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:58.928784  6277 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:58.929299  6266 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.968505  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:58:58.968807  6363 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:58.969359  6363 raft_consensus.cc:697] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:58.969666  6266 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:58.970058  6266 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:58.970444  6266 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:58.970255  6363 consensus_queue.cc:237] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.972754  6148 consensus_queue.cc:1059] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:58.972904  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.973734  1569 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:58.973623  6334 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:58.973937  6298 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:58.974166  1572 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:58.930948  6255 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:58.935690  5667 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.937937  6115 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:58.978578  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.940415  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.940579  5762 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:58:58.942327  6276 consensus_meta.cc:287] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 12:58:58.896546  6189 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:58:58.895352  5957 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:58.912802  6201 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:58.943997  6370 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:58.967902  6243 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:58.919705  6197 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.980140  6115 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:58.975785  1568 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:58:58.995446  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.995996  1568 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:58:58.975780  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:58.976171  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.977267  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:58.997192  1569 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 13: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:58.954342  6172 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.940131  6319 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:58.953712  6170 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.980682  1537 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.981230  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:58.988500  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:59.017324  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:59.017620  1565 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:58.975875  6248 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:58:58.984616  6226 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:58:58.974344  6298 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:59.018548  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:59.019315  1570 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:58:58.985076  6277 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.989820  6201 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.002625  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.026665  1572 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:58.986780  5957 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.999454  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:59.022485  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 128133us
W20260709 12:58:59.024138  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 43547.2us
I20260709 12:58:59.023114  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:58.994474  6051 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:58.999420  6297 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:58.974628  6334 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:58.985785  6276 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.046273  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.045019  1537 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:58.985591  5762 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:59.022238  6170 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:59.050973  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:59.149094  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 89808.2us
W20260709 12:58:59.206594  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 160387us
I20260709 12:58:59.207677  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.028028  6201 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:59.072280  6281 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.141963  6066 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:59.081930  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 60871.1us
I20260709 12:58:59.067576  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:58:59.143503  6348 log.cc:927] Time spent T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.530s	user 0.000s	sys 0.001s
I20260709 12:58:59.133659  6255 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:59.118925  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:59.050969  6319 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:58:59.122071  6382 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:58:59.136240  6383 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:58:59.234936  6115 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.242624  6392 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:59.246214  5762 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:58:59.123126  6381 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:58:59.132634  6248 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.128172  6276 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:59.069830  6378 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:59.042415  5957 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:59.028740  6379 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:59.125993  6172 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:58:59.214337  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 185363us
I20260709 12:58:59.222517  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:59.041332  6225 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:58:59.226667  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:59.231050  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.278138  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 653) took 1070 ms. Trace:
I20260709 12:58:59.235205  6291 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:59.225524  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:59.240058  6319 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.283269  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:59.258534  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:59.283856  1719 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.239058  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 706) took 1053 ms. Trace:
I20260709 12:58:59.228714  6277 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:59.256083  6298 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.293041  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:59.296909  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:59.299583  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:59.299881  6045 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:59.300683  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:59.269858  2349 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:59.301218  1720 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:59.237697  6281 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:59.239214  6364 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.380s	user 0.000s	sys 0.001s
I20260709 12:58:59.303520  6281 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:59.303989  6281 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:59.279189  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 52605.8us
I20260709 12:58:59.305078  5818 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.305748  1686 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:59.278596  1717 rpcz_store.cc:276] 0709 12:58:58.207521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.207960 (+   439us) service_pool.cc:224] Handling call
0709 12:58:59.277965 (+1070005us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b5400213c54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:59.278070 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118521088}
I20260709 12:58:59.304428  6281 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.307885  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:59.308190  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:59.234247  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:59.308470  1641 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:59.308946  1718 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:59.309319  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:59.309322  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.239837  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:59.281718  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:59.311247  1716 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:59.228942  5667 consensus_queue.cc:1059] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:58:59.282052  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:59.236861  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:59.285487  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:59.267488  6378 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.284307  1645 rpcz_store.cc:276] 0709 12:58:58.185626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.186157 (+   531us) service_pool.cc:224] Handling call
0709 12:58:58.186436 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:58.186804 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:58.186830 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:58.187269 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:58:58.464422 (+277153us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:58.464475 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.464557 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:59.142832 (+678275us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:59.238745 (+ 95913us) raft_consensus.cc:1685] finished
0709 12:58:59.238782 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:59.239002 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1140,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":8014720,"thread_start_us":276842,"threads_started":1,"wal-append.queue_time_us":365142}
I20260709 12:58:59.288655  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:58:59.310760  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.278577  1646 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:59.317270  1713 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:59.317462  1643 raft_consensus.cc:3060] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:59.318635  1721 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:59.314790  1570 raft_consensus.cc:2368] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13.
I20260709 12:58:59.309932  2346 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:58:59.324194  1686 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.314641  1714 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:58:59.323200  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.283021  6276 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:59.329321  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.330075  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:59.331992  1644 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:59.285759  6319 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:59.336469  1718 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
W20260709 12:58:59.337321  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.308509  6281 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:59.337368  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:59.347023  1572 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:58:59.341060  1640 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:58:59.321287  6378 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:59.354578  1686 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.355271  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:59.316322  6277 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:59.329792  6379 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.358886  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:58:59.336081  6276 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.370155  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:59.386551  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:59.367869  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:59.375785  1719 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:59.329711  5990 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:59.319444  6291 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:58:59.403012  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:59.352353  6045 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:59.408334  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:59.386840  1641 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:58:59.409423  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.410401  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.405652  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:59.321484  5818 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:58:59.397784  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.414631  1645 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.400151  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:59.389580  2346 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:58:59.370548  6255 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:59.413196  1612 leader_election.cc:400] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13.
I20260709 12:58:59.396322  6276 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:59.422204  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:58:59.329439  6266 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.424584  1612 leader_election.cc:403] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:58:59.395782  1646 raft_consensus.cc:2468] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 16.
I20260709 12:58:59.409893  6367 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:59.380332  6243 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:58:59.414418  6361 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:59.433727  1720 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:59.418200  6359 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:59.387885  6193 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:58:59.428175  6045 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:58:59.430579  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 57790.2us
I20260709 12:58:59.426066  6255 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:58:59.405457  5990 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:59.436561  1644 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:58:59.430052  6367 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.432222  6361 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:59.460517  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 106058us
I20260709 12:58:59.465006  1646 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.464865  1686 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.435984  6359 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.458850  1684 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:58:59.448321  6045 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:59.520895  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 56569.7us
I20260709 12:58:59.522692  1686 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.521054  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:58:59.467710  6361 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.462724  6367 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:59.483062  6359 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:59.542713  1646 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
W20260709 12:58:59.548794  6391 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 12:58:59.549047  6394 log.cc:927] Time spent T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 12:58:59.550638  6365 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.691s	user 0.001s	sys 0.001s
W20260709 12:58:59.551213  6393 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:58:59.552242  1643 raft_consensus.cc:2468] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:58:59.485252  5762 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:59.552384  6400 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:59.552634  5990 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:59.552876  5762 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:59.553252  6396 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:58:59.553344  5762 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:59.539708  6320 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:58:59.529542  6045 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.482746  6395 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:59.568512  6395 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.568980  6395 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:59.568876  6255 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:59.573575  6266 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.576138  1720 raft_consensus.cc:1240] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:59.546413  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 141907us
W20260709 12:58:59.547827  6390 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:58:59.597326  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:59.599931  1645 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:58:59.553092  6400 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:58:59.574749  6277 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:58:59.618494  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 95791.8us
I20260709 12:58:59.629907  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 2168) took 1428 ms. Trace:
I20260709 12:58:59.630291  1639 rpcz_store.cc:276] 0709 12:58:58.188233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.294436 (+106203us) service_pool.cc:224] Handling call
0709 12:58:59.616892 (+1322456us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000f82d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:58:59.617016 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375392512}
I20260709 12:58:59.601449  5818 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13.
I20260709 12:58:59.630505  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.608409  6400 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:59.654284  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2094) took 1310 ms. Trace:
I20260709 12:58:59.654822  1567 rpcz_store.cc:276] 0709 12:58:58.343503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.343614 (+   111us) service_pool.cc:224] Handling call
0709 12:58:58.365800 (+ 22186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:58.554261 (+188461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:58.554305 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:58.554367 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:58.554421 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.653985 (+1099564us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400112954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:59.654044 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:59.654192 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3553,"raft.queue_time_us":4086,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":424357248}
I20260709 12:58:59.612774  6404 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:59.635298  6118 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:59.677562  2341 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:58:59.685567  2346 raft_consensus.cc:1240] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:59.620012  6410 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:58:59.633728  6378 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.694149  5957 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.696415  6413 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:59.696955  6413 raft_consensus.cc:697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:58:59.697425  6170 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.698231  5957 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.698766  5957 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.699208  5957 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:58:59.699632  6409 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
I20260709 12:58:59.700136  1568 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:58:59.703197  6201 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.703807  6361 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.680888  6118 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:59.707636  6118 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.709911  6011 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:59.710479  6011 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:59.711623  6395 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.707700  6379 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:59.715042  1537 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.681416  6408 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.716729  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:58:59.718528  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:58:59.716332  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:58:59.745994  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 107733us
W20260709 12:58:59.713665  6398 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 12:58:59.725464  6343 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 1.264s	user 0.003s	sys 0.000s
I20260709 12:58:59.752506  1537 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.699720  6170 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.712579  6011 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:59.719835  5818 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:58:59.766523  1537 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:58:59.769122  1537 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.751884  6193 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:59.770324  6416 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:59.716594  6359 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.759433  6406 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:59.786810  6115 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.751444  6408 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.791467  5762 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.773478  6392 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:59.803258  6225 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:59.784161  5818 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:59.764726  6367 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.818490  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.803871  6406 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:58:59.819655  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.831005  1646 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:58:59.820611  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 68704.7us
I20260709 12:58:59.828433  1645 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:59.818645  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.832365  1643 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:59.807900  5667 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.808097  6416 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.807242  6201 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.840755  1643 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:58:59.834187  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:59.836796  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:58:59.836447  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:58:59.842691  1568 raft_consensus.cc:2368] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15.
I20260709 12:58:59.844590  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:58:59.802492  6410 consensus_queue.cc:1059] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:58:59.846930  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.813566  6392 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:59.851639  1567 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:58:59.856805  6367 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.858208  6421 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.858731  6421 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.861191  6045 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.844502  6225 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:59.864871  6225 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.806077  6115 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.850224  6418 consensus_queue.cc:1059] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:58:59.792883  6413 consensus_queue.cc:237] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.867857  1720 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:59.908447  6201 raft_consensus.cc:3055] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:59.908952  6201 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:59.910089  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:58:59.909838  6201 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.911022  1646 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:58:59.911510  6201 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:59.912300  6392 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.914574  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 2082) took 1031 ms. Trace:
I20260709 12:58:59.915030  1647 rpcz_store.cc:276] 0709 12:58:58.882676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.882791 (+   115us) service_pool.cc:224] Handling call
0709 12:58:58.883070 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:58.979730 (+ 96660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:58.979758 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:58.987590 (+  7832us) log.cc:844] Serialized 26 byte log entry
0709 12:58:59.256043 (+268453us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:59.256081 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.914164 (+658083us) spinlock_profiling.cc:243] Waited 93.4 ms on lock 0x7b5400335c54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:58:59.914222 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:59.914266 (+    44us) raft_consensus.cc:1685] finished
0709 12:58:59.914287 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:59.914510 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2844,"raft.queue_time_us":3853,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7056,"spinlock_wait_cycles":214899712,"thread_start_us":226335,"threads_started":1,"wal-append.queue_time_us":353699}
I20260709 12:58:59.917126  6418 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:59.917966  6359 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.917888  6418 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.919281  6103 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.921291  6197 raft_consensus.cc:3055] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:59.921844  6197 raft_consensus.cc:740] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:58:59.922027  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2167) took 1734 ms. Trace:
I20260709 12:58:59.922343  5818 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:58:59.922991  6197 consensus_queue.cc:260] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:59.919981  6103 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.925637  5762 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:59.876060  6395 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.876432  2344 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:59.848176  6416 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.928929  6103 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.850044  6423 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:58:59.846108  5990 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:58:59.849270  5667 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:59.875221  1645 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
W20260709 12:58:59.886263  6420 log.cc:927] Time spent T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:58:59.894598  6408 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.895785  6378 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.898092  6276 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.899727  6400 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:58:59.833129  6406 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.922494  1638 rpcz_store.cc:276] 0709 12:58:58.187969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.491504 (+303535us) service_pool.cc:224] Handling call
0709 12:58:58.526701 (+ 35197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:58.532936 (+  6235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:58.532966 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:58.579846 (+ 46880us) log.cc:844] Serialized 26 byte log entry
0709 12:58:59.921279 (+1341433us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b1800335860. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f646c02 00007f6a422ce20b 00007f6a422d3d23 00007f6a422d40d1
0709 12:58:59.921466 (+   187us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:59.921515 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.921614 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:59.921669 (+    55us) raft_consensus.cc:1685] finished
0709 12:58:59.921685 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:59.921958 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27953,"raft.queue_time_us":159728,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":5009,"spinlock_wait_cycles":2959232,"thread_start_us":107507,"threads_started":1,"wal-append.queue_time_us":242870}
I20260709 12:58:59.877015  6115 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:58:59.933324  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.934796  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 98068.3us
I20260709 12:58:59.884888  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:58:59.930827  5990 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:58:59.904930  6045 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:58:59.929410  6416 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:58:59.986402  6421 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:00.007866  1564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 2112) took 1644 ms (client timeout 1708 ms). Trace:
W20260709 12:59:00.008538  1564 rpcz_store.cc:269] 0709 12:58:58.363700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.400383 (+ 36683us) service_pool.cc:224] Handling call
0709 12:59:00.007596 (+1607213us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400094054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:00.007768 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366187264}
I20260709 12:58:59.977445  6281 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.014482  1715 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:58:59.992942  6103 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:00.015173  1612 leader_election.cc:400] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15.
I20260709 12:58:59.996136  6197 raft_consensus.cc:3060] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:00.015508  1612 leader_election.cc:403] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:59:00.017196  6408 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:00.017926  6400 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:00.019343  1716 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 14. Current term is 15. Ops: []
W20260709 12:59:00.027900  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 195977us
I20260709 12:59:00.022058  6276 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:00.034698  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:00.036315  5667 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:00.037348  6430 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:59:00.027145  6281 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:00.043641  6281 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:00.044930  6319 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.691s	user 0.005s	sys 0.006s
I20260709 12:59:00.045058  5990 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:00.045360  6319 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.046504  1721 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 15: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:00.048480  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.031456  6359 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:59:00.049130  1645 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:59:00.048947  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.058585  1638 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:00.061120  1684 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:00.061175  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:00.062515  1569 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:59:00.064277  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:00.064446  2312 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:00.066514  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:00.067047  1569 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:00.070302  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:00.070906  1568 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:00.071591  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:00.058280  6291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.014s	sys 0.062s
W20260709 12:59:00.072942  6291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.015s	sys 0.062s
I20260709 12:59:00.072971  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:00.073829  1568 raft_consensus.cc:3060] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:00.078020  6296 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:00.078693  6296 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:00.081110  6423 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:00.081736  6423 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:00.085377  6423 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:00.086874  6296 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:00.088595  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:00.087087  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:00.093277  1568 raft_consensus.cc:2468] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:00.070067  5667 raft_consensus.cc:2804] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:00.105033  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:00.105245  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:00.105499  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:00.105840  1564 raft_consensus.cc:2376] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13. Re-sending same reply.
I20260709 12:59:00.106154  1566 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:00.029371  5818 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15.
I20260709 12:59:00.110734  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:00.108129  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:00.111923  1567 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:59:00.112917  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.114032  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.114570  1646 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:59:00.114600  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.115455  1639 raft_consensus.cc:2393] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:00.117237  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:00.050684  6319 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:00.118378  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:00.119180  1566 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:00.120281  1566 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:00.120769  5667 raft_consensus.cc:697] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:59:00.121171  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 60126.2us
I20260709 12:59:00.122186  1684 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:00.122051  5667 consensus_queue.cc:237] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:00.123663  6401 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.555s	user 0.008s	sys 0.007s
I20260709 12:59:00.125257  6400 raft_consensus.cc:2804] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:00.125926  6400 raft_consensus.cc:697] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:00.109202  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:00.126914  6400 consensus_queue.cc:237] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.129671  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:00.131371  1721 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:00.109635  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.110203  1640 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:00.131699  1714 raft_consensus.cc:1240] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:00.137498  1570 raft_consensus.cc:2393] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:00.137916  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.138478  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.138674  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.070091  6359 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:00.140549  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.138520  1714 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:00.123554  6428 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:00.144057  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.144541  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.145171  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.145290  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.146060  1640 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:00.147310  1719 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:00.145321  1714 raft_consensus.cc:2393] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:00.148590  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.149551  1719 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:00.150573  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:00.151535  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.153002  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.155187  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.155857  1721 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:59:00.144448  6428 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.156989  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.157099  6428 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:00.158854  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.160743  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.162823  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.164582  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:00.165681  1721 raft_consensus.cc:2368] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13.
I20260709 12:59:00.167129  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.167848  1717 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:00.170352  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.131373  6276 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.202045  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.141034  6418 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:00.216310  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:00.141253  6359 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:00.225466  1569 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 15: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:59:00.222909  1686 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.708s (SENT)
I20260709 12:59:00.223906  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.232307  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:00.232824  1717 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:00.253480  1640 raft_consensus.cc:2393] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 15: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:59:00.211966  6364 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.006s
I20260709 12:59:00.234654  5818 consensus_queue.cc:1059] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:00.254061  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:00.253451  1572 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:59:00.264752  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.269924  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.270721  1639 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:59:00.273736  1684 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:00.279663  1639 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:00.284977  6291 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:00.285676  6291 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.286268  6291 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:00.230605  6248 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:59:00.274833  1684 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:00.212477  6276 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:00.291728  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:00.298429  2312 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:00.296983  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:00.315528  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.267000  6045 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:00.288808  6370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.017s	sys 0.027s
W20260709 12:59:00.326474  6370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.017s	sys 0.028s
I20260709 12:59:00.310217  6421 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:00.352198  6421 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.310894  6115 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:59:00.352752  6421 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:00.353070  6115 consensus_queue.cc:1243] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:59:00.354254  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 122023us
I20260709 12:59:00.335239  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.355150  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:00.343369  6350 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:00.327821  5667 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:00.346060  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:00.306631  6434 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:00.356688  1715 raft_consensus.cc:2368] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15.
I20260709 12:59:00.356541  1612 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:00.358888  1717 raft_consensus.cc:2393] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 16: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:59:00.318675  6413 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:00.376132  1719 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:59:00.317376  6428 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.353796  6115 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:00.384745  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58328 (request call id 715) took 1151 ms. Trace:
I20260709 12:59:00.291728  6359 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.357838  5667 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.388176  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:00.398066  5667 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:00.356912  6434 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.398900  6434 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:00.390200  1642 rpcz_store.cc:276] 0709 12:58:59.233149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.233300 (+   151us) service_pool.cc:224] Handling call
0709 12:58:59.240187 (+  6887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:59.256754 (+ 16567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:59.256783 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:59.256820 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:58:59.256849 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.384439 (+1127590us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54002652d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:00.384501 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.384667 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37664128}
I20260709 12:59:00.358583  6350 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:00.359354  6197 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.386224  6011 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:00.391523  6115 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:00.411711  6296 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:00.425809  6359 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:00.403053  6406 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.416000  6197 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:59:00.492417  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 194047us
I20260709 12:59:00.471956  6011 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:00.511984  6361 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:00.517479  6298 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:00.518018  6115 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:00.519237  6397 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.981s	user 0.004s	sys 0.004s
W20260709 12:59:00.529183  6438 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:59:00.495224  6027 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:59:00.557163  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.559036  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:00.477232  6296 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:00.548322  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:00.560325  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 203827us
W20260709 12:59:00.566414  6227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.020s	sys 0.020s
I20260709 12:59:00.605142  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.605974  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:59:00.606019  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 57792.4us
I20260709 12:59:00.607478  1643 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:59:00.608615  1535 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:00.609427  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.609589  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.610802  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:59:00.607046  6227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.021s	sys 0.020s
I20260709 12:59:00.569967  6276 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:00.611960  6443 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:59:00.612383  6408 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:00.612936  6408 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:00.567188  6193 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:00.618325  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.619158  1639 raft_consensus.cc:2410] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:59:00.620182  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:00.621155  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.621982  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.622721  1642 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:59:00.613776  6408 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:00.629367  6447 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 12:59:00.631001  6446 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:59:00.632027  6189 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:00.632593  6189 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:00.633541  6189 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.608777  6066 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:00.607311  6027 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:00.642585  6454 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:00.642769  6027 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:00.643785  6442 log.cc:927] Time spent T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:59:00.645872  6406 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:00.648196  5667 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:00.654338  6197 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:00.656476  2349 raft_consensus.cc:2368] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:59:00.604547  6115 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:00.498765  6350 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.668602  6296 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:00.668175  6225 consensus_queue.cc:1175] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "20c9ad12e0d0435f95be2eda5b653b39" responder_term: 13 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:00.669304  6434 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.670985  5667 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:00.666074  1646 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:00.667470  6428 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:00.673594  1646 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:00.672452  6434 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:00.681977  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:00.690196  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.690974  1643 raft_consensus.cc:2410] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:59:00.694787  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.703830  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.689564  6428 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:00.668602  6291 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:00.730556  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.736238  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 2061) took 1056 ms. Trace:
I20260709 12:59:00.736685  1716 rpcz_store.cc:276] 0709 12:58:59.679518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.679690 (+   172us) service_pool.cc:224] Handling call
0709 12:58:59.680000 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.028214 (+348214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.735982 (+707768us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54002c2ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:00.736165 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779914112}
I20260709 12:59:00.738695  6297 consensus_queue.cc:1059] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:00.740679  6248 raft_consensus.cc:3055] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:00.741086  6248 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:00.741945  6248 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.743028  6248 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:00.746202  1646 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.746701  1565 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:00.751940  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.752545  6291 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:00.712095  6428 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:00.754504  6428 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:00.757953  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.758632  1715 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:59:00.758167  1638 raft_consensus.cc:2410] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:59:00.759728  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:00.760219  1718 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:00.761258  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:00.761768  1718 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:00.744175  6421 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.791263  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:00.796595  6258 raft_consensus.cc:3055] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:00.798951  6258 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:00.790280  6051 consensus_queue.cc:1059] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:59:00.801502  6036 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:00.808074  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:59:00.805120  6403 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.001s	sys 0.010s
W20260709 12:59:00.822192  6403 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.001s	sys 0.010s
I20260709 12:59:00.795995  6418 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:00.805054  6402 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:00.830231  6418 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.838699  6418 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:00.847055  6418 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:00.847659  6418 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:00.848908  6262 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:00.849514  6262 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:00.849960  6262 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:00.850540  6418 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:00.861217  6227 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:59:00.861444  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 255538us
I20260709 12:59:00.861699  6227 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:00.862116  6227 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:00.853353  6172 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:00.853996  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 2058) took 1566 ms. Trace:
I20260709 12:59:00.895915  1713 rpcz_store.cc:276] 0709 12:58:59.287114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.330953 (+ 43839us) service_pool.cc:224] Handling call
0709 12:58:59.347870 (+ 16917us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:59.470920 (+123050us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:59.613662 (+142742us) log.cc:844] Serialized 14 byte log entry
0709 12:59:00.348134 (+734472us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b180027c820. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:59:00.800783 (+452649us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b180027c820. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a422dc4bc 00007f6a3f62a48b 00007f6a48484ab9 00007f6a3f64669b 00007f6a3f64493f 00007f6a3f644455 00007f6a4272c060 00007f6a4273e716 00007f6a4274f287
0709 12:59:00.802907 (+  2124us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:00.803508 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:59:00.803696 (+   188us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:00.803744 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.803840 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:00.853789 (+ 49949us) raft_consensus.cc:1685] finished
0709 12:59:00.853810 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.853935 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9809,"prepare.queue_time_us":260309,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":6499,"raft.queue_time_us":102254,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":21989,"spinlock_wait_cycles":8777856,"thread_start_us":400157,"threads_started":4,"wal-append.queue_time_us":76575}
I20260709 12:59:00.866344  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:00.868124  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.869549  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:00.871627  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.875497  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:00.902016  1647 raft_consensus.cc:3060] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:00.806151  1718 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:59:00.905318  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:00.938072  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.938089  1644 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:00.940536  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.941357  1643 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:00.952025  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 253993us
I20260709 12:59:00.956960  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:00.896062  6277 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:00.946352  6255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.374s	user 0.019s	sys 0.012s
I20260709 12:59:00.973001  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.974262  1645 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:59:00.961812  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 95544.2us
I20260709 12:59:00.976598  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:00.977902  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:00.978314  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:00.910144  6434 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.945181  6291 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:00.988233  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:00.895498  6172 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:59:00.992439  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 184471us
I20260709 12:59:00.943864  6418 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:59:00.967108  6255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.395s	user 0.020s	sys 0.012s
I20260709 12:59:01.005154  1610 leader_election.cc:400] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:59:01.012508  1610 leader_election.cc:403] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:01.000252  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:00.998478  1643 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:01.010358  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:00.986156  6423 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:00.998114  1645 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:00.904752  6389 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:00.960687  6462 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:00.967727  6458 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:00.986466  6298 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:01.018154  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:01.014132  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:01.031873  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.032373  1612 leader_election.cc:400] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13.
I20260709 12:59:01.024960  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:00.993659  5818 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:01.020856  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:00.970659  6339 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:59:01.035930  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:01.027288  1647 raft_consensus.cc:2468] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:59:01.014755  5990 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:01.017088  6066 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:00.994899  6434 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.021497  6421 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:01.084544  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52734.6us
I20260709 12:59:01.026381  6255 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:01.015902  6418 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.025925  6036 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:01.080792  5990 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:01.083264  6457 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:59:01.141170  5990 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:01.141644  6434 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:01.033470  6224 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:01.142258  6224 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:01.098730  6403 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:01.143801  6403 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.145874  6403 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:01.083256  6407 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.146875  6407 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.148923  6407 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.034444  6359 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:01.084013  6250 raft_consensus.cc:2764] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:59:01.088747  6172 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.150748  6172 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:01.151618  5990 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.089241  5667 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:01.103600  1644 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:01.152966  5667 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:01.153394  5667 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:01.153687  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:01.104135  6460 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 12:59:00.991568  6277 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.158111  1645 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:01.159019  6277 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:01.027143  6389 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.160274  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45024 (request call id 2222) took 2115 ms. Trace:
I20260709 12:59:01.081259  6066 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.168710  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:01.171779  1645 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:01.021260  6456 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:01.032178  6298 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.029814  6462 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.174705  6298 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:01.175100  6262 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.160624  1571 rpcz_store.cc:276] 0709 12:58:59.045098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.046843 (+  1745us) service_pool.cc:224] Handling call
0709 12:59:00.010330 (+963487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.051457 (+ 41127us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:00.051677 (+   220us) log.cc:844] Serialized 14 byte log entry
0709 12:59:00.307114 (+255437us) log.cc:844] Serialized 14 byte log entry
0709 12:59:00.307386 (+   272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:00.307431 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:00.307497 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.781865 (+474368us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b18004a6740. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:59:01.104200 (+322335us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b18004a6740. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6152a6 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1
0709 12:59:01.158270 (+ 54070us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b18004a6740. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6152a6 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419
0709 12:59:01.159331 (+  1061us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b5400094054. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:01.159374 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.160104 (+   730us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400094050. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427338ad 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:01.160193 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1455,"prepare.queue_time_us":432,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":9802,"raft.queue_time_us":3165,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":12758,"spinlock_wait_cycles":2238232576,"thread_start_us":254783,"threads_started":1,"wal-append.queue_time_us":427969}
I20260709 12:59:01.037209  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:01.164460  6418 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.213433  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:01.215410  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 178260us
I20260709 12:59:01.216532  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:01.162998  6066 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:01.219395  6389 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.219616  5957 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.219925  6227 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.221011  6036 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.221567  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:01.224221  6458 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:01.225324  6262 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.235582  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.236263  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.236901  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.294950  1715 raft_consensus.cc:2393] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:01.237694  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.295497  1712 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:01.239205  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.239871  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.297150  1721 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 14: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:01.240499  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.244968  2349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:01.298527  2349 raft_consensus.cc:606] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:01.298941  2349 raft_consensus.cc:614] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:01.246397  1684 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:59:01.299770  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53456.7us
I20260709 12:59:01.263252  5990 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.263765  6298 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:01.268791  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.319098  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.269665  6462 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:01.250481  6392 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:01.296604  1720 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:01.293977  1713 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:59:01.300612  1684 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:59:01.382030  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 81525.4us
I20260709 12:59:01.384632  5667 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.390514  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:01.392182  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.392498  1721 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:01.394963  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:01.403584  1713 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:01.316511  1712 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:01.257874  6476 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:01.320349  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.410965  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.374006  1642 raft_consensus.cc:3060] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:01.374469  1638 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
W20260709 12:59:01.291847  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 75427.6us
I20260709 12:59:01.413050  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:01.408910  5667 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:01.409452  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 133495us
I20260709 12:59:01.415632  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.317709  6193 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:01.417054  1712 raft_consensus.cc:2410] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:59:01.418921  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.421075  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.421890  1569 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:01.425879  1564 raft_consensus.cc:2393] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:01.427793  6339 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:01.428406  6291 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:59:01.406912  6462 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.430820  6462 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.432173  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:01.433496  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.434350  1572 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:01.435384  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:01.250870  6456 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:01.438598  6350 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:01.373589  6266 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:01.447633  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:01.372304  6416 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:01.452778  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.458112  1721 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:01.450043  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:01.454172  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:01.458232  1565 raft_consensus.cc:2393] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:01.459244  1564 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:01.456382  1568 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 12:59:01.459810  1568 pending_rounds.cc:85] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 4
I20260709 12:59:01.460068  1568 pending_rounds.cc:107] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 12:59:01.401592  6421 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:01.460310  1568 raft_consensus.cc:2889] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:01.406402  6458 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.465482  1572 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:01.465006  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:01.415920  6403 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:01.402338  6392 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.472885  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.483664  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.489877  1721 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:01.491283  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:59:01.491621  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 66269.8us
I20260709 12:59:01.492894  1712 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:01.466171  6417 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:01.497293  1572 raft_consensus.cc:1240] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:01.472700  6421 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:01.524748  1569 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:01.485852  6359 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.445637  6476 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.491106  6403 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:01.460529  6266 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.526614  1571 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:01.463104  6416 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.483610  6027 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:59:01.472942  6458 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.526683  6417 raft_consensus.cc:697] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:01.564903  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.589059  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.589798  1721 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:01.589993  6416 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.593189  6421 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.595418  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.596042  1720 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:01.596202  1642 raft_consensus.cc:2468] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:59:01.598950  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.599558  1713 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:01.604780  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:59:01.605201  6480 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:59:01.605866  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.606595  1721 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 15: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:01.607650  6403 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.611450  6298 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.612253  6227 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.612910  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.614714  6476 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.615451  1720 raft_consensus.cc:2468] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:59:01.544611  6359 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.623109  6359 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.624495  6417 consensus_queue.cc:237] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:01.628324  1639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.070s	sys 0.085s
I20260709 12:59:01.631074  1713 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 16.
I20260709 12:59:01.634027  1570 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:59:01.635850  1639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.070s	sys 0.085s
I20260709 12:59:01.649389  1569 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:01.653890  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:01.654001  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:01.654891  1567 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:01.655581  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.658007  1569 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:01.637626  6413 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.673561  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.674278  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.674832  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.675184  1571 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:01.675539  1568 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:01.635917  6350 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:59:01.692844  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 221716us
I20260709 12:59:01.700941  2312 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:01.679507  6462 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:01.699278  1569 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:01.717425  1568 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:01.727490  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:01.677567  6413 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.681032  6350 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.728366  1640 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:59:01.706713  6425 raft_consensus.cc:2804] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:01.706952  6434 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:01.749684  6413 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:01.751888  6350 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.721434  6258 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:01.744505  6478 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.537s	user 0.002s	sys 0.004s
I20260709 12:59:01.740581  6425 raft_consensus.cc:697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:01.759194  6066 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.741706  6434 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.776279  1640 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:01.781947  1640 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:59:01.776917  6350 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.787506  1572 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 14: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:01.805171  6266 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.809290  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:01.782015  6434 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:01.822253  1537 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.822158  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:01.823313  1647 raft_consensus.cc:2393] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
W20260709 12:59:01.823932  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 241062us
I20260709 12:59:01.825013  1537 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:01.825935  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.827775  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.828234  1645 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:01.826875  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:01.825672  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.833231  1537 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.833478  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:01.789024  6425 consensus_queue.cc:237] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.871731  6367 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:01.872474  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:01.873485  6367 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:01.873487  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:01.837417  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:01.874390  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:01.843747  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:01.834865  5957 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:01.823464  6172 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:01.807507  6350 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.886174  1612 leader_election.cc:400] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15.
I20260709 12:59:01.888339  6350 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:01.836606  6418 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:01.879983  6462 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:01.894620  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.895812  1718 raft_consensus.cc:2410] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:01.826855  6148 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:01.826508  6225 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.870551  6404 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:01.891916  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:01.901708  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.879362  1567 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:01.897364  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.902628  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:01.891095  6403 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:01.904582  6403 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.897473  6417 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:01.898038  6413 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:01.900496  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.877120  6297 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:01.888832  6227 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:01.891420  6434 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:01.857502  1537 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:01.907714  1713 raft_consensus.cc:2368] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:59:01.912185  6066 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:01.907708  6225 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.914254  1569 raft_consensus.cc:2410] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 12:59:01.914340  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 56932.1us
I20260709 12:59:01.903272  1568 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
W20260709 12:59:01.916874  6474 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.801s	user 0.006s	sys 0.000s
I20260709 12:59:01.897360  6193 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:59:01.919399  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.920166  1713 raft_consensus.cc:2393] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:01.915722  1537 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.920907  1712 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:01.905382  6404 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.900704  6462 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:01.925463  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.907092  6250 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:01.923738  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.939424  1712 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:59:01.942121  1713 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:01.954960  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.955881  1537 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.919755  6297 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:01.961696  1537 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.968341  5957 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:01.968690  1537 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:01.964200  2314 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:01.971415  1537 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:01.939405  6404 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:01.909662  6417 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.915668  6413 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.976779  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.977490  1712 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:01.978155  1716 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:59:01.977329  1714 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:01.979801  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.981349  1712 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:59:01.918454  6434 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:01.973137  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.926115  6172 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:01.980074  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.982972  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:01.984273  1686 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:01.986440  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.959407  6350 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:01.971961  6485 raft_consensus.cc:2804] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:01.987802  1713 raft_consensus.cc:2368] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14.
I20260709 12:59:01.972957  6148 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:01.990629  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:01.991695  1686 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:01.956799  6250 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:01.976272  6189 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:02.001241  1717 raft_consensus.cc:2393] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 10: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:01.962472  6418 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:59:01.975663  6297 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:01.985877  6298 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:02.004617  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:01.989181  1721 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:59:01.922647  6066 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:59:02.010723  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:01.998611  6479 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:02.002827  6277 raft_consensus.cc:2804] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:02.032953  2345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 735) took 1463 ms. Trace:
I20260709 12:59:02.038024  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:02.012830  6498 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:02.017206  6488 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:59:02.035411  2345 rpcz_store.cc:276] 0709 12:59:00.570032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.608687 (+ 38655us) service_pool.cc:224] Handling call
0709 12:59:00.608976 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.644905 (+ 35929us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:59:00.716519 (+ 71614us) log.cc:844] Serialized 14 byte log entry
0709 12:59:00.808873 (+ 92354us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:00.808919 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:00.808964 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.032600 (+1223636us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54005e0e54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:02.032693 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.032873 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14618,"prepare.queue_time_us":113125,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":14199,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":1765,"spinlock_wait_cycles":82103552,"thread_start_us":149171,"threads_started":2,"wal-append.queue_time_us":234601,"wal-append.run_cpu_time_us":1349,"wal-append.run_wall_time_us":1010759}
I20260709 12:59:02.006412  6189 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:02.008229  6400 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:02.033545  6193 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.013243  6298 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.032137  6415 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:02.012279  6485 raft_consensus.cc:697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:02.036996  6479 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:02.049330  6359 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.049301  6428 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:02.064895  6298 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:02.059774  6189 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:02.069856  6415 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.079700  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:02.011330  6462 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.037309  6224 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.088997  6224 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:02.057893  6297 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:02.093163  6497 log.cc:927] Time spent T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:59:02.094724  6485 consensus_queue.cc:237] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.097687  6250 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.075762  6225 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.084959  6434 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:02.068257  6193 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.062608  6495 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:02.079295  6359 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.083559  6403 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:02.118659  1686 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:02.147974  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:02.099794  6417 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:02.107669  6408 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:02.110296  6428 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:02.178093  1686 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:02.241829  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.112931  6277 raft_consensus.cc:697] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:59:02.177268  6493 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 12:59:02.177426  6474 log.cc:927] Time spent T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:59:02.254988  6402 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:59:02.255447  6489 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 12:59:02.256807  6266 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:02.257246  6266 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:59:02.257478  6500 log.cc:927] Time spent T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:59:02.156319  6403 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:02.136011  6208 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:02.225564  6503 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.225953  6495 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:02.258108  6266 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:02.294134  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 116143us
I20260709 12:59:02.255565  6402 raft_consensus.cc:697] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:02.252166  6413 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:02.298693  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.289909  6428 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:02.290304  5957 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:02.237035  6408 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.177342  6479 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.330659  6298 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.332502  6359 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.332912  5957 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.334940  6408 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.336656  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 2196) took 1460 ms. Trace:
W20260709 12:59:02.336903  6504 log.cc:927] Time spent T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:59:02.316507  6403 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:59:02.358670  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:02.373633  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.373965  1686 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:02.319924  6506 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:02.366655  1642 rpcz_store.cc:276] 0709 12:59:00.876525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.937841 (+ 61316us) service_pool.cc:224] Handling call
0709 12:59:02.336447 (+1398606us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54001d33d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:02.336572 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000613632}
I20260709 12:59:02.367828  6193 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.368323  6298 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.314006  6415 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.348632  6250 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.299173  6503 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.357779  6148 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:02.389369  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.389451  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:02.337234  6428 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.376900  6408 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:02.377926  6359 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:02.404244  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.407184  1566 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:59:02.406000  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:02.388974  6402 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.410043  6503 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.388501  6250 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.411890  1644 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:59:02.386046  6506 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.413486  6250 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.414076  6506 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:02.415114  6507 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:59:02.380972  6403 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.416734  6408 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.417951  6403 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:02.418900  6508 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:59:02.419103  6408 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:02.404273  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 138044us
I20260709 12:59:02.421741  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:02.423018  1612 leader_election.cc:400] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10.
I20260709 12:59:02.425012  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.426069  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:02.394486  6421 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:02.428906  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.431589  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.432529  1568 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:02.385830  6495 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:02.433373  1566 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:02.431555  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.295709  6208 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.359229  6277 consensus_queue.cc:237] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.433190  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:02.442189  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.434515  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:02.443035  1566 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
W20260709 12:59:02.427942  6499 log.cc:927] Time spent T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 12:59:02.439205  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.406721  6413 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:02.438387  1563 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:02.444245  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:02.429774  6250 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:02.447718  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.392802  6148 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.432299  6224 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:02.454708  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:02.454995  5957 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.455145  6498 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:02.455397  1715 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:02.456394  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:02.457028  1714 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:02.457134  6148 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.457935  6224 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:02.458499  6224 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.458501  1717 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:59:02.460749  6224 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.431236  6193 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:59:02.463645  6487 consensus_queue.cc:1059] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:02.460958  6250 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:02.464692  6250 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.465054  6250 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:02.458061  1565 raft_consensus.cc:1275] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:02.467388  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.438269  6511 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:02.469527  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:02.441815  6456 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:02.448671  6457 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:02.428973  6359 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:02.530025  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 60572.9us
I20260709 12:59:02.531392  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.532220  2341 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 10.
I20260709 12:59:02.449322  6413 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.449322  6421 raft_consensus.cc:3055] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:02.539311  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.551541  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.568522  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.471895  6051 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:02.537202  6421 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:02.537168  6413 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:02.566347  6514 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:02.587443  6514 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:02.587858  6514 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:02.598923  1638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59270 (request call id 2118) took 1425 ms (client timeout 1644 ms). Trace:
W20260709 12:59:02.599551  1638 rpcz_store.cc:269] 0709 12:59:01.173297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.213182 (+ 39885us) service_pool.cc:224] Handling call
0709 12:59:02.598718 (+1385536us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400192dd4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:02.598835 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367153536}
I20260709 12:59:02.541028  6456 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.610980  1564 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:02.579954  6051 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.613466  6456 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.614261  6051 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:02.616835  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.595491  6495 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.629930  6250 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.632156  6250 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.633335  6514 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.638676  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.642150  1686 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:02.655539  1646 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:02.677349  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 75088.4us
I20260709 12:59:02.658226  6498 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:59:02.677268  6518 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 12:59:02.689147  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 90913.9us
I20260709 12:59:02.669143  6403 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:59:02.674088  6250 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:02.655594  6495 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.678599  6392 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.683977  6498 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.694502  6498 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:02.689903  6208 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.702380  6514 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.703147  6359 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.700973  6250 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:02.704432  6404 consensus_meta.cc:287] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.717s	user 0.008s	sys 0.002s
I20260709 12:59:02.704872  6404 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.678788  6510 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:59:02.706950  6404 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.705117  6250 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.709178  6495 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:02.709556  6189 consensus_meta.cc:287] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 12:59:02.710134  6189 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.714363  6413 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.716704  6413 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:02.709725  6458 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:02.726627  6483 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.940s	user 0.008s	sys 0.002s
I20260709 12:59:02.728034  6498 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.732851  6189 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.730794  6498 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:02.735641  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.736090  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.738454  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.747294  6266 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:02.753118  6496 log.cc:927] Time spent T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.702s	user 0.021s	sys 0.025s
W20260709 12:59:02.753139  6501 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.714s	user 0.008s	sys 0.010s
I20260709 12:59:02.754020  6421 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.755313  6421 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:02.756007  6258 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:02.757493  6428 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:02.801008  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 356593us
W20260709 12:59:02.802642  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.689239  1646 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:59:02.804399  1646 pending_rounds.cc:85] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 6
I20260709 12:59:02.805130  1646 pending_rounds.cc:107] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:59:02.805675  1646 raft_consensus.cc:2889] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:02.807437  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 2112) took 2142 ms. Trace:
I20260709 12:59:02.808244  1567 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:02.810088  1571 raft_consensus.cc:1240] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: [12.5-12.5]
W20260709 12:59:02.815261  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.820405  6462 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.821491  6462 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.823431  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45038 (request call id 2151) took 1175 ms. Trace:
W20260709 12:59:02.824947  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.825515  6462 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:02.826566  1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59258 (request call id 2202) took 1679 ms (client timeout 2048 ms). Trace:
W20260709 12:59:02.827078  1644 rpcz_store.cc:269] 0709 12:59:01.146546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.153420 (+  6874us) service_pool.cc:224] Handling call
0709 12:59:02.826051 (+1672631us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001d38d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:02.826269 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2892063488}
I20260709 12:59:02.823877  1572 rpcz_store.cc:276] 0709 12:59:01.647769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.647899 (+   130us) service_pool.cc:224] Handling call
0709 12:59:02.822905 (+1175006us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400133b54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:02.823195 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259884288}
I20260709 12:59:02.807998  1646 rpcz_store.cc:276] 0709 12:59:00.665248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.665606 (+   358us) service_pool.cc:224] Handling call
0709 12:59:00.665940 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.745890 (+ 79950us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b4c000eec40. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a40a00a20 00007f6a40a11a29 00007f6a409d7644 00007f6a409fef2d 00007f6a409feb93 00007f6a4272f18b 00007f6a4272fcb5 00007f6a4272af30 00007f6a4272c7de 00007f6a42736b49 00007f6a42737416
0709 12:59:01.400038 (+654148us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b180023ed40. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a4276f646 00007f6a426a958e 00007f6a4272af9e 00007f6a4272c7de 00007f6a42736b49 00007f6a42737416 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4
0709 12:59:02.655156 (+1255118us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b5800548cd0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426900aa 00007f6a42712447 00007f6a4272afe7 00007f6a4272c7de 00007f6a42736b49 00007f6a42737416 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4
0709 12:59:02.806901 (+151745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.807325 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036492672}
I20260709 12:59:02.838020  6487 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:02.839339  6487 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.840421  1563 raft_consensus.cc:1275] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:59:02.840879  1563 pending_rounds.cc:85] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 11
I20260709 12:59:02.841113  1563 pending_rounds.cc:107] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:59:02.841405  1563 raft_consensus.cc:2889] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:02.842060  2342 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:02.843648  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:02.853529  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.855091  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:02.857584  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53360us
I20260709 12:59:02.859153  1612 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:02.860863  6266 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:02.861399  6266 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:02.861882  6266 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:02.861848  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.863189  1612 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:02.864903  6462 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:02.865803  6458 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:59:02.867025  6458 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:02.867434  6458 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:02.868989  6458 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.871716  6458 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:02.874660  1717 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:02.875813  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:02.878033  1714 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 15: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:02.884018  1719 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:02.884147  6400 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:02.894131  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.896777  6197 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:02.898018  1684 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:02.897948  6197 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.884935  6400 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.896345  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:02.907018  6400 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:02.908102  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 1.00787e+06us
I20260709 12:59:02.909469  6462 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.910260  6462 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.912046  6197 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.912873  6462 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.913676  2346 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:02.922801  1644 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:02.923498  6417 raft_consensus.cc:2804] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:02.924314  6417 raft_consensus.cc:697] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:02.926659  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:02.925854  6417 consensus_queue.cc:237] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:02.927302  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:02.928408  1571 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 14: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:02.930338  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:02.931218  1569 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:02.932070  1565 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:02.934206  1566 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:59:02.940999  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:02.952527  6462 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:02.952937  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:02.953401  6462 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.956310  6462 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:02.959406  6316 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:02.955353  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:02.960405  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:02.960991  6316 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:02.962654  6498 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:02.965986  6316 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:02.969694  1572 raft_consensus.cc:3055] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:02.979699  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:02.981768  2314 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:02.982811  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:02.984812  6036 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:02.970898  1684 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:02.985898  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 122938us
I20260709 12:59:02.986655  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:02.970192  1572 raft_consensus.cc:740] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:02.996991  1572 consensus_queue.cc:260] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.012527  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:03.013068  1720 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:59:03.013613  1646 raft_consensus.cc:2393] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 14: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:03.013724  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:03.016769  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.020382  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.021060  1564 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:59:03.012739  1612 leader_election.cc:400] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14.
I20260709 12:59:03.025198  1612 leader_election.cc:403] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:59:03.028203  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.007428  6400 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:03.039474  1684 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:03.040211  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.006982  6036 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:03.043502  6266 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.052392  6487 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:03.053191  6036 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:03.037668  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52650.3us
I20260709 12:59:03.060336  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.063251  1644 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:03.065434  1719 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:59:03.065635  1714 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:03.066699  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.065502  1643 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:03.069082  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.070017  1642 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:03.070573  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.071079  6389 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:03.072391  6389 consensus_queue.cc:1048] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:03.074168  6389 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:03.074616  6389 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:03.074882  6197 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:03.075549  6197 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.075729  6389 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.077121  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.066780  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.071363  1716 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:03.083181  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.089202  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.088994  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:03.092211  1646 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:03.091079  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.087302  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.093927  1571 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:03.099648  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:03.094599  6428 consensus_queue.cc:1048] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:59:03.103180  1643 raft_consensus.cc:1275] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:03.106408  1719 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:03.104260  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.115325  1639 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:03.117520  6316 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:03.118818  6316 raft_consensus.cc:3055] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:03.119241  6316 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:03.121373  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:03.122007  6339 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14.
I20260709 12:59:03.122287  1713 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 14: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:03.089021  6417 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:03.125535  1572 raft_consensus.cc:3060] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:03.126406  6027 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:03.126926  6027 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:03.127403  6027 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:03.129293  6389 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:03.120352  6316 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.134470  6462 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.134691  6052 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:03.135068  6462 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.136924  6250 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:03.137573  6250 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.139468  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:03.139851  6250 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.140304  6052 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:03.142518  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:03.139948  1569 raft_consensus.cc:2468] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:03.144941  6052 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:03.146579  6458 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:03.147279  6458 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.150767  1645 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:03.153251  6422 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:59:03.155467  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 116219us
I20260709 12:59:03.157866  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:03.159551  6266 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:03.159714  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:03.161448  1643 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:03.161685  6417 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:03.162139  6417 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.162498  6417 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:03.162824  1647 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:59:03.163925  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:03.164909  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 50403.9us
I20260709 12:59:03.167146  6428 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:03.167835  6495 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:03.169749  1640 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:03.169813  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.170778  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:03.186501  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.171617  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:03.171914  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:03.171075  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.173048  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.190017  6458 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.184630  1686 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:03.194132  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.195199  1715 raft_consensus.cc:2393] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:03.110963  6197 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.197921  6462 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:03.120486  6036 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:03.207085  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.213493  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:59:03.215708  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.217119  6422 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:03.217971  6422 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:03.219033  6422 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.223776  2345 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:59:03.225980  6485 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.226619  6485 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.244181  6291 raft_consensus.cc:2804] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:03.244910  6291 raft_consensus.cc:697] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:03.245683  6036 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.245913  6291 consensus_queue.cc:237] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.247542  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:03.247361  1469 catalog_manager.cc:5697] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 10, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:03.249393  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.249816  2346 raft_consensus.cc:1240] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:59:03.249961  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 65586.3us
I20260709 12:59:03.253254  1646 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
W20260709 12:59:03.257581  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 245221us
I20260709 12:59:03.260018  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:03.260630  1643 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:03.260053  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.265777  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:59:03.266783  1465 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 235) took 61925 ms (client timeout 15000 ms). Trace:
I20260709 12:59:03.267995  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:03.269451  1571 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:03.270051  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:59:03.271164  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 111535us
I20260709 12:59:03.249241  1469 catalog_manager.cc:5697] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:03.285006  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:03.303071  1643 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:59:03.309877  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:03.310734  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.311408  1639 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
W20260709 12:59:03.311561  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.312263  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:59:03.313141  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.306099  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:03.303279  6316 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:03.330171  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:03.331215  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52380.9us
I20260709 12:59:03.330360  6413 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:03.332008  6413 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.334275  6413 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:03.335755  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.349936  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.330255  6318 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:03.351275  6318 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.354545  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.357213  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:03.358397  6458 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:03.359511  6359 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:03.359949  6359 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.360285  6359 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:03.359015  6458 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.355993  1610 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:03.314652  6197 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.375310  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.374040  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:59:03.380091  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 47437.8us
I20260709 12:59:03.380802  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:03.386940  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.390895  6458 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.391844  6250 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:03.392460  6250 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:03.392908  6250 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:03.396806  6197 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.398217  1570 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:03.398927  6197 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:03.401149  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.404317  6027 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:03.403645  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44772.6us
I20260709 12:59:03.409169  6458 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:03.370308  1469 catalog_manager.cc:5697] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:03.409644  6458 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.413632  6458 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:03.417915  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.423724  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.406196  6318 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:03.430081  1715 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:59:03.430992  6359 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.439316  1564 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:59:03.446295  1640 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:59:03.436709  6400 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:03.448148  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:59:03.458899  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 48275.1us
I20260709 12:59:03.448582  6027 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.461459  1713 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:03.463703  6479 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:03.463903  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.466534  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:03.467391  6428 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:03.448864  1469 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:03.267236  1465 rpcz_store.cc:269] 0709 12:58:01.341559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.341824 (+   265us) service_pool.cc:224] Handling call
0709 12:59:03.266523 (+61924699us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:53.206814 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:53.249069 (+ 42255us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:53.253207 (+  4138us) write_op.cc:435] Acquired schema lock
0709 12:58:53.255213 (+  2006us) tablet.cc:662] Decoding operations
0709 12:58:53.309658 (+ 54445us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:53.309758 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:53.309786 (+    28us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:58:53.310453 (+   667us) tablet.cc:701] Row locks acquired
0709 12:58:53.310499 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:58:53.310649 (+   150us) write_op.cc:270] Start()
0709 12:58:53.310795 (+   146us) write_op.cc:276] Timestamp: P: 1783601933310593 usec, L: 0
0709 12:58:53.310833 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:58:53.354748 (+ 43915us) log.cc:844] Serialized 2850 byte log entry
0709 12:58:54.507538 (+1152790us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:58:54.773753 (+266215us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18002c2120. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:58:54.838743 (+ 64990us) op_driver.cc:464] REPLICATION: finished
0709 12:58:55.214904 (+376161us) write_op.cc:301] APPLY: starting
0709 12:58:55.226607 (+ 11703us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:55.379450 (+152843us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:55.379568 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:55.409297 (+ 29729us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:55.409567 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:58:55.409642 (+    75us) write_op.cc:312] APPLY: finished
0709 12:58:55.409970 (+   328us) log.cc:844] Serialized 73 byte log entry
0709 12:58:55.410152 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:55.410257 (+   105us) write_op.cc:454] Released schema lock
0709 12:58:55.410318 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:55.410731 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:55.410766 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":907635,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":328101,"apply.run_cpu_time_us":13472,"apply.run_wall_time_us":215093,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33415,"num_ops":7,"prepare.queue_time_us":264825,"prepare.run_cpu_time_us":16533,"prepare.run_wall_time_us":338345,"raft.queue_time_us":42035,"raft.run_cpu_time_us":55679,"raft.run_wall_time_us":282002,"replication_time_us":1490462,"spinlock_wait_cycles":76150272,"thread_start_us":424744,"threads_started":4,"wal-append.queue_time_us":85589,"wal-append.run_cpu_time_us":12696,"wal-append.run_wall_time_us":3010232}]]}
I20260709 12:59:03.472235  1684 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:03.445508  6318 consensus_queue.cc:1048] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 12:59:03.476992  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 44978.2us
W20260709 12:59:03.479053  6534 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:59:03.475420  6413 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:03.511354  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:03.529763  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:03.537403  1537 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:03.513316  6462 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:59:03.547194  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 192985us
I20260709 12:59:03.557001  1572 raft_consensus.cc:1275] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:03.553187  6462 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:03.564842  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 51741.9us
I20260709 12:59:03.548660  6428 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:59:03.574539  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 102387us
I20260709 12:59:03.568470  1469 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:03.584803  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:03.569397  6462 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:03.569044  6197 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:03.561844  6479 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:59:03.593253  1469 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:03.614902  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.615630  1721 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:03.620942  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.624001  1469 catalog_manager.cc:5697] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 10, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:03.624864  6546 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:03.626351  6359 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:03.626096  1469 catalog_manager.cc:5697] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:03.627728  1469 catalog_manager.cc:5697] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:03.628429  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:03.630810  2341 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:03.571362  6417 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.632472  2346 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:59:03.634265  2349 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:03.637801  2312 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:03.677304  6318 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:03.677412  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.677747  6318 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:03.678128  6318 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:03.679344  2341 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:03.639791  1535 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:03.590534  6036 consensus_queue.cc:1048] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:59:03.595078  6428 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.644196  6250 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.650188  6458 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.651032  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:03.660859  1715 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 11. Current term is 12. Ops: []
W20260709 12:59:03.662472  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52804.9us
I20260709 12:59:03.663005  6485 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.667328  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:03.667533  6417 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:03.674561  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.688395  1684 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:03.809842  1537 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:59:03.810667  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 167250us
I20260709 12:59:03.812023  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:03.812286  6546 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:03.812938  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.813570  6551 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:03.813742  1721 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 14: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:03.814040  6551 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.814129  6546 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:03.814463  6551 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:03.816879  6413 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:03.817399  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:03.817587  6413 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:03.818361  6277 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:03.819315  6413 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:03.819783  6277 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:03.820211  6277 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:59:03.780979  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 86620.9us
I20260709 12:59:03.656569  1713 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:59:03.806849  6189 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:03.807413  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 167646us
I20260709 12:59:03.824828  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.808713  6458 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.820608  6277 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:03.839568  1718 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:03.841626  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.856222  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.860973  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.844358  6318 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.878116  1469 catalog_manager.cc:5697] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 9, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 9 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:03.888770  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.890689  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.892726  6425 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:03.904670  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.906504  6250 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:03.907178  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44892.5us
I20260709 12:59:03.910243  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.911846  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:03.913097  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.917045  6189 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.917783  6428 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:03.917671  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:03.917742  6189 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.921226  1718 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:03.922935  6189 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.923031  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:03.924157  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:03.924803  1717 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:03.925098  6498 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:03.926571  6498 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:03.926916  6498 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:03.927271  6498 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:03.929584  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:03.931267  6400 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:03.939323  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.931850  6400 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:03.941970  1469 catalog_manager.cc:5697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 7, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:03.946837  1610 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:03.950662  1469 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:03.951308  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.951645  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.954102  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:03.955269  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.956423  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.957156  1570 raft_consensus.cc:2393] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 14: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:03.957401  6266 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.957885  6266 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.959739  1565 raft_consensus.cc:1240] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:03.959856  6266 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.956875  6458 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:03.960673  6458 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.960896  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.960820  6413 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:03.962148  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.962674  6458 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.964025  1535 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:03.968997  1569 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:03.969955  6458 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:03.970651  6458 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:03.971138  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.940009  6250 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:03.971498  6458 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.972985  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:03.973733  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:03.975018  6417 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.975531  6417 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.976724  6359 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:03.977448  6359 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.978160  1641 raft_consensus.cc:1275] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:03.978238  6318 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:03.977463  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.979398  6359 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:03.979786  1645 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:03.943135  6462 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:03.972370  6250 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:03.981362  1717 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:03.983378  6250 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:03.969925  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:03.976810  1564 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:03.990605  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:03.991302  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:03.990600  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:03.990904  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:03.993319  2349 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:59:03.952008  1469 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 13, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:04.001523  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 334250us
W20260709 12:59:04.012197  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 200266us
I20260709 12:59:04.013299  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:04.025558  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 61692.2us
I20260709 12:59:04.011823  6189 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:04.037708  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:59:04.044106  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 53585.6us
I20260709 12:59:04.046528  1718 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:04.045778  2314 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:04.016148  6277 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.052829  1469 catalog_manager.cc:5697] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:04.092325  2314 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:04.098752  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:04.112355  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:04.113597  1642 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:04.123063  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 59629.4us
W20260709 12:59:04.149554  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 82899.7us
W20260709 12:59:04.159228  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 58911.7us
I20260709 12:59:04.105125  1469 catalog_manager.cc:5697] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 10, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:04.114607  6479 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:04.142014  6462 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:04.175367  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 64680.3us
I20260709 12:59:04.140056  6527 raft_consensus.cc:2764] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:59:04.097373  6400 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.125521  6485 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:59:04.216838  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:04.167651  6417 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:04.143404  6052 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:59:04.173748  6413 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:04.229662  6413 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.231629  6413 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:04.227006  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:04.186312  1469 catalog_manager.cc:5697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 10, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:04.140367  6551 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.145766  6498 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.239054  1564 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:04.184718  6266 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:59:04.208837  6197 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:59:04.246165  6359 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:04.250267  6339 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:04.263458  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 57315.1us
I20260709 12:59:04.254988  1469 catalog_manager.cc:5697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 10, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:04.273284  6551 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:04.274037  6551 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:04.274431  6551 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:04.274799  6551 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:04.276507  6567 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:59:04.277783  6498 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:04.278615  6417 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.279276  6277 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:04.281894  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:04.279219  6417 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.293493  6417 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:04.294613  6554 log.cc:927] Time spent T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
I20260709 12:59:04.290016  6277 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:04.299832  6339 consensus_queue.cc:1059] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:04.300778  6339 raft_consensus.cc:3055] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:04.301158  6339 raft_consensus.cc:740] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:04.300424  1469 catalog_manager.cc:5697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:04.302098  6339 consensus_queue.cc:260] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.303300  6339 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:04.302989  1469 catalog_manager.cc:5697] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:04.304481  1469 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 11, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.306176  1469 catalog_manager.cc:5697] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 10, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:04.307693  1469 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:04.299103  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:04.308429  1642 raft_consensus.cc:2468] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
W20260709 12:59:04.308693  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.310249  1684 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:04.318907  6277 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:04.319029  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:04.319782  1721 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:04.320442  6422 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:04.320843  6422 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:04.321700  6422 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:04.322824  6422 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:04.327368  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.308981  1469 catalog_manager.cc:5697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:04.312448  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:04.312777  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:04.311374  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:04.315701  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:04.331714  1716 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:04.317735  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:04.339531  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 110777us
I20260709 12:59:04.353300  1721 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
W20260709 12:59:04.356767  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 50274.8us
I20260709 12:59:04.359018  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:04.359622  1717 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:04.315116  6266 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:04.368561  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:04.310576  6551 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.362062  6266 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.370923  6266 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:04.379949  1565 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:04.380769  6551 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:04.384881  2312 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:04.385732  6550 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:59:04.387049  6576 raft_consensus.cc:2804] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:04.387640  6576 raft_consensus.cc:697] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:59:04.389025  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 71391.7us
I20260709 12:59:04.392403  6258 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:04.392796  6462 consensus_queue.cc:1059] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:04.358419  6339 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:04.393482  6462 consensus_queue.cc:1243] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:04.393947  6339 raft_consensus.cc:3055] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:04.394296  6339 raft_consensus.cc:740] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:04.395149  6339 consensus_queue.cc:260] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.396200  1612 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:04.396276  6339 raft_consensus.cc:3060] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:04.396909  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 106023us
I20260709 12:59:04.399498  6400 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:04.400012  6400 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:04.388585  6576 consensus_queue.cc:237] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:04.402376  6400 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:04.405534  1717 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 16.
W20260709 12:59:04.407390  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 152535us
I20260709 12:59:04.412566  1718 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 12:59:04.415024  1684 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:04.415724  2349 raft_consensus.cc:1240] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:04.363127  1469 catalog_manager.cc:5697] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 11, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:04.421497  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 62238.3us
I20260709 12:59:04.422310  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:04.421304  6277 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:04.418157  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:04.427363  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:04.430238  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:04.426333  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:04.430495  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:04.428287  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:04.447448  1714 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:59:04.450148  1712 raft_consensus.cc:2410] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:59:04.449127  1638 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:04.431535  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:04.431167  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:04.428676  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:04.458559  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:04.459120  1639 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:04.493933  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:04.494663  1646 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:04.423890  6462 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:04.497053  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 67885.1us
I20260709 12:59:04.428858  6417 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:04.447605  6250 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:04.423305  6587 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:04.455302  6458 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:04.506188  1571 raft_consensus.cc:1275] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:04.508213  1564 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:04.458429  6546 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.499034  6551 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:04.503791  1469 catalog_manager.cc:5697] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:04.505555  6250 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:04.503371  6417 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:59:04.527997  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 105468us
I20260709 12:59:04.528882  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:04.532073  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:04.532452  1469 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 13, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:04.544752  1566 raft_consensus.cc:2393] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:04.524138  6250 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:04.502940  6462 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.532099  6417 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:04.550475  1535 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:04.556861  6581 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.259s	user 0.001s	sys 0.002s
W20260709 12:59:04.557978  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.559788  6583 consensus_queue.cc:1048] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:59:04.564296  6462 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:04.564679  6529 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:04.565363  6579 log.cc:927] Time spent T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.225s	user 0.000s	sys 0.003s
I20260709 12:59:04.524050  6546 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.593967  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:04.622099  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 118649us
I20260709 12:59:04.623256  1639 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
W20260709 12:59:04.624794  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 121407us
W20260709 12:59:04.591113  6594 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:59:04.628703  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 81204.3us
W20260709 12:59:04.626405  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 196423us
I20260709 12:59:04.626422  1469 catalog_manager.cc:5697] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 11, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:04.633798  6458 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:04.736009  6458 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:04.650966  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:04.719468  1640 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:04.646286  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:04.637633  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:59:04.717025  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 75312.8us
I20260709 12:59:04.645566  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:04.746006  1569 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:04.650487  1713 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:04.746416  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:04.747920  1612 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:04.649020  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:04.739434  1720 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:04.761471  1564 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 15: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:04.759402  1566 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:04.626089  6266 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.793457  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:04.653712  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:04.866027  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 228592us
I20260709 12:59:04.954571  6550 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:04.665288  6417 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:04.956969  6266 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:04.958062  1717 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:04.653522  6197 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.306s
I20260709 12:59:04.761384  6318 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:04.886494  6421 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:59:04.728426  6551 consensus_queue.cc:1059] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.234s
I20260709 12:59:04.962785  6551 raft_consensus.cc:3055] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:04.963250  6551 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:04.642369  6586 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:04.644590  6546 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:04.994866  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 134817us
I20260709 12:59:04.972707  6569 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:59:04.795554  6600 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:04.678718  6189 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.287s
I20260709 12:59:04.973871  6560 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:04.761132  6462 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:04.760975  6359 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:04.990288  1537 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:04.761945  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:04.991438  6551 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:04.994704  6604 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.276s	user 0.008s	sys 0.003s
W20260709 12:59:04.954777  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 301153us
I20260709 12:59:04.961318  6318 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:05.013167  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.044793  1571 raft_consensus.cc:3055] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:05.045178  1571 raft_consensus.cc:740] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
W20260709 12:59:05.022197  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 228856us
W20260709 12:59:05.022970  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 67006.6us
W20260709 12:59:05.040521  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 279116us
I20260709 12:59:05.046948  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:04.983309  6417 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:04.667513  6250 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.043679  6462 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:05.051771  6462 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.052244  6318 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:05.052922  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:05.054663  6597 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:05.055084  6597 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.055444  6597 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:05.034627  6359 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:05.056782  6359 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:05.064172  1564 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:05.065563  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:05.029956  6600 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.076583  1571 consensus_queue.cc:260] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.080108  6600 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:05.080225  1571 raft_consensus.cc:3060] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:05.081090  6551 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:05.082773  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:05.083336  1720 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:05.083775  1612 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39997 timed out after 1.789s (SENT) [suppressed 14 similar messages]
I20260709 12:59:05.059803  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:05.085119  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:05.086647  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:05.039575  6568 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:05.041234  6197 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:05.103003  1571 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
W20260709 12:59:05.131125  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44541.7us
I20260709 12:59:05.135031  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:05.078202  6318 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:59:05.142091  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 99999.8us
I20260709 12:59:05.103931  6546 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:05.078066  6250 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:05.103291  6413 consensus_queue.cc:1048] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:59:05.107468  6587 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:59:05.143569  1714 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:05.140079  6605 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:05.168560  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.182636  1535 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:05.125414  6197 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.136869  6573 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:59:05.197609  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 62695.1us
I20260709 12:59:05.201784  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:05.180717  6546 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:05.136890  6291 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:59:05.195598  6197 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:05.234239  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:05.205068  6569 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:05.181913  6318 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.205557  6573 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:05.235652  6266 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:05.335074  1613 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:43765, user_credentials={real_user=slave}} blocked reactor thread for 54355.6us
I20260709 12:59:05.273954  6605 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:05.271960  6599 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:05.277326  6569 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:05.335281  6277 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.337364  6588 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:05.271929  6597 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:05.364775  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.385313  1672 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:43765 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:43765 timed out after 15.000s (SENT)
I20260709 12:59:05.405905  6318 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:05.417189  6569 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.418078  6546 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:05.423214  6608 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:59:05.467903  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 266204us
W20260709 12:59:05.429076  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 345302us
W20260709 12:59:05.489701  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.498417  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:05.500274  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.343812  6266 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.429754  6599 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:05.439540  6277 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.539849  6573 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.547420  6197 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.478502  6359 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.470485  6189 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:05.550607  6189 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.551923  6546 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:05.558552  1687 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:43765, user_credentials={real_user=slave}} blocked reactor thread for 52000.4us
I20260709 12:59:05.560045  6617 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.087s
W20260709 12:59:05.561625  6611 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:59:05.562873  6612 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
W20260709 12:59:05.573770  6601 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.858s	user 0.000s	sys 0.012s
I20260709 12:59:05.575255  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46170 (request call id 2118) took 1162 ms. Trace:
I20260709 12:59:05.576071  1642 raft_consensus.cc:1275] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:59:05.576475  1642 pending_rounds.cc:85] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 7
I20260709 12:59:05.576742  1642 pending_rounds.cc:107] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:59:05.576972  1642 raft_consensus.cc:2889] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:05.575700  1716 rpcz_store.cc:276] 0709 12:59:04.412429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.412538 (+   109us) service_pool.cc:224] Handling call
0709 12:59:04.428941 (+ 16403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:04.458288 (+ 29347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:04.458326 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:04.504956 (+ 46630us) log.cc:844] Serialized 26 byte log entry
0709 12:59:04.632881 (+127925us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:04.632936 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.633027 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:05.428272 (+795245us) spinlock_profiling.cc:243] Waited 981 us on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:59:05.574834 (+146562us) raft_consensus.cc:1685] finished
0709 12:59:05.574865 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.575157 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4094,"raft.queue_time_us":46502,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4884,"spinlock_wait_cycles":2255744,"thread_start_us":107349,"threads_started":1,"wal-append.queue_time_us":197842}
W20260709 12:59:05.581399  6610 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 12:59:05.582706  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 71514.6us
I20260709 12:59:05.585628  6624 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:05.586198  6624 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.589320  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:05.590317  1642 raft_consensus.cc:2393] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:05.592444  1647 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:05.595340  1684 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:05.598874  6597 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:05.599617  6597 consensus_queue.cc:1048] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:05.600283  6597 consensus_queue.cc:1243] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer 7a04d0a2963b4860beb7cd14e0b4939a log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:05.601027  6629 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:05.601755  6629 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:05.498912  6588 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:05.604658  6588 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:05.605237  6588 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.607368  6588 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:05.620748  6586 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:05.621147  6586 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:05.622080  6586 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.623064  6586 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:05.628701  6598 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.492s	user 0.001s	sys 0.000s
I20260709 12:59:05.630509  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 724) took 1300 ms. Trace:
I20260709 12:59:05.630860  1715 rpcz_store.cc:276] 0709 12:59:04.330420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.330655 (+   235us) service_pool.cc:224] Handling call
0709 12:59:04.355276 (+ 24621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:04.406787 (+ 51511us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:59:04.447218 (+ 40431us) log.cc:844] Serialized 14 byte log entry
0709 12:59:04.646278 (+199060us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b1800110200. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6473f3 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:59:04.692309 (+ 46031us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:04.729385 (+ 37076us) log.cc:844] Serialized 26 byte log entry
0709 12:59:04.729562 (+   177us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:59:04.729606 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.729687 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:05.630234 (+900547us) raft_consensus.cc:1685] finished
0709 12:59:05.630332 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.630452 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2906,"prepare.queue_time_us":20235,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":10891,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":17970,"spinlock_wait_cycles":46454528,"thread_start_us":171007,"threads_started":1,"wal-append.queue_time_us":510825}
I20260709 12:59:05.507161  6458 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:05.633244  6458 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.635161  6277 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:05.635540  6458 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:05.637559  6551 consensus_meta.cc:287] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
I20260709 12:59:05.639284  6599 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.640801  6291 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:05.641736  6359 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:05.643484  6197 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:05.645325  1720 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.003s
I20260709 12:59:05.645642  1720 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:05.656157  1714 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:05.685508  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:05.686177  1572 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:59:05.508369  6462 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:05.692147  6600 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:05.692718  6600 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.681612  6250 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:05.507465  6413 consensus_queue.cc:1059] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.186s
W20260709 12:59:05.700394  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.702486  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 369896us
I20260709 12:59:05.694568  6462 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.726831  2346 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:05.728242  6462 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:05.730528  6600 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:05.737000  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:05.740479  6266 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:05.700482  6359 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:05.723057  6052 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.721310  6250 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.819295  6027 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:05.847419  6027 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.845578  6476 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.830132  6422 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.751842  6359 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.828380  6189 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:05.856562  1570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.009s	sys 0.056s
W20260709 12:59:05.884900  1570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.009s	sys 0.057s
I20260709 12:59:05.770968  6052 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:05.747612  6570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.036s	sys 0.025s
W20260709 12:59:05.887333  1564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.005s	sys 0.004s
W20260709 12:59:05.892251  1564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.005s	sys 0.005s
I20260709 12:59:05.888901  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 842) took 1081 ms. Trace:
I20260709 12:59:05.895800  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:05.896409  2349 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
W20260709 12:59:05.906745  1567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.006s	sys 0.005s
W20260709 12:59:05.907298  1567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.006s	sys 0.005s
I20260709 12:59:05.908106  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2208) took 1150 ms. Trace:
I20260709 12:59:05.930002  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:05.891847  6570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.036s	sys 0.025s
I20260709 12:59:05.894080  1570 rpcz_store.cc:276] 0709 12:59:04.804153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.804293 (+   140us) service_pool.cc:224] Handling call
0709 12:59:04.804565 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:04.804770 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:59:05.202950 (+398180us) log.cc:844] Serialized 14 byte log entry
0709 12:59:05.885344 (+682394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.885419 (+    75us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:59:05.885479 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.885566 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.885730 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77410,"prepare.queue_time_us":302764,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":380007,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":172,"thread_start_us":915486,"threads_started":2}
I20260709 12:59:05.934288  2346 raft_consensus.cc:2393] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 15: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:05.889559  6027 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:05.935106  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.005s	sys 0.009s
W20260709 12:59:05.943074  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 47402.4us
I20260709 12:59:05.908595  1567 rpcz_store.cc:276] 0709 12:59:04.757324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.758213 (+   889us) service_pool.cc:224] Handling call
0709 12:59:04.800964 (+ 42751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:04.801203 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:05.119091 (+317888us) log.cc:844] Serialized 14 byte log entry
0709 12:59:05.907722 (+788631us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.907786 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:05.907849 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.907924 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.908045 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77309,"prepare.queue_time_us":238362,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":8950,"raft.queue_time_us":248411,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":1017349,"threads_started":3,"wal-append.queue_time_us":377744}
W20260709 12:59:05.943593  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.005s	sys 0.009s
W20260709 12:59:05.954500  2313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.021s	sys 0.046s
W20260709 12:59:05.954950  2313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.021s	sys 0.046s
I20260709 12:59:05.883411  6422 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.931788  6479 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.881415  6476 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.961372  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:05.965729  6626 raft_consensus.cc:3055] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:05.966279  6626 raft_consensus.cc:740] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:59:05.967703  1685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.007s	sys 0.003s
W20260709 12:59:05.967971  6568 consensus_meta.cc:287] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.001s
I20260709 12:59:05.967337  6626 consensus_queue.cc:260] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:05.968502  6568 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:05.969108  6626 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:05.974539  6422 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:05.968041  1685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.007s	sys 0.003s
I20260709 12:59:05.978490  6573 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:05.979144  6573 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:05.984871  1684 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:05.991823  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:59:05.935247  6584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.000s	sys 0.014s
W20260709 12:59:05.998572  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 407381us
I20260709 12:59:05.966050  6052 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:05.995062  6584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.000s	sys 0.015s
W20260709 12:59:06.002715  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 859433us
I20260709 12:59:05.990571  6462 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:06.003746  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:06.004547  2341 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:06.001156  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.001679  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.008435  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.010278  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:06.015726  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:06.054286  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.055840  2346 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
W20260709 12:59:06.062132  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.020617  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 436037us
I20260709 12:59:06.065887  1642 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:59:06.071367  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:06.070019  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.076443  1645 raft_consensus.cc:1275] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 12:59:06.076088  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.005107  6458 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:59:06.014299  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 317955us
I20260709 12:59:06.021855  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:06.084697  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.085333  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:06.085764  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.007328  6599 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.992842  6627 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:06.013058  1716 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:59:06.013149  1638 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
W20260709 12:59:06.073824  6546 consensus_meta.cc:287] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.521s	user 0.002s	sys 0.008s
I20260709 12:59:06.147908  6634 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:06.148495  6634 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.149451  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:06.150295  1715 raft_consensus.cc:2393] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:06.076629  6189 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:59:06.141007  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 119283us
I20260709 12:59:05.943560  6624 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.136173  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.075942  6550 raft_consensus.cc:3055] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:06.145071  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:06.171912  1567 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:06.148720  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.122138  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:06.173604  1647 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:05.992957  6479 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.123656  6584 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:06.189563  6584 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.175127  6573 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:06.190124  6584 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:06.190677  6359 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:06.170768  6189 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.193799  6189 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.144235  6250 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.195638  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.196095  6640 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:06.197562  6640 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.198030  6640 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.199091  6479 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.200114  6640 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.202054  6600 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:06.134187  6458 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.206681  6458 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:06.208973  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.213099  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:06.219286  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2215) took 1132 ms. Trace:
I20260709 12:59:06.097910  6588 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:06.176017  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.071051  6462 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.185575  6570 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.188069  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.156323  6266 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:06.223382  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:06.223737  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:06.224499  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.144047  1570 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:06.234025  1572 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:06.219729  1565 rpcz_store.cc:276] 0709 12:59:05.086797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.087241 (+   444us) service_pool.cc:224] Handling call
0709 12:59:05.087542 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.352880 (+265338us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:05.464500 (+111620us) log.cc:844] Serialized 14 byte log entry
0709 12:59:05.896271 (+431771us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:05.929764 (+ 33493us) log.cc:844] Serialized 26 byte log entry
0709 12:59:05.929914 (+   150us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:05.929947 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.930039 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:06.219052 (+289013us) raft_consensus.cc:1685] finished
0709 12:59:06.219079 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:06.219224 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35913,"prepare.queue_time_us":112827,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":25704,"raft.queue_time_us":47856,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":4379,"spinlock_wait_cycles":32512,"thread_start_us":522490,"threads_started":2,"wal-append.queue_time_us":661968}
I20260709 12:59:06.250130  1645 raft_consensus.cc:1217] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[11.6-15.8]   Dedup: 11.6->[13.7-15.8]
I20260709 12:59:06.253032  1645 pending_rounds.cc:85] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 6
I20260709 12:59:06.251708  1640 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:59:06.253314  1645 pending_rounds.cc:107] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 12.7
W20260709 12:59:06.250481  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 61743us
I20260709 12:59:06.253645  1645 raft_consensus.cc:2889] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:06.237169  1567 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:06.171657  6550 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:06.143298  6599 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.275931  1567 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
W20260709 12:59:06.273973  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 101397us
I20260709 12:59:06.277588  1686 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:06.291487  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:06.295912  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:06.296576  2349 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:06.237303  6640 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:06.273111  6651 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:06.308497  1535 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:06.315245  1610 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:06.275383  6266 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.329548  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:06.355484  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.257975  6570 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.362610  1535 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:06.320343  6583 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:06.309763  6651 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:06.328725  6624 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:59:06.356521  6601 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:06.330133  6189 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:06.330570  6551 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:06.329850  6587 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:06.356734  6650 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:06.401311  6649 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:59:06.371160  6648 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:59:06.397917  6635 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:06.331229  6291 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:59:06.398686  6189 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.399711  6624 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:06.400764  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44211.6us
I20260709 12:59:06.414819  1535 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:06.401264  6650 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:06.362514  6588 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:06.318943  6640 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.387208  6476 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:06.415061  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 321678us
I20260709 12:59:06.395931  6583 raft_consensus.cc:697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:06.431383  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:06.432607  6660 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:06.433960  6634 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.440378  1647 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:06.443828  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:06.420115  6650 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:06.457382  6560 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:06.385319  6651 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:06.426820  6643 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:06.462107  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.464031  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.473959  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.474427  2345 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:06.475222  1646 raft_consensus.cc:1240] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:06.477818  1644 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 13: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:06.477865  6599 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.479661  6359 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:06.480162  6359 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:06.483943  6586 consensus_meta.cc:287] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.860s	user 0.007s	sys 0.007s
I20260709 12:59:06.484737  1565 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:06.493790  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2214) took 1407 ms. Trace:
I20260709 12:59:06.476637  1612 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:06.495096  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:59:06.495921  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.500622  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.494179  1564 rpcz_store.cc:276] 0709 12:59:05.086500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.104671 (+ 18171us) service_pool.cc:224] Handling call
0709 12:59:05.105155 (+   484us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:05.892735 (+787580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.892779 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:59:05.893589 (+   810us) log.cc:844] Serialized 78 byte log entry
0709 12:59:06.290610 (+397021us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:06.425538 (+134928us) log.cc:844] Serialized 14 byte log entry
0709 12:59:06.439179 (+ 13641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.439341 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:06.493539 (+ 54198us) raft_consensus.cc:1685] finished
0709 12:59:06.493561 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:06.493716 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20723,"raft.queue_time_us":25985,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2529,"spinlock_wait_cycles":14720,"thread_start_us":1164114,"threads_started":3,"wal-append.queue_time_us":460417}
I20260709 12:59:06.501407  1565 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:59:06.504421  6632 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:06.472674  6462 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.506070  6632 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.506454  6632 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:06.507480  6583 consensus_queue.cc:237] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.471431  6643 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:06.508975  6643 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:06.515041  6189 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:06.519287  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.520386  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:06.520978  1684 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:06.521381  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.524447  2349 raft_consensus.cc:2393] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 14: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:59:06.527268  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.530880  1717 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:59:06.463191  6266 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:06.529951  1646 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 12:59:06.536567  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 60043us
W20260709 12:59:06.540062  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 130396us
I20260709 12:59:06.540838  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:06.541975  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.544387  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:06.549389  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.550810  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:06.544184  6462 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:59:06.535305  1535 connection.cc:256] RPC call timeout handler was delayed by -2.1238904030000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 12:59:06.547194  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:06.552758  2312 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:06.555589  6561 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:06.535830  6277 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:06.555817  6462 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:06.556910  6462 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.551759  6389 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:06.561482  6389 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:06.561669  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.562364  1638 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:06.561647  1535 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:06.562382  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:59400
I20260709 12:59:06.563434  1638 raft_consensus.cc:1240] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:06.563632  1568 raft_consensus.cc:606] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:06.563977  1568 raft_consensus.cc:614] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:06.561908  6389 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:06.564885  6189 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:06.565424  6189 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:06.565822  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.566350  6189 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.568575  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.536334  6614 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.569386  6614 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.570005  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.571889  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.572081  1641 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:06.523850  6666 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:59:06.573338  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:06.573683  6389 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.574100  1564 raft_consensus.cc:2410] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:59:06.564914  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:06.577570  2346 raft_consensus.cc:1240] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:06.577723  1565 raft_consensus.cc:2410] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:59:06.576182  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
W20260709 12:59:06.579319  6656 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 0.358s	user 0.002s	sys 0.002s
I20260709 12:59:06.579650  1568 raft_consensus.cc:2393] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 11: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:06.579782  6597 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:06.576894  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.580789  1715 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:59:06.582986  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:06.579588  6389 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:06.584743  6389 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:06.580477  6597 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.585285  6389 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:06.585832  6389 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:06.585557  6550 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.587248  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.568902  1638 raft_consensus.cc:1240] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:59:06.583313  6624 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.587774  1568 raft_consensus.cc:1240] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:59:06.590431  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:06.638533  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:06.639842  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:06.640666  1646 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:06.508543  6584 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.644845  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:06.561578  6573 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:06.663543  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.593058  6417 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:06.671630  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.679594  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:06.678835  1638 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:59:06.586606  6485 consensus_queue.cc:1048] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 12:59:06.676317  6550 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:06.692816  6638 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:59:06.694666  6428 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:06.695155  6428 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.696938  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45038 (request call id 2218) took 1186 ms. Trace:
I20260709 12:59:06.697314  1569 rpcz_store.cc:276] 0709 12:59:05.529367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.536466 (+  7099us) service_pool.cc:224] Handling call
0709 12:59:05.536846 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.537299 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.537341 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:05.537853 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:59:05.880185 (+342332us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:05.880240 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.880306 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:06.696726 (+816420us) raft_consensus.cc:1685] finished
0709 12:59:06.696756 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:06.696881 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70659,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":341937,"threads_started":1,"wal-append.queue_time_us":840970}
I20260709 12:59:06.700069  6584 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:06.671797  6573 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.702687  6573 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:06.703277  6627 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:06.704008  1714 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:06.721470  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.712859  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.723991  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:06.726254  1569 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:06.711724  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.727046  1646 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:06.727355  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.727944  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.728444  1641 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:06.731828  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.732868  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:06.733597  1646 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:06.685918  6597 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:06.789516  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:06.790227  2345 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:06.790242  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 69293.7us
W20260709 12:59:06.721386  6569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.028s	sys 0.053s
I20260709 12:59:06.795228  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.791533  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:06.709728  6614 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.802884  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.804358  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:06.794653  6569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.029s	sys 0.054s
I20260709 12:59:06.807808  1569 raft_consensus.cc:2410] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:59:06.687642  6417 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.816004  6650 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.818661  6650 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:06.819559  6620 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:06.822211  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.822969  1564 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:06.825234  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:06.825922  1642 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:59:06.820039  6620 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:06.840808  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:06.844985  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:06.839336  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 190739us
I20260709 12:59:06.850433  1564 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:06.851105  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:06.854189  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.856138  1646 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:06.858775  1647 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 12:59:06.859833  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.845166  6620 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:06.866412  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:06.869000  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 77615.9us
I20260709 12:59:06.848294  6586 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:06.875613  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:06.880416  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.899849  2349 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:06.903874  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:06.904610  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:06.906353  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.909014  6644 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:06.909401  6644 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:06.903658  6586 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.910212  6644 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:06.913100  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:06.914042  1564 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:06.879091  6428 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:06.960964  6586 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:06.965941  6277 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:06.964529  6389 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:06.971242  6389 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:06.969137  6680 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:59:06.981400  6417 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:06.990978  2345 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
W20260709 12:59:06.991259  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 86537.8us
I20260709 12:59:06.992215  1564 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 12:59:06.992633  1564 pending_rounds.cc:85] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 6
I20260709 12:59:06.920616  6644 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:07.001937  1564 pending_rounds.cc:107] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 12:59:07.002490  1564 raft_consensus.cc:2889] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:06.955257  6614 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:07.004173  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:07.005074  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.009233  2314 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:07.010645  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.046938  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:07.010978  6679 log.cc:927] Time spent T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:59:07.006259  6614 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.960472  6651 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.121766  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.114264  6250 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:07.149178  6250 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.150282  6359 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:07.165536  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.166474  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.167213  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.167640  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:07.168262  1571 raft_consensus.cc:2376] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12. Re-sending same reply.
I20260709 12:59:07.165755  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.168808  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.168965  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:07.169811  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.176347  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:07.178226  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.188961  1568 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:07.177520  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:07.192361  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:07.192782  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:07.193910  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.194414  1643 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:07.143007  6614 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:07.119170  6586 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:07.201876  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:07.208952  1535 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.210500  1535 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.212191  1535 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.213414  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:07.194458  6617 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:07.202279  6417 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.203365  6359 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:07.216754  6550 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:07.225520  6632 consensus_meta.cc:287] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.002s
I20260709 12:59:07.205711  6654 consensus_queue.cc:1059] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:59:07.226841  6617 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:07.238240  2345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:07.238937  2345 raft_consensus.cc:606] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:07.239326  2345 raft_consensus.cc:614] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:07.230284  6417 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.242801  6417 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:07.238343  6617 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:07.257068  6654 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:07.259021  6654 raft_consensus.cc:3055] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:07.259454  6654 raft_consensus.cc:740] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:07.217710  6189 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:07.264071  6674 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.567s	user 0.001s	sys 0.004s
W20260709 12:59:07.278800  6672 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.582s	user 0.003s	sys 0.010s
I20260709 12:59:07.281153  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2271) took 1040 ms. Trace:
I20260709 12:59:07.281682  1645 rpcz_store.cc:276] 0709 12:59:06.241113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.241291 (+   178us) service_pool.cc:224] Handling call
0709 12:59:06.241803 (+   512us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:06.259744 (+ 17941us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:06.291995 (+ 32251us) log.cc:844] Serialized 14 byte log entry
0709 12:59:06.540310 (+248315us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:06.544593 (+  4283us) log.cc:844] Serialized 52 byte log entry
0709 12:59:06.544767 (+   174us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:06.544798 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.544861 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:07.278115 (+733254us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:59:07.280766 (+  2651us) raft_consensus.cc:1685] finished
0709 12:59:07.280893 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:07.281071 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70584,"prepare.queue_time_us":33401,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":72821,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":5605,"spinlock_wait_cycles":36103040,"thread_start_us":162517,"threads_started":1,"wal-append.queue_time_us":349515}
I20260709 12:59:07.236248  6632 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.286931  6632 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.227540  6586 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.312835  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.315016  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59258 (request call id 2255) took 1788 ms. Trace:
I20260709 12:59:07.315544  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.315553  1639 rpcz_store.cc:276] 0709 12:59:05.509431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.509695 (+   264us) service_pool.cc:224] Handling call
0709 12:59:05.573089 (+ 63394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.733130 (+160041us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:05.987719 (+254589us) log.cc:844] Serialized 14 byte log entry
0709 12:59:06.302425 (+314706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:06.302489 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:06.302560 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.512244 (+209684us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b180007b3a0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f6152a6 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419
0709 12:59:07.297655 (+785411us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540040ced4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:07.297725 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:07.297885 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":244062,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":262,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":11757,"spinlock_wait_cycles":377239808,"thread_start_us":567939,"threads_started":2,"wal-append.queue_time_us":437325}
W20260709 12:59:07.298450  6643 consensus_meta.cc:287] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.789s	user 0.007s	sys 0.005s
I20260709 12:59:07.326097  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.326980  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.331933  1569 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 9.
I20260709 12:59:07.330245  1715 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:07.295940  6189 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:07.289152  6550 consensus_queue.cc:1059] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:59:07.337040  2341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59844 (request call id 757) took 1085 ms. Trace:
I20260709 12:59:07.337512  2341 rpcz_store.cc:276] 0709 12:59:06.253733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.261499 (+  7766us) service_pool.cc:224] Handling call
0709 12:59:06.285733 (+ 24234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:06.294064 (+  8331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:06.294105 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:06.304730 (+ 10625us) log.cc:844] Serialized 26 byte log entry
0709 12:59:06.472700 (+167970us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:06.472761 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.472869 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:07.263424 (+790555us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f56dc85 00007f6a3f56e6a2 00007f6a422e01db 00007f6a422dbaaf 00007f6a422cf86e 00007f6a422cebb6 00007f6a422ce7d8 00007f6a422d8221 00007f6a422d81d9 00007f6a422d8169
0709 12:59:07.327605 (+ 64181us) raft_consensus.cc:1685] finished
0709 12:59:07.327635 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:07.335130 (+  7495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14727,"raft.queue_time_us":6213,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4844,"spinlock_wait_cycles":35555072,"thread_start_us":83384,"threads_started":1,"wal-append.queue_time_us":340160}
W20260709 12:59:07.339666  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 137941us
I20260709 12:59:07.345860  1610 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:07.327051  6624 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:07.351302  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.260439  6654 consensus_queue.cc:260] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.354044  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.357674  1716 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:07.358757  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.352631  6695 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:07.364346  6695 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.363536  1719 raft_consensus.cc:2393] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:07.364889  1716 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
W20260709 12:59:07.352480  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 150738us
I20260709 12:59:07.367980  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:07.371101  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.372151  1564 raft_consensus.cc:2410] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:59:07.373317  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.350114  6462 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:59:07.376169  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 164064us
I20260709 12:59:07.334882  6643 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.381191  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.382193  1564 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 9.
I20260709 12:59:07.386204  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.387562  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.363294  6651 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:07.389024  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.392372  1565 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:07.397746  6586 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.398473  6586 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:07.396505  2346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:07.399312  6586 consensus_queue.cc:1059] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:07.399964  2346 raft_consensus.cc:606] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:07.403218  6250 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.391657  1715 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:07.398504  6643 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.376103  6550 raft_consensus.cc:493] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:59:07.406931  6620 consensus_meta.cc:287] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
I20260709 12:59:07.410034  6700 raft_consensus.cc:3055] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:07.411180  6700 raft_consensus.cc:740] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:07.410676  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.412076  6700 consensus_queue.cc:260] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.412953  1572 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:07.410987  1612 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:07.414603  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:07.416960  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.409178  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:07.385584  6654 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:07.417629  6701 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:07.417936  1564 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:07.418402  6701 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:07.418762  6701 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:07.419116  6701 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:07.421029  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.420923  6550 raft_consensus.cc:515] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.421241  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.421669  1572 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:59:07.421873  1571 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 16.
I20260709 12:59:07.423026  6550 leader_election.cc:290] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:07.424319  1565 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:07.410985  6651 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:07.417658  1563 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 14: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:07.362716  6624 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.444964  1564 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
W20260709 12:59:07.451205  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 61505.2us
I20260709 12:59:07.452000  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.456321  2346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3e979717db64b77b569522980fab6af"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:07.409004  6462 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:07.407488  6696 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:07.456935  2346 raft_consensus.cc:606] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.444613  6651 consensus_queue.cc:1243] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer 2af567a273d44ca89d2b3b0f7c815bd1 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:59:07.474680  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 58394.2us
I20260709 12:59:07.475693  1612 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:07.410638  6620 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:07.483029  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.488421  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:07.489194  1718 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:07.461302  6699 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:07.497613  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:59:07.505802  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.463182  6698 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:59:07.512212  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.516999  1717 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:59:07.510710  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:07.465226  6462 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.521234  1720 raft_consensus.cc:2393] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:07.481133  6605 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:07.495281  6696 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:07.523967  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:07.528431  6685 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:07.528904  6685 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.529251  6685 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:07.530421   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:07.506651  6417 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:59:07.533342  6644 consensus_meta.cc:287] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:59:07.535705  6620 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.532563  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:07.537257  1721 raft_consensus.cc:2368] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14.
I20260709 12:59:07.523325  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:07.532861  6417 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.546370  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:07.525061  6699 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.555651  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:07.557489  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:07.566201  1564 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:59:07.515033  6400 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:59:07.579322  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:07.541802  6695 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:07.583359  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:07.587272   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:07.580610  6699 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.590664  6699 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.591670  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:07.593698  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58328 (request call id 803) took 1075 ms. Trace:
W20260709 12:59:07.595541  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 130867us
I20260709 12:59:07.594079  1642 rpcz_store.cc:276] 0709 12:59:06.518329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.518438 (+   109us) service_pool.cc:224] Handling call
0709 12:59:07.593540 (+1075102us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54001d38d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:07.593638 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651083648}
I20260709 12:59:07.598791  1535 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.540153  6605 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:07.606850  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 98180.5us
I20260709 12:59:07.601756  1718 raft_consensus.cc:2468] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 16.
W20260709 12:59:07.621076  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 145475us
I20260709 12:59:07.622452  1612 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:07.623365  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44633.2us
I20260709 12:59:07.623610  6650 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:07.626885  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:59:07.627424  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 45725us
I20260709 12:59:07.630484  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.629331  1612 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:07.636008  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.638908  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:07.627255  6624 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:07.642234  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:07.652498  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:07.632460  6651 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:07.631101  6462 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:59:07.630074  6570 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:07.673709  6570 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:07.674077  6570 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:07.674544  6570 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:07.636860  6400 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.660399  6600 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:07.639283  6705 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:07.649296  6650 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:07.696440  2345 raft_consensus.cc:1240] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:07.661362  6651 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.700055  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:07.700505  6600 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:07.700779  2346 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:07.701297  6600 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:07.709102  6704 log.cc:927] Time spent T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:59:07.709843  6052 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:07.715148  6685 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.693346  6400 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.719712  6400 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:07.720398  6651 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:07.697508  6617 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.716509  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2290) took 1079 ms. Trace:
I20260709 12:59:07.723594  6617 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.723100  1568 rpcz_store.cc:276] 0709 12:59:06.637099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.638181 (+  1082us) service_pool.cc:224] Handling call
0709 12:59:07.716303 (+1078122us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400043654. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:07.716437 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099421568}
I20260709 12:59:07.728936  6417 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:07.697783  6712 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.729941  6712 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.732105  6712 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:07.737488  2346 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:07.742074  6640 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:07.742533  6701 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.743954  2341 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:07.709136  6605 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:07.701777  6600 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.760052  6600 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.763083  6701 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:07.751293  6614 consensus_meta.cc:287] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 12:59:07.763794  6685 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.763981  6614 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:07.755555  6700 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:07.770289  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 140859us
I20260709 12:59:07.777261  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59270 (request call id 2151) took 1240 ms. Trace:
I20260709 12:59:07.768028  6570 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.777631  1647 rpcz_store.cc:276] 0709 12:59:06.537091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.562089 (+ 24998us) service_pool.cc:224] Handling call
0709 12:59:06.562375 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:06.859257 (+296882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:07.777028 (+917771us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400336154. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:07.777202 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681096960}
I20260709 12:59:07.787670  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:59:07.791846  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 155908us
W20260709 12:59:07.797299  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 166913us
I20260709 12:59:07.801237  2314 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:07.799983  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:07.848815  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.846596  6476 raft_consensus.cc:2804] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:07.877481  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:07.810730  6605 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:07.879256  1718 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:07.928340  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.879869  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:59:07.934948  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 55181.6us
I20260709 12:59:07.963586  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:07.969617  6476 raft_consensus.cc:697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:07.970616  1718 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:59:07.974815  6651 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:07.957896  6277 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:07.975914  6614 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:07.979038  2346 raft_consensus.cc:1240] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:07.981952  2314 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:07.881706  6605 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:07.958125  6718 raft_consensus.cc:993] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:07.995186  1716 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:07.994447  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 111930us
I20260709 12:59:07.998411  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:07.999094  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:08.004494  1610 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:59:08.006681  6721 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:59:08.006628  6570 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:08.006623  6189 raft_consensus.cc:3055] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:08.007846  6189 raft_consensus.cc:740] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:08.008028  6651 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:08.008953  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:08.004149  6720 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:08.010493  6651 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:08.011113  6651 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:08.008854  6189 consensus_queue.cc:260] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.012717  6614 raft_consensus.cc:1081] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Signalling peer 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:08.013192  6189 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:07.995340  6266 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:08.014895  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:08.003355  6727 consensus_queue.cc:1059] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:59:08.018936  6266 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.018728  6476 consensus_queue.cc:237] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.021327  6266 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:08.002750  6605 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:07.999243  6277 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:08.026840  6277 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:08.037470  6570 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:08.043630  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.042531  6570 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.076186  6570 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:08.018747  6727 raft_consensus.cc:3055] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:08.083519  6642 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:08.084144  6642 raft_consensus.cc:697] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:08.085186  6642 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.037330  6400 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 12:59:08.088785  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 45232.5us
I20260709 12:59:08.088940  2346 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:08.089986  6400 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:08.091847  6597 raft_consensus.cc:3055] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:08.092269  6597 raft_consensus.cc:740] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:08.093079  6597 consensus_queue.cc:260] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.093752  1612 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.094974  1612 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.095422  6266 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:08.096092  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:08.097774  6701 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:08.098628  6701 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:08.098933  6701 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:08.099704  6701 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.105903  6573 consensus_queue.cc:1059] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:08.096124  6266 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:08.083542  6727 raft_consensus.cc:740] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:08.109184  6727 consensus_queue.cc:260] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.110448  6727 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:08.113850  6266 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:08.114288  6696 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:08.116150  6701 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:08.014034  6651 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.134145  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:08.141705  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:59:08.150177  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.151371  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:08.152572  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.074373  2314 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.154204  6698 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:08.153352  6266 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:08.167115  6605 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.154827  1719 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:08.154743  6600 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:08.171326  6720 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:08.156693  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:08.153678  6696 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:08.142437  6570 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:08.162467  1565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2289) took 1573 ms (client timeout 1700 ms). Trace:
W20260709 12:59:08.173454  1565 rpcz_store.cc:269] 0709 12:59:06.590066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.590159 (+    93us) service_pool.cc:224] Handling call
0709 12:59:08.162274 (+1572115us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54001a8954. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:08.162395 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834880896}
I20260709 12:59:08.176285  6605 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:08.164636  1716 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:08.165829  6640 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:08.176398  6627 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:08.180604  6640 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:08.181078  6627 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.181557  6640 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:08.181926  6640 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:08.182904  6640 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.170387  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:59:08.170614  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 96353.8us
I20260709 12:59:08.184393  6675 raft_consensus.cc:993] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:59:08.193459  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:08.163923  6359 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:08.199361  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:08.202142  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:08.202718  1715 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:08.205302  1716 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:08.207495  6699 raft_consensus.cc:493] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:08.208011  6699 raft_consensus.cc:515] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.210883  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:08.211442  1714 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:08.214439  6699 leader_election.cc:290] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:08.215432  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 616860us
I20260709 12:59:08.187369  6640 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:08.216253  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 617508us
I20260709 12:59:08.222527  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:08.219962  1714 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:08.221479  1537 leader_election.cc:400] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14.
I20260709 12:59:08.225008  1537 leader_election.cc:403] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:59:08.227224  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:08.230574  2314 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:08.231808  1717 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:59:08.217864  6632 raft_consensus.cc:1081] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:59:08.240316  6400 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:08.232784  6550 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:08.242792  6627 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:08.236904  6716 raft_consensus.cc:2804] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:08.243716  6716 raft_consensus.cc:697] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:08.243827  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:08.246572  1535 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.247749  1535 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.248225  6597 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:08.249619  6624 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:08.250355  6624 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:08.250954  6624 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14.
I20260709 12:59:08.251573  6586 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:08.252074  6586 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.252558  6706 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:08.252764  6707 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:08.253118  6706 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.253319  6707 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.254217  6586 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:08.255260  6706 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:08.255431  6707 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:08.257457  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:08.258594  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:08.248287  6643 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:08.259449  1647 raft_consensus.cc:2410] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:59:08.245728  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.264474  1719 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 16. Current term is 17. Ops: [16.7-16.7]
I20260709 12:59:08.263718  1714 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:08.267490  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.268039  1564 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:08.263023  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:08.262744  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:08.269073  1566 raft_consensus.cc:2410] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 15 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:59:08.269251  1568 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:08.261447  1535 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.270100  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.270601  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.273698  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:08.275900  1612 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.270602  1568 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:08.279254  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.279845  1639 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:59:08.281638  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:08.234129  6570 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:08.283627  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.286259  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:08.287231  1640 raft_consensus.cc:1240] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:59:08.287757  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.266610  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.300366  1563 raft_consensus.cc:3060] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:59:08.288389  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.301033  1643 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:08.296171  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.312582  1568 raft_consensus.cc:2468] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:59:08.314519  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46fb86b9f3304b99a092fa35dffe1813" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:08.315487  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:08.320452  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.320544  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:08.316092  1572 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:08.326611  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.306367  6600 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:08.300868  6624 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:08.334712  2346 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:08.337235  1714 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:08.338470  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.339138  1641 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:59:08.345849  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.349721  6699 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.350268  6699 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.352232  6699 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:08.288314  1642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3e979717db64b77b569522980fab6af"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58328
I20260709 12:59:08.357194  1642 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.357607  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:08.357646  1642 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:08.360771  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:08.260911  6550 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:08.361944  6550 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.260332  6266 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:08.368978  6266 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.371445  6266 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:08.301012  6359 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:08.357209  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:08.321623  1712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:59:08.384057  1712 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.384553  1712 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:08.384394  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3fcdecc7546fe92075e15e904c331" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:08.372255  6727 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.364573  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.388531  1570 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:08.368422  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.390218  1566 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:08.235685  6277 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.295218  6707 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:08.415417  1535 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.420137  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:08.420754  1535 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.416204  1567 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:08.422722  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:08.424077  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.417382  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.303536  6643 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:08.431293  1535 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.433363  1567 raft_consensus.cc:2368] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12.
I20260709 12:59:08.433297  1612 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:08.436661  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.438683  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:08.434368  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.440812  1645 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:08.437477  1567 raft_consensus.cc:2376] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13. Re-sending same reply.
I20260709 12:59:08.364567  6550 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:08.443925  1686 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:08.481637  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.483225  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.482754  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:08.418247  6719 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.244603  6716 consensus_queue.cc:237] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:08.496270  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 57683.8us
I20260709 12:59:08.496728  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.497776  1567 raft_consensus.cc:2410] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:59:08.498517  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.499228  1572 raft_consensus.cc:2376] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14. Re-sending same reply.
I20260709 12:59:08.503746  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:08.504954  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 73728.2us
I20260709 12:59:08.505618  1715 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:59:08.507992  1564 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:59:08.510489  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:08.511931  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.445240  6189 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:08.444518  6568 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:08.532858  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:08.533783  1564 raft_consensus.cc:3060] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:08.514271  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:08.520054  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:08.528913  1612 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.533980  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:08.510210  2314 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.453044  6266 raft_consensus.cc:2804] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:08.539275  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:08.418574  6696 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:59:08.414757  6727 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.481105  6624 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:08.540592  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.496400  6642 raft_consensus.cc:2804] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:08.560601  1535 leader_election.cc:304] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.493460  6698 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:08.452800  6651 consensus_queue.cc:1059] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:59:08.453181  6600 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:59:08.562981  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:08.567677  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 57547us
I20260709 12:59:08.580688  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.564116  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.495641  6570 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:08.581390  1638 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:08.581637  6570 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.582103  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:08.582197  6570 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:08.584215  1572 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:08.571933  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.526713  1642 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.572141  1564 raft_consensus.cc:2468] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:08.491298  6359 consensus_queue.cc:1059] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:59:08.482556  6699 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:59:08.590580  1645 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:08.587230  1564 pending_rounds.cc:85] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 6
I20260709 12:59:08.541177  6568 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:08.594000  1564 pending_rounds.cc:107] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:59:08.594480  1564 raft_consensus.cc:2889] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:08.594614  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.594079  1572 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:08.596493  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:08.565110  6706 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:08.605690  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:08.607259  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.610975  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:08.566424  6701 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:08.513676  6719 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.579105  6189 raft_consensus.cc:2749] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:08.555094  6695 consensus_queue.cc:1059] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:59:08.586499  6675 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:08.621111  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:08.611421  6706 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:08.599692  6568 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:08.630860  1719 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:59:08.631953  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 122394us
I20260709 12:59:08.632985  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:08.637667  6695 raft_consensus.cc:3055] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:08.638078  6695 raft_consensus.cc:740] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:08.638906  6695 consensus_queue.cc:260] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.639696  6277 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:08.640039  6695 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:08.631839  6706 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:08.614280  6687 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:08.654058  1563 raft_consensus.cc:2468] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:08.645421  1642 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:08.590397  6724 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:59:08.643488   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:08.662660  1563 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 12:59:08.664400  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:08.665170  2341 raft_consensus.cc:3055] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:08.665446  2341 raft_consensus.cc:740] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:08.666442  1563 raft_consensus.cc:1240] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:08.622023  6703 consensus_queue.cc:1059] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:59:08.649477  6675 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:08.659324  6700 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:08.659605  6687 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:08.650600  6717 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:59:08.704413  6642 raft_consensus.cc:697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:08.612757  6643 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:08.641997  6710 consensus_queue.cc:1175] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" responder_term: 8 status { last_received { term: 8 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 8 index: 10 } }
W20260709 12:59:08.707643  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 139893us
I20260709 12:59:08.698258  6703 consensus_queue.cc:1243] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer c05ea12435084ad9b281ed3a0a2ecebe log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:59:08.735478  1563 raft_consensus.cc:3055] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:08.736824  1563 raft_consensus.cc:740] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:08.733652  6727 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:08.739729  6727 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:08.740100  6727 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:08.740460  6727 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:08.745841  2345 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:59:08.750420  1712 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:08.754595  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 121696us
I20260709 12:59:08.755631  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:08.738310  1563 consensus_queue.cc:260] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:08.755314  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 176507us
I20260709 12:59:08.757915  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:08.763067  1535 leader_election.cc:304] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.764607  1712 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:08.767177  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:08.767849  2345 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:08.767745  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:08.766788  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:08.769140  1612 leader_election.cc:400] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12.
I20260709 12:59:08.768390  2345 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:08.776376  1612 leader_election.cc:403] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:59:08.778851  1566 raft_consensus.cc:2468] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 17.
I20260709 12:59:08.780865  1572 raft_consensus.cc:1240] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 16. Current term is 17. Ops: [16.7-16.7]
I20260709 12:59:08.760344  6359 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:08.760968  6189 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:08.804929  2345 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.811287  2345 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:08.773412  6624 raft_consensus.cc:2749] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:08.821071  1570 raft_consensus.cc:2468] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:59:08.827931  1567 raft_consensus.cc:1240] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: []
W20260709 12:59:08.823369  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 54391.6us
I20260709 12:59:08.766327  6266 raft_consensus.cc:697] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:08.759671  6570 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.833345  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:08.834969  6600 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:08.808959  6189 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:59:08.836109  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 69394.3us
W20260709 12:59:08.828632  6597 consensus_meta.cc:287] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 12:59:08.814384  6719 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:08.836912  1535 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.830319  6745 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 11. Current term is 12.
I20260709 12:59:08.850256  2345 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 17.
I20260709 12:59:08.853561  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
W20260709 12:59:08.864401  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 51885.5us
I20260709 12:59:08.865705  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:59:08.870515  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.872568  1718 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:08.766439  6687 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.891927  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:08.837920  6189 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:08.810245  6642 consensus_queue.cc:237] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:08.890589  6731 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:59:08.910548  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:08.921573  6734 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:59:08.921492  6570 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:08.922557  6735 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:59:08.799494  6675 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:08.865468  6600 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:08.938987  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:08.934572  1684 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:08.931524  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.899295  6745 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.940730  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:08.947389  1638 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:08.900513  6712 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:08.936905  6719 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:08.961799  6696 raft_consensus.cc:3055] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:08.962327  6696 raft_consensus.cc:740] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:08.963213  6696 consensus_queue.cc:260] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.966606  6701 raft_consensus.cc:3055] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:08.967020  6701 raft_consensus.cc:740] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:08.967868  6701 consensus_queue.cc:260] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:08.972410  6701 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:08.968753  6277 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:08.964493  6696 raft_consensus.cc:3060] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:08.979432  6753 log.cc:927] Time spent T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:59:08.985713  6742 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:08.988993  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:59:08.994398  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 140938us
I20260709 12:59:08.995169  1535 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.935151  6359 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:08.996519  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:08.996662  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.003202  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 49798.3us
I20260709 12:59:09.008064  1684 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.899425  6741 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:59:09.003998  6719 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:09.003890  6712 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:09.036331  6719 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.037614  6712 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.038674  6719 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:09.039333  6724 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:09.040616  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:09.041489  6743 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:59:09.042826  6748 log.cc:927] Time spent T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:59:09.044137  6642 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:09.044901  6642 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:08.998510  6751 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.046669  6698 raft_consensus.cc:3055] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:08.932363  6266 consensus_queue.cc:237] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:09.082552  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 143322us
W20260709 12:59:09.084633  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.126825  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 129045us
I20260709 12:59:09.127646  1535 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:08.961793  6600 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.079159  6698 raft_consensus.cc:740] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:09.079653  6756 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:08.988499  6745 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.073333  6760 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:09.132862  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.083875  6729 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:09.128844  2341 consensus_queue.cc:260] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.138142  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:09.142892  6744 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:09.161970  2341 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:09.161895  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:09.163793  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:09.133215  6400 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:09.164915  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:09.165378  6640 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:09.166100  6640 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:09.162268  2345 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:09.167126  1643 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:59:09.129277  6757 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:09.164989  6400 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.168356  1640 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:09.198596  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:09.198951  1535 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:09.199260  1571 raft_consensus.cc:3060] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:09.200179  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.201062  1564 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:09.137334  6756 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:09.210146  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.080899  6751 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.216619  2341 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:09.218284  1610 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:09.166041  1612 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:09.166846  6640 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:09.136296  6359 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
W20260709 12:59:09.228971  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 62988.6us
W20260709 12:59:09.239614  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 190119us
W20260709 12:59:09.232256  6568 consensus_meta.cc:287] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
I20260709 12:59:09.212296  6745 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.240089  1686 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:09.211663  6756 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:09.243767  6755 raft_consensus.cc:2749] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:09.224314  6742 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:09.246618  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.236300  6744 raft_consensus.cc:2804] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:09.168300  6729 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.245810  6643 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:09.268821  6744 raft_consensus.cc:697] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:09.272420  1571 raft_consensus.cc:2468] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:09.239087  6651 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:59:09.223618  6698 consensus_queue.cc:260] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:09.295418  6746 log.cc:927] Time spent T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:59:09.249095  6568 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.280825  6752 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:09.284453  6724 raft_consensus.cc:2804] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:59:09.305104  6695 consensus_meta.cc:287] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.001s
W20260709 12:59:09.309319  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 110465us
I20260709 12:59:09.357543  1638 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 17.
W20260709 12:59:09.360811  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 113260us
I20260709 12:59:09.406867  6189 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.407195  1686 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:09.408599  6729 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.409174  6729 raft_consensus.cc:2804] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:59:09.409637  6769 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.002s
I20260709 12:59:09.409684  6729 raft_consensus.cc:697] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:09.380743  6744 consensus_queue.cc:237] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.411125  6729 consensus_queue.cc:237] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.415429  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.417143  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:09.417806  1570 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:09.402979  6773 consensus_queue.cc:1059] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:09.403749  6643 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:09.403837  6695 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:59:09.403825  6706 consensus_meta.cc:287] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.763s	user 0.005s	sys 0.008s
I20260709 12:59:09.404458  6771 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.405360  6724 raft_consensus.cc:697] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:09.437429  6765 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:09.438127  6765 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.438251  6724 consensus_queue.cc:237] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.409108  6751 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.432852  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.432798  6695 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.433143  6777 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:09.433430  6643 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.434824  6773 raft_consensus.cc:3055] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:09.436425  6417 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.436256  6706 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.439994  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.441812  1715 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:09.449970  1570 raft_consensus.cc:2468] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:59:09.451768  1717 raft_consensus.cc:1240] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 12:59:09.451758  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 217816us
I20260709 12:59:09.442974  6771 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.443142  6757 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.515659  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:59:09.506577  2315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.477149  6695 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.451975  6777 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.517975  6757 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.512519  1564 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
W20260709 12:59:09.461793  6761 log.cc:927] Time spent T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.452s	user 0.002s	sys 0.000s
I20260709 12:59:09.452163  6773 raft_consensus.cc:740] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:09.507045  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:09.521270  6757 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.521680  6773 consensus_queue.cc:260] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.522161  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.456033  6400 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:09.520730  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.522958  1718 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:09.457949  2345 raft_consensus.cc:1240] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:09.500541  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.523993  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.473374  6417 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.467337  6752 consensus_queue.cc:1059] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:59:09.460116  6568 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.525161  1537 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:09.522765  6773 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:09.527056  1567 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:09.527964  6758 log.cc:927] Time spent T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.287s	user 0.010s	sys 0.000s
W20260709 12:59:09.528844  6764 log.cc:927] Time spent T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.292s	user 0.004s	sys 0.006s
I20260709 12:59:09.531945  6643 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.533000  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:09.511534  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:59:09.525861  6727 consensus_meta.cc:287] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.004s
I20260709 12:59:09.540761  6727 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.542886  6727 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.544677  6706 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.546775  6777 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.550474  6756 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.551630  1572 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:09.552862  6693 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.553584  6756 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.553375  6693 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.555553  6693 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:09.556900  6651 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:09.557323  6651 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.557650  6651 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:09.526684  1537 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:09.558836  6755 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:09.559223  6755 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.559561  6755 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:09.561353  6266 raft_consensus.cc:3055] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:09.561729  6266 raft_consensus.cc:740] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:09.562633  6266 consensus_queue.cc:260] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.563580  6266 raft_consensus.cc:3060] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:09.565421  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.566228  1718 raft_consensus.cc:2410] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:09.568037  1717 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 12:59:09.568356  1717 pending_rounds.cc:85] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 5
I20260709 12:59:09.568573  1717 pending_rounds.cc:107] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 12:59:09.568850  1717 raft_consensus.cc:2889] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:09.570257  6762 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.570955  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:09.570792  6762 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.572165  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:09.573515  6762 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.584964  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.585636  1570 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:09.586925  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:09.475889  6768 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.464986  6277 raft_consensus.cc:493] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:09.594197  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.595217  1719 raft_consensus.cc:1240] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:09.597186  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.598774  1716 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:09.600425  6644 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.600919  6644 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.602135  1686 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:09.602942  6400 raft_consensus.cc:2804] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:09.603027  6644 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.599995  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.604425  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.604718  1716 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:59:09.605731  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.457250  6189 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.608429  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:09.609066  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:09.610095  1721 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:59:09.456039  6765 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:09.514161  6771 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.612097  1568 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:09.621215  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.613864  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.623009  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:09.533398  6696 consensus_queue.cc:1059] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:59:09.603533  6400 raft_consensus.cc:697] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:09.618279  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.619271  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.557339  6757 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:09.624993  1566 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:09.625747  1717 raft_consensus.cc:1240] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:09.628906  1720 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:09.604089  6417 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:09.631577  6400 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.624612  6643 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:09.635056  6643 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.610765  6277 raft_consensus.cc:515] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.635504  6643 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:09.637364  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.597576  6756 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:09.647795  6277 leader_election.cc:290] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.649071  6277 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.597137  6768 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.654671  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.655544  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:59:09.675701  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 82708.1us
I20260709 12:59:09.678625  1638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57522
I20260709 12:59:09.679333  1638 raft_consensus.cc:606] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Received request to transfer leadership
I20260709 12:59:09.679746  1638 raft_consensus.cc:614] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:09.681406  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.683935  6417 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:09.684796  6417 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:09.686313  6651 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.687539  1565 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:09.689275  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.706286  1566 raft_consensus.cc:1240] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:09.699455  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:09.707973  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:09.711068  1646 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 12:59:09.717792  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:09.718029  1570 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:09.720428  6744 consensus_queue.cc:1059] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:09.721529  6696 raft_consensus.cc:3055] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:09.721899  6696 raft_consensus.cc:740] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:09.722846  6768 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.722713  6696 consensus_queue.cc:260] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.723994  6696 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:09.713881  6752 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:09.724953  6752 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.725266  6752 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:09.669802  6277 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.735522  1612 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:09.735488  1566 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:59:09.712690  6266 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:09.750151  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:09.751710  1720 raft_consensus.cc:2376] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14. Re-sending same reply.
I20260709 12:59:09.743768  6778 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:09.756235  6778 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.756573  6778 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:09.718050  6600 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:59:09.694509  6755 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.766224  6755 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.775651  6651 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.776793  6751 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:09.781338  6605 consensus_queue.cc:1059] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:09.782401  6776 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.378s	user 0.000s	sys 0.002s
I20260709 12:59:09.784080  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 783) took 1132 ms. Trace:
I20260709 12:59:09.784464  1715 rpcz_store.cc:276] 0709 12:59:08.651322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.651778 (+   456us) service_pool.cc:224] Handling call
0709 12:59:08.652046 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:09.453395 (+801349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:09.783876 (+330481us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54002c2ed4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a42734e01 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4 00007f6a40c6fb62 00007f6a40c6fa91 00007f6a40c6fa0c 00007f6a40c6ecc2 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:09.784026 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815814400}
I20260709 12:59:09.785604  6707 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:09.786103  6707 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.788077  6707 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.789811  1563 raft_consensus.cc:3060] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:09.791736  6727 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.792201  6727 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.793332  6277 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.794219  6727 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.796988  6643 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.798377  6630 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:09.818854  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.819485  1564 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:09.799302  6752 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.821786  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.822394  1645 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:09.822516  6752 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.823072  6752 raft_consensus.cc:493] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:09.823203  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.823776  1645 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:59:09.823529  6752 raft_consensus.cc:515] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.799957  6755 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.825073  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:09.824949  6755 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.825693  2341 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:09.825839  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.802000  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.826459  1638 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:09.826889  1639 raft_consensus.cc:2393] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 14: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:09.827245  6755 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.827289  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.827659  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:09.827950  1638 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 17.
I20260709 12:59:09.828807  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:09.829797  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.824525  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.830518  1639 raft_consensus.cc:2393] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 15: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:09.803356  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.831208  1640 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:09.804701  6744 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:09.832237  6744 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:09.834458  6744 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.834966  1535 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:09.802587  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.835777  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:09.804811  6745 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:09.836292  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:09.782441  6605 raft_consensus.cc:3055] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:09.812136  1647 raft_consensus.cc:1240] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:09.813213  1643 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:09.808811  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:09.816845  1644 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:09.807371  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:09.814376  6698 raft_consensus.cc:3060] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:09.830590  1568 raft_consensus.cc:2393] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:09.836498  6700 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:09.818168  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.817425  1686 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:09.888335  1712 raft_consensus.cc:1275] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:09.940802  1470 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.849790  6763 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:09.833325  6643 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:09.891324  6561 consensus_queue.cc:1059] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:59:09.836939  6745 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.892416  1720 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:09.950381  6700 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.906045  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:09.951237  1641 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:09.859154  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:09.952476  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.952732  6605 raft_consensus.cc:740] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:09.953212  1641 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 8.
I20260709 12:59:09.953694  6605 consensus_queue.cc:260] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.820600  1564 raft_consensus.cc:1275] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:59:09.954830  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 137484us
I20260709 12:59:09.955749  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:09.923942  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.957199  1721 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 12.
I20260709 12:59:09.840144  2345 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:59:09.859747  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:09.958436  1647 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:09.847506  1535 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:09.925047  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:09.840562  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:09.938706  6744 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.951313  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:09.955646  6772 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:09.895812  1565 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:59:09.976022  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 128610us
I20260709 12:59:09.836359  1642 raft_consensus.cc:2393] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:09.858765  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:09.977219  2342 raft_consensus.cc:2393] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 13: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:59:09.946177  1638 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:09.932785  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:09.900738  2343 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:09.947373  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.869333  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:09.865016  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:09.844801  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 89561.3us
I20260709 12:59:09.979247  1644 raft_consensus.cc:2410] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:59:09.963330  2346 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 9.
I20260709 12:59:09.839742  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:09.980443  1640 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 8.
I20260709 12:59:09.965751  1610 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:09.948764  6763 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:09.975118  1643 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:09.912221  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:09.959378  1570 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 9.
I20260709 12:59:09.977034  1535 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:09.962168  1563 raft_consensus.cc:1275] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:59:09.983896  1563 pending_rounds.cc:85] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 10
I20260709 12:59:09.984213  1563 pending_rounds.cc:107] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:59:09.984566  1563 raft_consensus.cc:2889] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:09.985304  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53576 (request call id 885) took 1288 ms. Trace:
I20260709 12:59:09.985925  1563 rpcz_store.cc:276] 0709 12:59:08.697265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.734985 (+ 37720us) service_pool.cc:224] Handling call
0709 12:59:08.735338 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:09.789234 (+1053896us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b58005564d0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a426900aa 00007f6a42712447 00007f6a4272afe7 00007f6a4272c7de 00007f6a42736b49 00007f6a42737416 00007f6a42733d8f 00007f6a4273383e 00007f6a476f8419 00007f6a40c6fbd4
0709 12:59:09.985092 (+195858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:09.985253 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532572416}
I20260709 12:59:09.974396  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:09.998499  1643 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:09.999811  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:10.000385  1716 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:09.985137  1535 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:09.950896  6700 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:09.810154  6778 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:09.899714  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061154c4edb1414ca27eef7f6a49a794" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:09.929929  6752 leader_election.cc:290] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:09.974895  6759 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:59:10.022387  6797 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.169s	user 0.000s	sys 0.008s
W20260709 12:59:10.022614  6799 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.150s	user 0.003s	sys 0.004s
I20260709 12:59:09.992383  6744 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:10.179647  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 267529us
W20260709 12:59:10.177421  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 173192us
I20260709 12:59:10.003417  6763 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:09.954834  6605 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:10.185890  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58424 (request call id 233) took 19831 ms (client timeout 15000 ms). Trace:
I20260709 12:59:09.983469  6643 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:09.874320  6747 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:09.993600  6773 raft_consensus.cc:2749] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:09.844929  6701 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.168s
I20260709 12:59:10.011476  6696 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:59:10.005549  6727 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:10.206303  1639 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:59:10.206794  1639 pending_rounds.cc:85] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 10
I20260709 12:59:09.949847  6561 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:10.164479  1638 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:59:10.207096  1639 pending_rounds.cc:107] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:59:10.207463  1639 raft_consensus.cc:2889] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:10.171124  1537 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:10.172166  2313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:10.173099  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 188059us
I20260709 12:59:10.210052  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:10.173938  6759 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:10.175655  6359 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.173683  1716 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:10.062161  6687 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:10.176406  1470 catalog_manager.cc:5697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 5 to 10, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 10 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.190071  6644 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:10.235498  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:10.236756  1535 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:10.238539  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:10.235647  1537 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
W20260709 12:59:10.189299  1469 rpcz_store.cc:269] 0709 12:58:50.332433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.332797 (+   364us) service_pool.cc:224] Handling call
0709 12:58:51.926858 (+1594061us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b54001c0610. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f60fe9c 00007f6a3f6100f6 00007f6a48589a89 00007f6a48521da6 00007f6a484f3088 00007f6a485f137e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc
0709 12:59:10.094552 (+18167694us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:05.588659 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:05.589310 (+   651us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:05.589362 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:59:05.589378 (+    16us) tablet.cc:662] Decoding operations
0709 12:59:05.591553 (+  2175us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:05.591647 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:05.591676 (+    29us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:59:05.718810 (+127134us) tablet.cc:701] Row locks acquired
0709 12:59:05.720957 (+  2147us) write_op.cc:260] PREPARE: finished
0709 12:59:05.724627 (+  3670us) write_op.cc:270] Start()
0709 12:59:05.724844 (+   217us) write_op.cc:276] Timestamp: P: 1783601945724553 usec, L: 0
0709 12:59:05.724882 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:59:05.725586 (+   704us) log.cc:844] Serialized 10692 byte log entry
0709 12:59:06.808851 (+1083265us) op_driver.cc:464] REPLICATION: finished
0709 12:59:07.286049 (+477198us) write_op.cc:301] APPLY: starting
0709 12:59:07.286152 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:07.536274 (+250122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:07.536431 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:07.732250 (+195819us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a4273132a 00007f6a426b6f14 00007f6a426b6ec3 00007f6a426b6e38 00007f6a426b6df3 00007f6a426b60dc 00007f6a426dfe16 00007f6a426c7cbb 00007f6a426b239d 00007f6a426b5d75
0709 12:59:07.736839 (+  4589us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18001a3da0. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4850fde1 00007f6a4851c5b1 00007f6a3f647522 00007f6a3f6497c1 00007f6a3f649779 00007f6a3f649709 00007f6a3f6496d1 00007f6a3f6489cd 000000000038f354 000000000038f199 00007f6a3f62a83a
0709 12:59:08.136378 (+399539us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:08.136809 (+   431us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0709 12:59:08.153236 (+ 16427us) write_op.cc:312] APPLY: finished
0709 12:59:08.158061 (+  4825us) log.cc:844] Serialized 236 byte log entry
0709 12:59:08.242556 (+ 84495us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.242803 (+   247us) write_op.cc:454] Released schema lock
0709 12:59:08.242900 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:08.243463 (+   563us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.245663 (+  2200us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":617557,"reported_tablets":51,"spinlock_wait_cycles":7380480,"child_traces":[["op",{"apply.queue_time_us":392038,"apply.run_cpu_time_us":61403,"apply.run_wall_time_us":957404,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117095,"num_ops":27,"prepare.queue_time_us":551626,"prepare.run_cpu_time_us":129490,"prepare.run_wall_time_us":509670,"raft.queue_time_us":106609,"raft.run_cpu_time_us":54665,"raft.run_wall_time_us":1032218,"replication_time_us":1066831,"spinlock_wait_cycles":89984512,"thread_start_us":831754,"threads_started":5,"wal-append.queue_time_us":655491,"wal-append.run_cpu_time_us":13427,"wal-append.run_wall_time_us":2492191}]]}
W20260709 12:59:10.247216  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 56764.5us
I20260709 12:59:10.249356  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:10.251384  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 45993.9us
I20260709 12:59:10.184228  6757 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:10.193346  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:10.193533  1719 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 LEADER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:09.982615  6772 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:10.208505  6561 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:59:10.010908  6550 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:59:10.180879  6752 raft_consensus.cc:493] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:10.246855  6768 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:10.257479  6799 log.cc:927] Time spent T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:59:10.263237  6773 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:10.264878  6643 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:10.208671  6727 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.216882  6759 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:10.212375  6756 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:10.246989  6742 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:10.200896  6675 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 12:59:10.275094  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.272512  6772 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:10.246248  6359 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.274783  6685 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.293148  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:10.217931  6687 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.205523  6747 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.278820  6712 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:10.285781  6644 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:10.285573  6768 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.286198  6727 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:10.312574  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 114446us
I20260709 12:59:10.305581  6685 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.321923  6685 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:10.323400  6744 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:10.324117  6359 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:10.325162  6801 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:10.293335  6742 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.328737  6742 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:10.285813  6752 raft_consensus.cc:515] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.302263  6687 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.329104  6745 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:10.305425  6712 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:10.333441  6712 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.336109  6752 leader_election.cc:290] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:10.316756  6768 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.340916  6561 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.342195  6561 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:10.345963  6747 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:10.347388  6687 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:10.350920  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 57864.8us
I20260709 12:59:10.356480  6778 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:10.356603  6027 consensus_queue.cc:1048] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:10.361980  1535 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:10.366305  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:10.367130  1638 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:59:10.372928  1639 raft_consensus.cc:1240] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:10.306010  6765 consensus_queue.cc:1059] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:59:10.375844  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:10.376200  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.374636  1535 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:10.381311  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:10.382174  1639 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:59:10.358769  6747 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:10.392958  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:10.349745  6724 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:10.401479  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:10.402422  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:10.402928  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.355165  6700 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.403494  1717 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:10.405493  1720 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:10.358479  6781 consensus_queue.cc:1059] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:59:10.415079  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccb6bb6402c4cdf9f065c72d521dc44" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.397605  6752 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.415962  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.384474  6266 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.377030  6755 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.376003  6742 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:10.417883  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:10.421015  1720 raft_consensus.cc:3060] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:10.395797  6747 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:10.407675  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:10.418725  1715 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:10.418648  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.400354  6573 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:10.412196  6802 log.cc:927] Time spent T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:59:10.434309  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 167950us
W20260709 12:59:10.435144  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 56537.5us
I20260709 12:59:10.397140  6810 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:59:10.441581  1569 raft_consensus.cc:1240] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:10.443272  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 161262us
I20260709 12:59:10.444214  1612 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:10.449046  1566 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:59:10.450086  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 51710.2us
I20260709 12:59:10.450207  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:10.451604  6643 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:10.452615  6643 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.455039  6687 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:10.424410  6685 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.426877  6747 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:10.458189  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:10.463274  1720 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:10.431794  6573 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.468053  6700 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:10.468770  6700 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:10.469161  6700 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:10.469513  6700 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:10.472668  6763 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.474009  1565 raft_consensus.cc:1240] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:10.474942  6763 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:10.475517  6763 consensus_queue.cc:1059] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:10.428233  6811 consensus_queue.cc:1048] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:59:10.427287  6755 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.480290  6755 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:10.427229  6742 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:10.429567  6614 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.482299  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.484448  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:10.484967  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:10.485186  1639 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:10.486241  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:59:10.490213  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46105us
I20260709 12:59:10.491590  1612 leader_election.cc:304] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:10.492448  6696 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:10.493032  6359 raft_consensus.cc:2749] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:10.494597  1612 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:10.495536  6696 consensus_queue.cc:1059] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:10.496421  6696 consensus_queue.cc:1243] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer 20c9ad12e0d0435f95be2eda5b653b39 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:10.496990  6696 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:10.497707  6696 raft_consensus.cc:3055] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:10.498097  6696 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:10.499163  6696 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.500926  6696 raft_consensus.cc:3060] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:10.505829  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:10.507372  1721 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 11: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:10.510701  1571 raft_consensus.cc:1240] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:10.424680  6266 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.512714  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:10.513345  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.513899  1716 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:10.512739  1684 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:10.515415  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:10.515961  1564 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:10.518546  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.519107  1716 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:10.522591  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.524748  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:10.527341  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9bedf7aba45139d86ca314258a105" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:59:10.530529  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 117310us
I20260709 12:59:10.532181  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:10.424835  6752 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.481418  6685 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.533681  1646 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:10.530541  1564 raft_consensus.cc:1275] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:59:10.534451  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:10.506094  6781 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:10.457094  6675 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:59:10.538115  1612 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:10.549095  6600 raft_consensus.cc:2804] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:10.549731  6600 raft_consensus.cc:697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:10.550731  6600 consensus_queue.cc:237] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.541275  1642 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:59:10.538636  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 87795us
I20260709 12:59:10.554577  1641 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:10.559162  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:10.528779  6765 raft_consensus.cc:2764] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:59:10.559554  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:10.565936  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.511782  6597 consensus_queue.cc:1048] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:59:10.509145  6614 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.531754  6788 consensus_queue.cc:1059] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:59:10.531868  6727 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.543581  6781 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:10.600899  1639 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:10.605177  1535 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:59:10.596550  6794 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:59:10.609234  6788 raft_consensus.cc:3055] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:10.512817  6742 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.606884  6781 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:10.618021  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 54995.6us
I20260709 12:59:10.623730  2314 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:10.611423  6707 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:10.631990  6707 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:10.635155  6642 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:10.611243  6687 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:59:10.641963  6727 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:10.613197  6788 raft_consensus.cc:740] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:10.630796  6759 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.652026  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:10.652695  2347 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:10.653782  6759 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:10.655190  6768 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.655943  1716 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:10.656440  1570 raft_consensus.cc:2393] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 10: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:10.665135  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:10.666872  1716 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:10.659406  6830 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:10.672255  1518 auto_rebalancer.cc:893] Removing replace marker failed: Replica 7a04d0a2963b4860beb7cd14e0b4939a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:10.672734  1518 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:59:10.673024  1518 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:59:10.674661  6772 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.675756  1714 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:10.640151  6700 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.665911  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.670182  2347 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:10.652726  6614 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:10.692716  1714 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:59:10.684583  6814 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.696704  6814 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.699189  6814 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:10.692188  6825 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:59:10.710582  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.703209  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:10.711771  1720 raft_consensus.cc:2410] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for term 15 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:59:10.725540  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:10.715586  6741 raft_consensus.cc:3055] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:10.752043  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:10.752003  6685 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:10.770396  1684 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:10.771859  1684 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:10.773442  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:10.752015  6752 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:10.753822  6741 raft_consensus.cc:740] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:59:10.826762  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 53362.6us
I20260709 12:59:10.771483  6823 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:10.827797  1684 leader_election.cc:304] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:10.769405  6772 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:10.830546  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 340857us
I20260709 12:59:10.777112  6642 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:10.774413  6835 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:10.713785  6707 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.839489  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:10.844892  1646 raft_consensus.cc:3060] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:10.772881  6597 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:59:10.815199  6600 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.832487  6765 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:10.839939  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:10.853981  1640 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 17.
I20260709 12:59:10.718061  6788 consensus_queue.cc:260] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.846714  2345 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:10.842525  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:10.881520  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:10.883291  1640 raft_consensus.cc:2368] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 14. Current term is 15.
I20260709 12:59:10.840459  6605 raft_consensus.cc:2749] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:10.883766  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:10.890123  1647 raft_consensus.cc:1240] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 12:59:10.892120  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:10.893111  1638 raft_consensus.cc:2368] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
I20260709 12:59:10.844996  6768 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:10.853343  6740 raft_consensus.cc:3055] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:10.840442  6693 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:59:10.875320  6747 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.915987  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:10.909545  6788 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:10.907644  6740 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:10.917035  6700 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:10.920897  6747 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:10.919062  1717 raft_consensus.cc:2393] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 11: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:10.928406  6740 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.929807  6740 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:10.924235  1645 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:59:10.930963  1645 pending_rounds.cc:85] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 7
I20260709 12:59:10.931208  1645 pending_rounds.cc:107] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:59:10.931447  1645 raft_consensus.cc:2889] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:10.899170  6741 consensus_queue.cc:260] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.921043  6712 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:10.924571  1646 raft_consensus.cc:2468] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 10.
I20260709 12:59:10.855722  6600 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:10.944185  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:10.945396  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46170 (request call id 2181) took 1021 ms. Trace:
I20260709 12:59:10.956574  1642 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 7. (term mismatch)
I20260709 12:59:10.957024  1642 pending_rounds.cc:85] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 6
I20260709 12:59:10.957257  1642 pending_rounds.cc:107] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 16.7
I20260709 12:59:10.946889  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:10.955983  6600 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:10.956308  1714 rpcz_store.cc:276] 0709 12:59:09.923875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.924768 (+   893us) service_pool.cc:224] Handling call
0709 12:59:10.945247 (+1020479us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b5400300a54. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:10.945345 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639181184}
I20260709 12:59:10.980825  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:10.969846  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:10.982542  2312 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:10.983754  6813 raft_consensus.cc:2804] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:10.984275  6813 raft_consensus.cc:697] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:10.984459  1565 raft_consensus.cc:1275] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:10.985189  6813 consensus_queue.cc:237] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:10.987607  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:10.957347  2343 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
W20260709 12:59:10.965107  6757 consensus_meta.cc:287] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.005s
I20260709 12:59:10.987357  6476 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:10.995427  6476 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.995788  6476 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:10.980841  1642 raft_consensus.cc:2889] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:10.966536  6840 log.cc:927] Time spent T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:59:10.994549  6757 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:10.967952  6781 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.027940  6597 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:11.037742  1569 raft_consensus.cc:1275] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 12:59:11.041237  1719 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:11.036046  1563 raft_consensus.cc:2468] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:11.054515  6568 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:11.066298  6781 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:11.071648  1719 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:11.089290  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:11.090607  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:11.090929  1535 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:11.091363  1646 raft_consensus.cc:2393] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 10: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:59:11.092150  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:11.095433  6756 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:11.095886  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:11.128756  1641 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:59:11.130785  1535 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:11.144840  6757 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:11.145430  6757 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:11.146380  6757 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.148864  6476 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.166656  6755 raft_consensus.cc:3055] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:11.167171  6755 raft_consensus.cc:740] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:11.174609  1720 raft_consensus.cc:1275] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:59:11.175221  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.175895  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.184885  1714 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:11.185701  1612 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:11.168059  6755 consensus_queue.cc:260] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.187207  6696 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:11.187480  6755 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:11.187753  6696 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.188221  6573 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:11.189931  6696 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.192919  6476 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.193893  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:11.199239  1610 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:59:11.218394  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.225328  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.226240  1566 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:59:11.182837  6651 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.228370  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:11.229898  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:11.200798  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:11.227741  6742 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.227897  6768 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:11.248067  2314 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:11.237597  6809 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:11.184686  6600 consensus_queue.cc:1048] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:59:11.256814  6809 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.257208  6809 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:11.257800  6600 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:11.258380  6600 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:11.237780  6696 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:11.259771  6696 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:11.260160  6696 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:11.255716  6751 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:11.260854  6266 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.256192  6768 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.264073  6768 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:11.264935  6757 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:59:11.240684  6651 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.266604  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.267352  1712 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 16: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:11.267845  6651 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.244571  6742 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.259285  6600 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.270764  6742 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:11.239451  6693 consensus_queue.cc:1059] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:59:11.268136  6809 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:11.289821  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 59996.7us
W20260709 12:59:11.290997  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 90331.7us
I20260709 12:59:11.285643  6826 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:11.294592  1535 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:11.298673  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:11.276357  6696 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.293150  1612 leader_election.cc:304] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:59:11.299883  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 100714us
I20260709 12:59:11.311260  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:11.299233  6826 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.300177  6768 raft_consensus.cc:2749] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:11.315634  1641 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:11.318316  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:11.318991  2344 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 16.
I20260709 12:59:11.319473  6741 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:11.314985  6744 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:11.331610  6810 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:11.332118  6810 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:11.331733  6744 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.334024  6744 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.336764  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:11.339988  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:11.340622  1641 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 10.
I20260709 12:59:11.301342  6707 raft_consensus.cc:2749] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:11.344264  1535 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:11.312197  6866 raft_consensus.cc:2749] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:11.314640  6266 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:11.348541  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:11.314751  6826 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:11.353883  1639 raft_consensus.cc:1240] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:59:11.355283  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:11.364194  1646 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:11.356464  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:11.345029  6744 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:11.376375  1638 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 13. Current term is 14. Ops: []
W20260709 12:59:11.389834  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.372975  6866 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:11.396396  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 49838.2us
I20260709 12:59:11.375674  1646 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 18.
I20260709 12:59:11.389875  6755 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:11.402773  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:11.368420  6707 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:11.372633  6867 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:59:11.399591  6725 consensus_queue.cc:1059] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:59:11.402065  6809 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:11.403568  6755 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.396287  6869 consensus_queue.cc:1048] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:59:11.406579  6707 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:11.421264  6869 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:11.376256  6810 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.419646  6707 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:11.426906  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.427237  6810 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:11.417315  6811 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:11.430438  6811 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:59:11.430837  6693 consensus_queue.cc:1175] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" responder_term: 17 status { last_received { term: 17 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 17 index: 11 } }
I20260709 12:59:11.431306  6811 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.415505  6755 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:11.416877  6809 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:11.437166  6809 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.438549  6811 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:11.439157  6809 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.389206  6744 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:11.449868  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 45098.6us
I20260709 12:59:11.445573  6724 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.497165  1644 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:59:11.498311  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 93119.1us
I20260709 12:59:11.493716  6740 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.510435  1566 raft_consensus.cc:2955] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 3 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:11.494479  6823 raft_consensus.cc:493] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:11.521459  6823 raft_consensus.cc:515] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.523564  6823 leader_election.cc:290] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:11.526010  6744 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.533720  6826 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.535970  6707 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.500211  6696 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:11.536662  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:11.562372  2343 raft_consensus.cc:2393] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:59:11.544510  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.546168  6826 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:11.546947  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.553052  6643 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:11.554490  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:11.556322  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.559386  1718 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:11.575029  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:11.498816  6724 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.509368  6727 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:11.563248  1570 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 14: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:11.518106  6740 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:11.563503  2314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.566903  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.567591  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:11.568363  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.716969  1714 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:11.569420  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.717885  1715 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:11.570585  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.571559  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.656332  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:11.725598  2347 raft_consensus.cc:2368] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
I20260709 12:59:11.606968  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.605702  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.651777  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:11.657012  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:11.645484  6724 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:11.674583  2312 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:11.653018  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45024 (request call id 2352) took 1417 ms. Trace:
I20260709 12:59:11.727562  1563 rpcz_store.cc:276] 0709 12:59:10.235755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.238233 (+  2478us) service_pool.cc:224] Handling call
0709 12:59:11.652844 (+1414611us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54001658d4. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269d571 00007f6a427382fa 00007f6a476f9b17 00007f6a40c746d4 00007f6a40c74662 00007f6a40c74591 00007f6a40c7450c 00007f6a40c737c2 00007f6a40a6f48c 00007f6a40a6e8c6 00007f6a40a6e26f
0709 12:59:11.652960 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783342464}
I20260709 12:59:11.653904  1569 raft_consensus.cc:1275] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:11.650210  6707 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:11.707453  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:11.710489  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.735405  1612 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:11.656987  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:11.738351  1563 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:59:11.738340  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 63870.6us
I20260709 12:59:11.715528  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.744531  6696 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:11.748132  6696 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.749305  6751 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:11.749828  6751 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.750325  6696 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.747462  6740 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:11.755448  1612 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:11.757548  1644 raft_consensus.cc:1275] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:59:11.758695  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:11.759460  1646 raft_consensus.cc:3060] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:59:11.764698  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:11.766538  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:11.784261  1640 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 15: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:11.799823  2347 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:11.713681  6630 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 12:59:11.745383  6685 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:59:11.802865  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 47475.2us
I20260709 12:59:11.805968  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.806653  1612 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:11.807864  1612 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:11.809119  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:11.809736  1646 raft_consensus.cc:2468] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:59:11.719985  6755 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.785422  6875 raft_consensus.cc:2749] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:11.721462  6727 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.784073  6751 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.813920  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:11.818884  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.820628  1568 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:59:11.783552  6810 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:59:11.830965  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:11.819550  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:11.832448  1714 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:11.821856  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e271944afc3846f9b26d682a57b58ce8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:11.822245  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:11.835089  1713 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 16: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:11.836009  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:11.823899  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:11.810806  6874 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:11.829725  1715 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:11.825255  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:11.840065  1571 raft_consensus.cc:2393] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 12: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:11.859954  6755 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:11.815670  6476 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:11.830323  6879 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:11.813959  6266 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:11.864423  1646 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 10.
I20260709 12:59:11.865008  2348 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 16.
I20260709 12:59:11.817126  6685 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:11.862556  6876 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:11.815538  6600 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:11.866307  6868 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:59:11.866174  6889 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:11.834796  6696 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:59:11.874037  6877 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.259s	user 0.004s	sys 0.000s
W20260709 12:59:11.878432  6878 log.cc:927] Time spent T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:59:11.870337  6476 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:11.869020  6879 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.890247  6696 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:11.838465  6768 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:59:11.920930  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.838362  6880 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:59:11.899111  6696 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:11.964778  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 139479us
I20260709 12:59:11.898918  6879 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:11.965719  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:11.946815  6700 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:11.978999  6700 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.981791  6700 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:11.984853  6573 consensus_queue.cc:1048] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:11.985095  1686 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:11.986824  6886 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:11.987211  6886 raft_consensus.cc:493] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.987529  6886 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:11.989104  6476 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.990588  6476 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:11.972852  6685 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:11.995709  6886 raft_consensus.cc:515] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:11.998303  6886 leader_election.cc:290] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:11.998662  6727 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.010298  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:12.010998  1566 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:12.013013  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:12.022905  1566 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:59:11.977140  6809 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:12.027125  6809 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:12.026548  1713 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:59:12.008121  6811 consensus_meta.cc:287] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.000s
W20260709 12:59:12.073556  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 43994.5us
I20260709 12:59:12.029763  6809 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:12.078074  1713 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:12.029361  6841 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:59:12.089478  1684 leader_election.cc:400] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 14. Current term is 15.
I20260709 12:59:12.095674  1684 leader_election.cc:403] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:59:12.090816  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 60362.5us
I20260709 12:59:12.092937  6869 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.093335  6867 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.101287  6869 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.099098  1686 leader_election.cc:304] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:12.104049  1684 leader_election.cc:400] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
I20260709 12:59:12.106781  1684 leader_election.cc:403] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:59:12.079183  6573 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:59:12.107846  6741 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 14. Current term is 15.
I20260709 12:59:12.108839  6729 raft_consensus.cc:2804] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:12.118695  6788 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.119040  6712 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881) with higher term. Message: Invalid argument: T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
W20260709 12:59:12.146454  2312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.153174  6757 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:12.155400  6869 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.179318  2312 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:12.179872  6685 consensus_queue.cc:1048] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:12.180574  6614 raft_consensus.cc:2804] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:12.181326  6614 raft_consensus.cc:697] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:12.182179  6614 consensus_queue.cc:237] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:12.184167  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:12.185322  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:12.158227  6879 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.144224  6729 raft_consensus.cc:697] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:12.131392  6887 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:59:12.102560  6867 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.183712  6696 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.192549  6868 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:59:12.264910  6729 consensus_queue.cc:237] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.193045  6788 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.269960  6788 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:12.275538  6883 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.395s	user 0.000s	sys 0.002s
I20260709 12:59:12.286518  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:12.287262  1647 raft_consensus.cc:2393] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 12: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:59:12.287425  1646 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:12.289372  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:12.290555  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:12.292573  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:12.251748  6882 log.cc:927] Time spent T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.370s	user 0.002s	sys 0.002s
I20260709 12:59:12.298844  1612 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:12.301429  6876 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:12.302068  6876 consensus_queue.cc:1048] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:12.306881  1715 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:12.309746  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:12.252444  6809 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:12.254469  6885 log.cc:927] Time spent T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 12:59:12.261984  6867 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.312616  1535 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:12.331723  1640 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:12.350749  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:12.351573  1714 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:12.342098  1639 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:11.285142   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:12.372741  1537 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:12.330423  6879 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.377719  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:12.378409  1717 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:12.379346  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:12.381757  6778 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.382368  6778 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.389151  1639 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 18 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:12.390527  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:59:12.328567  6881 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 12:59:12.393340  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:12.378333  6879 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:12.399636  1717 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:12.384440  6778 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:12.349848  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 235810us
I20260709 12:59:12.398073  1714 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
W20260709 12:59:12.398216  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 85680.7us
I20260709 12:59:12.414848  1712 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:12.415319  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:12.417905  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af922e165f0c427eacd26ca4bc111d76" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:12.338227  6869 raft_consensus.cc:493] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:12.406185  6476 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:12.344584  6875 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:12.354331  6876 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:12.329422  6696 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.328088  6768 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:12.350239  6600 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:12.484934  6600 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.487144  6600 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.338341  6880 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:12.487771  6880 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:12.488835  1470 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46898 (request call id 133) took 60977 ms (client timeout 15000 ms). Trace:
I20260709 12:59:12.489722  6880 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.408576  6868 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:12.490806  6868 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:12.491191  6868 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:12.409621  6756 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:12.341950  6809 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.420325  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:12.423494  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:12.499969  1567 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 14: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:12.424997  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:12.415861  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:12.441104  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:12.452891  6867 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:12.454800  1535 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:12.458743  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:12.457084  1612 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:59:12.503831  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46830.4us
W20260709 12:59:12.509147  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 54434.1us
I20260709 12:59:12.520843  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
W20260709 12:59:12.489223  1470 rpcz_store.cc:269] 0709 12:58:11.511475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.530214 (+ 18739us) service_pool.cc:224] Handling call
0709 12:58:12.856659 (+1326445us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269e090 00007f6a4273cf3a 00007f6a484f31cc 00007f6a485f137e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:12.488766 (+59632107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:10.543373 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:10.669124 (+125751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:10.676974 (+  7850us) write_op.cc:435] Acquired schema lock
0709 12:59:10.678798 (+  1824us) tablet.cc:662] Decoding operations
0709 12:59:10.690534 (+ 11736us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:10.690597 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:10.690628 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:10.691036 (+   408us) tablet.cc:701] Row locks acquired
0709 12:59:10.691060 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:59:10.691214 (+   154us) write_op.cc:270] Start()
0709 12:59:10.691331 (+   117us) write_op.cc:276] Timestamp: P: 1783601950691163 usec, L: 0
0709 12:59:10.691356 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:59:10.695586 (+  4230us) log.cc:844] Serialized 919 byte log entry
0709 12:59:11.035774 (+340188us) op_driver.cc:464] REPLICATION: finished
0709 12:59:11.098463 (+ 62689us) write_op.cc:301] APPLY: starting
0709 12:59:11.098559 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:11.121683 (+ 23124us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:11.121792 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:11.123156 (+  1364us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:11.123346 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:59:11.123395 (+    49us) write_op.cc:312] APPLY: finished
0709 12:59:11.123590 (+   195us) log.cc:844] Serialized 33 byte log entry
0709 12:59:11.129580 (+  5990us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:11.131535 (+  1955us) write_op.cc:454] Released schema lock
0709 12:59:11.132799 (+  1264us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:11.152031 (+ 19232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:11.152062 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":219,"mutex_wait_us":1945239,"reported_tablets":26,"spinlock_wait_cycles":877039872,"child_traces":[["op",{"apply.queue_time_us":62407,"apply.run_cpu_time_us":4779,"apply.run_wall_time_us":53546,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12495,"num_ops":2,"prepare.queue_time_us":181042,"prepare.run_cpu_time_us":71420,"prepare.run_wall_time_us":313846,"raft.queue_time_us":84533,"raft.run_cpu_time_us":10573,"raft.run_wall_time_us":78734,"replication_time_us":334248,"thread_start_us":344023,"threads_started":4,"wal-append.queue_time_us":218750,"wal-append.run_cpu_time_us":7998,"wal-append.run_wall_time_us":1211183}]]}
I20260709 12:59:12.520555  1463 catalog_manager.cc:5697] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 14, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.521842  6755 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:12.522789  1463 catalog_manager.cc:5697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 12, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.508301  6880 raft_consensus.cc:2804] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:12.494664  6768 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.476604  6570 consensus_queue.cc:1048] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 12:59:12.497076  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 83023us
I20260709 12:59:12.530764  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:12.527324  1463 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.535596  1463 catalog_manager.cc:5697] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 15, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 15 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.506141  6763 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.541916  1566 raft_consensus.cc:3060] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:59:12.477315  6869 raft_consensus.cc:515] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.477475  6875 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.543637  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:12.544730  1463 catalog_manager.cc:5697] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 10, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.550729  1463 catalog_manager.cc:5697] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.552086  1463 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 9 to 10, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.556886  1463 catalog_manager.cc:5697] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.558007  1463 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 13, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.517913  6756 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:12.528251  6700 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:12.547578  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:12.478938  6876 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.536805  6880 raft_consensus.cc:697] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:12.559159  1463 catalog_manager.cc:5697] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 2 to 12, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.571023  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:12.576802  1463 catalog_manager.cc:5697] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 10, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.582044  6868 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.583213  1568 raft_consensus.cc:2368] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14.
I20260709 12:59:12.578998  1463 catalog_manager.cc:5697] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 13 to 14, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.593071  1684 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:12.595208  6897 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:12.595391  6823 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:12.562633  6809 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:12.600085  1566 raft_consensus.cc:2468] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:12.566222  6696 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:12.559782  6763 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.643931  6763 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.645701  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:12.646342  1714 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:12.647635  1537 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:12.648516  6763 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:12.648927  6763 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:12.639593  6884 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:12.630210  1463 catalog_manager.cc:5697] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.603257  6417 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:12.649260  6763 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:12.630750  1684 leader_election.cc:400] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
I20260709 12:59:12.694306  1684 leader_election.cc:403] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:59:12.694801  1463 catalog_manager.cc:5697] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 10, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 10 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.696342  1463 catalog_manager.cc:5697] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 14. New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.697760  1463 catalog_manager.cc:5697] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 13, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
W20260709 12:59:12.695242  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 64670us
I20260709 12:59:12.700906  1684 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:12.700268  1463 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.626132  6700 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.703809  1463 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 13 to 16, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 16 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.708616  1463 catalog_manager.cc:5697] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
W20260709 12:59:12.722626  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 212583us
I20260709 12:59:12.725431  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:12.718179  1463 catalog_manager.cc:5697] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 3 to 10, term changed from 10 to 12, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.699613  6809 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:12.742867  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:12.743898  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:12.744400  1463 catalog_manager.cc:5697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 11, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.758404  1463 catalog_manager.cc:5697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 13, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 13 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.764400  1463 catalog_manager.cc:5697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 4 to 9, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 9 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.710626  6696 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
W20260709 12:59:12.770546  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 69750.6us
I20260709 12:59:12.790158  1463 catalog_manager.cc:5697] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 17, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 17 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.791301  1684 leader_election.cc:304] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:12.715943  6685 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.795243  1463 catalog_manager.cc:5697] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.800865  1463 catalog_manager.cc:5697] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 9 to 16, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 16 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.712796  6700 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.767138  6898 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) with higher term. Message: Invalid argument: T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14.
I20260709 12:59:12.708213  6417 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:12.833556  6685 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:12.838726  1463 catalog_manager.cc:5697] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 11 to 14, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 14 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.795204  6740 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:12.811439  6867 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:12.713758  6756 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:12.871624  1463 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.811084  6768 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.879405  1463 catalog_manager.cc:5697] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 12, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.834828  6675 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.837231  6884 raft_consensus.cc:2749] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:12.715368  6880 consensus_queue.cc:237] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:12.884176  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 156834us
W20260709 12:59:12.885362  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 51292.1us
I20260709 12:59:12.881825  1463 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 11 to 12, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 12 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.889779  1463 catalog_manager.cc:5697] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 11 to 14, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.891376  1463 catalog_manager.cc:5697] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 3 to 8, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.895394  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:12.896476  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:12.880379  6868 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.893086  1463 catalog_manager.cc:5697] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 16, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 16 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.906217  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:12.912705  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:12.907266  2345 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 LEADER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:59:12.914335  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:12.909765  1612 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:12.917925  1463 catalog_manager.cc:5697] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.920409  1463 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 13 to 16, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 16 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:12.921849  1463 catalog_manager.cc:5697] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 9 to 14, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.923182  1463 catalog_manager.cc:5697] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:12.878005  6875 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.925640  1612 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:59:12.938692  6906 log.cc:927] Time spent T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 12:59:12.894021  6869 leader_election.cc:290] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.902855  6916 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:12.914664  6742 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
W20260709 12:59:12.956727  6904 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:59:12.932916  6876 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:12.893086  6675 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:12.974035  2345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:12.979628  2345 raft_consensus.cc:606] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:12.979970  2345 raft_consensus.cc:614] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:12.988332  1570 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:59:12.970021  6918 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:59:12.933290  6696 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:12.993678  6417 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:12.946396  6890 consensus_queue.cc:1059] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:59:12.999526  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:13.002635  2345 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:59:12.914160  6809 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:12.981869  6900 log.cc:927] Time spent T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260709 12:59:12.985224  6875 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.991420  6920 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:12.997799  6752 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:13.018826  6907 log.cc:927] Time spent T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:59:13.019052  6915 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:59:13.016534  6890 consensus_queue.cc:1243] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Peer c05ea12435084ad9b281ed3a0a2ecebe log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:59:13.014945  6914 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:59:13.020210  6902 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:59:13.021292  6685 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:13.021867  6908 log.cc:927] Time spent T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 12:59:13.022152  6909 log.cc:927] Time spent T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:59:12.972401  6742 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:12.967648  6916 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.041405  6700 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:13.027590  6875 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.050477  6875 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:13.055424  6916 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:13.098055  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 113804us
I20260709 12:59:13.110721  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:13.113318  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:13.116015  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df7e2e5458047a9a8b0d6a07577bbbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:12.990753  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 65185.7us
I20260709 12:59:13.135732  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.138087  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.142748  1612 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:13.143615  1639 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:59:13.142762  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.138198  1645 raft_consensus.cc:1275] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:59:13.152864  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 160861us
I20260709 12:59:13.159440  6675 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:13.164541  6724 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.165117  6875 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.165674  6724 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.166020  6875 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.171427  1644 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:59:13.175213  6763 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.179551  6570 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:13.180065  6570 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:13.175791  6742 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:13.164636  6896 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:13.188990  6896 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.192006  6896 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:13.194131  6724 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:13.197629  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:13.194322  6756 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:59:13.199867  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 43873.9us
I20260709 12:59:13.199529  6756 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.198869  2345 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 16.
I20260709 12:59:13.201112  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:13.202175  1715 raft_consensus.cc:2368] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14.
I20260709 12:59:13.203697  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:13.204002  6756 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:13.204488  1720 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:13.210466  6875 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:13.216250  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.217197  1645 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:59:13.216277  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508332d25a2b4288bc6411b566044758" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
W20260709 12:59:13.222010  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 79621.2us
I20260709 12:59:13.237098  1644 raft_consensus.cc:3060] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:13.243134  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:13.251001  2347 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:13.251870  1640 raft_consensus.cc:1240] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 18 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:59:13.251539  6570 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.254455  6875 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:13.259107  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:13.264218  6570 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:13.268028  6763 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:13.269384  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:13.270169  1718 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:59:13.275759  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:13.276525  1712 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:59:13.276566  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:13.276818  6932 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:59:13.277204  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:13.277501  1713 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:13.278517  6809 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:13.279222  6809 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.281824  6809 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:13.283370  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:13.285029  6941 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.288328  6941 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.288877  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:13.285538  1537 leader_election.cc:400] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14.
I20260709 12:59:13.290390  1537 leader_election.cc:403] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:13.290040  1570 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 18.
I20260709 12:59:13.308298  2342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:13.309187  2342 raft_consensus.cc:606] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:13.312484  1720 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:13.313789  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:13.316129  1644 raft_consensus.cc:2468] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:59:13.313580  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:13.317619  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:13.334223  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.335033  1639 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 14: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:13.335811  6809 raft_consensus.cc:493] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:13.336437  6809 raft_consensus.cc:515] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.338646  6809 leader_election.cc:290] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:13.341537  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.343448  1644 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 14: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:13.319509  6763 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:13.349289  6763 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:13.368491  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 147742us
I20260709 12:59:13.370380  6942 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:13.371125  6942 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.374135  6890 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:13.374543  6890 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.374863  6890 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:13.377938  6941 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:13.388335  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:13.389178  2342 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 18.
I20260709 12:59:13.403190  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:13.404978  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:13.356362  6809 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:13.407438  6643 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 13. Current term is 14.
I20260709 12:59:13.383978  6763 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:13.407805  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 122708us
I20260709 12:59:13.411504  1718 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:59:13.411844  1718 pending_rounds.cc:85] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting all ops after (but not including) 11
I20260709 12:59:13.405891  2314 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:59:13.415697  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 153283us
I20260709 12:59:13.418812  1612 leader_election.cc:400] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14.
I20260709 12:59:13.420189  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:13.427708  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:13.429445  1537 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:13.429867  6922 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:13.430380  6922 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:13.430785  6922 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:13.431016  6768 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:13.432178  1537 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:13.433560  6944 log.cc:927] Time spent T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.185s	user 0.003s	sys 0.001s
I20260709 12:59:13.412036  1718 pending_rounds.cc:107] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:59:13.443656  6934 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:13.437601  1718 raft_consensus.cc:2889] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:13.413669  6941 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:13.448855  6941 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.449282  6941 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:13.453770  6942 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:13.456264  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.457247  1646 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 14: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:13.464751  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.466131  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.466702  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.478626  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:13.479432  2347 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 18.
I20260709 12:59:13.488965  6935 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:13.444270  6934 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.493219  6934 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:13.493388  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 141473us
I20260709 12:59:13.497179  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:13.503821  6675 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:13.506011  1610 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:13.471004  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:13.517067  6651 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:13.517593  6651 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Starting leader election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:13.518071  6651 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:59:13.517827  1454 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 52bc0b3e08ea4bd78b344b833b97faed with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c05ea12435084ad9b281ed3a0a2ecebe is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:13.521142  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.528760  6643 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:13.536865  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:59:13.537791  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:13.558878  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 138869us
I20260709 12:59:13.563156  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.567035  2347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:13.595121  6813 consensus_queue.cc:1048] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:59:13.609462  6768 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:13.527928  6890 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:13.613382  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 181310us
W20260709 12:59:13.615727  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 57283.2us
W20260709 12:59:13.611238  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 46090.5us
I20260709 12:59:13.550189  6643 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:13.627403  6884 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:13.627313  6700 raft_consensus.cc:493] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:13.631225  6941 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.631893  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:13.632917  1612 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:13.639600  6839 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:13.639339  6643 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.640057  6839 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.641182  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:13.646145  6941 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 19 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:13.645993  6763 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:13.651811  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 123981us
I20260709 12:59:13.640470  6839 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:13.648588  6763 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:13.662914  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:13.663910  1720 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:13.665308  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:13.670295  1645 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:13.671314  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:13.671936  1712 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:13.673722  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50492.8us
I20260709 12:59:13.676105  6934 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.677105  2347 raft_consensus.cc:606] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:13.677503  2347 raft_consensus.cc:614] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:13.677572  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 54121.7us
I20260709 12:59:13.678428  6934 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:13.681692  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:13.671322  1569 raft_consensus.cc:1275] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:13.625882  6768 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.688875  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:13.628594  6700 raft_consensus.cc:515] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.705271  2342 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:13.705919  1718 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:13.715914  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:13.717268  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:13.717851  1641 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:13.722599  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:13.723846  1684 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:13.738148  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:13.735648  6889 raft_consensus.cc:2749] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:13.771745  1717 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:59:13.773718  6923 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:13.774279  6923 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:13.774324  6867 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:13.774868  6923 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:13.782500  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 52986.9us
I20260709 12:59:13.809846  1712 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:59:13.813210  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:13.820550  1640 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:13.729990  6922 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.840408  1715 raft_consensus.cc:1240] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 16. Current term is 17. Ops: []
W20260709 12:59:13.843303  6957 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:59:13.844166  6573 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:13.844837  6573 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:13.845322  6573 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:13.847692  6923 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.852898  6651 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:13.869688  1641 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 16.
W20260709 12:59:13.884840  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 200873us
I20260709 12:59:13.840451  6890 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:13.887094  1639 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 18.
I20260709 12:59:13.888249  1563 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 14: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:13.887669  1717 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:13.887723  1720 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 16.
I20260709 12:59:13.895576  6700 leader_election.cc:290] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:13.927642  6820 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:59:13.928354  6959 log.cc:927] Time spent T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.247s	user 0.002s	sys 0.000s
I20260709 12:59:13.928848  6700 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:13.894989  6890 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:59:13.950716  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 66223.6us
I20260709 12:59:13.928390  6820 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.978760  1537 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:13.984463  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.986095  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:13.987802  6763 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:13.988474  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:13.989298  1647 raft_consensus.cc:2393] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 14: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:13.990411  6756 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:13.991163  6756 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:13.993898  1640 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:13.988500  6763 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:13.999004  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:13.999223  6763 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:13.999847  1566 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 16: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:14.001204  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:14.004876  6923 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:14.004866  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.007578  6573 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.003719  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:14.013235  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:13.993093  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:13.955703  6700 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.011327  6651 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:14.036595  1535 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:14.018525  6884 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:13.992256  6756 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.041126   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:14.043769  6768 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:14.042500  6867 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:14.051059  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:14.051393  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:14.052726  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:14.057734  1569 raft_consensus.cc:2368] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 18. Current term is 19.
I20260709 12:59:14.060901  6867 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:14.061753  1567 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:14.062158  6867 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.063179  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.064081  1714 raft_consensus.cc:2393] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 16: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:14.064585   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:14.069998  6964 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:14.072299  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.074344  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:14.075150  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.073174  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:14.077088  1639 raft_consensus.cc:2393] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 14: Already voted for candidate 7a04d0a2963b4860beb7cd14e0b4939a in this term.
I20260709 12:59:14.073967  1612 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:14.079348  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:14.080324  6700 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:14.080840  6962 log.cc:927] Time spent T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:59:14.081015  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523c299f124340818ee040d8a887dba6" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:14.094753  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:14.095865  6931 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:14.098356  1717 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:14.104206  2312 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:14.107457  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:14.108319  1567 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:14.116624  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d04144cd804a9b886ecfd1a986ec95" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.117384  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.117898  6573 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:14.118716  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 60285.3us
I20260709 12:59:14.089948  6839 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.090469  6964 consensus_queue.cc:1048] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:59:14.129563  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:14.130302  1712 raft_consensus.cc:2368] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 14. Current term is 15.
I20260709 12:59:14.135038  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.141149  2344 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 in current term 19: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:59:14.142421  2347 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:14.144070  1612 leader_election.cc:304] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:14.144721  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:14.151377  1537 leader_election.cc:304] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:14.155056  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:14.157240  6911 consensus_queue.cc:1059] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:59:14.160779  6826 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:14.161603  6707 raft_consensus.cc:2749] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:14.161952  6965 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:59:14.182299  1567 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:14.187667  1537 leader_election.cc:400] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 14. Current term is 15.
I20260709 12:59:14.188122  1537 leader_election.cc:403] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:59:14.189810  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:14.190694  1714 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:14.153883  6875 raft_consensus.cc:2749] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:14.200510  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 56549.1us
I20260709 12:59:14.206974  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008f8fc81244052803539fc7317853b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.186195  6826 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:59:14.218670  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 83869.3us
W20260709 12:59:14.226814  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 63306.3us
I20260709 12:59:14.202986  6923 raft_consensus.cc:3055] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:14.228034  6923 raft_consensus.cc:740] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:14.229074  6923 consensus_queue.cc:260] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.199990  6742 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649) with higher term. Message: Invalid argument: T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 14. Current term is 15.
I20260709 12:59:14.233465  1612 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:14.245180  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:14.245803  1641 raft_consensus.cc:3060] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:14.249269  1643 raft_consensus.cc:3055] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:14.249648  1643 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:14.250490  1643 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.251442  6839 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:14.253871  6826 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.256757  6916 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:14.258548  1612 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:14.260350  6879 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:14.260973  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:14.261546  1645 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:14.262058  6809 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:14.267123  6600 consensus_queue.cc:1059] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:14.268139  6696 raft_consensus.cc:3055] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:14.268515  6696 raft_consensus.cc:740] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:14.269291  6696 consensus_queue.cc:260] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.270419  6696 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:14.274032  1535 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:14.275308  6868 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:14.242810  6922 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:14.282991  6820 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:14.292236  1641 raft_consensus.cc:2468] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:14.251502  1643 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:14.301770  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:14.303458  1686 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:14.304207  1714 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:14.304908  6973 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:14.305567  6973 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:14.306207  6675 raft_consensus.cc:993] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:59:14.306696  6675 raft_consensus.cc:1081] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:59:14.308432  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:14.313738  1718 raft_consensus.cc:1240] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 13. Current term is 14. Ops: []
W20260709 12:59:14.297107  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 87222.9us
I20260709 12:59:14.316406  1537 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:14.317673  1537 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:14.320513  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.325822  1721 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:14.326584  1567 raft_consensus.cc:1275] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 12:59:14.334311  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 106744us
I20260709 12:59:14.335539  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:14.336316  1568 raft_consensus.cc:2368] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 18. Current term is 19.
I20260709 12:59:14.337402  1565 raft_consensus.cc:1240] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Rejecting Update request from peer 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:14.337402  1684 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:14.339747  6768 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:14.340353  1717 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:14.346217  1537 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:14.347589  1643 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:59:14.343652  6809 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:14.322917  6868 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:14.385999  6868 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:14.386490  6868 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:14.387399  1537 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:14.357854  1643 pending_rounds.cc:85] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 7
I20260709 12:59:14.390358  1643 pending_rounds.cc:107] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:59:14.390738  1643 raft_consensus.cc:2889] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:14.387398  6868 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.393476  1721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:59:14.393821  6768 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:14.394120  1721 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.394510  1721 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:14.398907  6820 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:14.399457  6820 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.401513  6820 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:14.402915  6768 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:14.404706  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:14.411752  6724 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:14.412293  6724 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.419579  6724 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:14.421294  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e979717db64b77b569522980fab6af" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:14.422195  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:14.422752  1535 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:14.431085  6820 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:14.361039  1645 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 19.
I20260709 12:59:14.366031  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:14.368367  6964 raft_consensus.cc:2804] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:14.444717  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd982fdd5b6440bbcf0eaf350f5124f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:14.373853  6923 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:14.374696  6809 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.466095  1570 raft_consensus.cc:2393] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 19: Already voted for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in this term.
I20260709 12:59:14.466332  6809 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.469786  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:14.473230  1721 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.477203  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:14.482558  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 174195us
I20260709 12:59:14.487155  1721 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:14.479153  6964 raft_consensus.cc:697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:14.491076  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:14.492214  2344 raft_consensus.cc:3055] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:14.492552  2344 raft_consensus.cc:740] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:14.492754  1612 leader_election.cc:400] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 18. Current term is 19.
I20260709 12:59:14.493630  2344 consensus_queue.cc:260] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.494796  2344 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:14.495270  6889 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:14.496487  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.494891  1612 leader_election.cc:400] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 18. Current term is 19.
I20260709 12:59:14.497367  1612 leader_election.cc:403] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:59:14.498414  6889 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a for earlier term 18. Current term is 19.
I20260709 12:59:14.502719  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:14.502221  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:14.499724  6970 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:14.505470  2344 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 17.
I20260709 12:59:14.505879  1612 leader_election.cc:304] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:14.507400  1718 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:14.507326  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51b349fdba540c3a8c0e167720c3a7c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:14.485652  6763 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:59:14.515034  1684 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:14.491906  6724 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:14.520386  1570 raft_consensus.cc:3060] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:14.533746  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 63791.9us
I20260709 12:59:14.533660  6651 consensus_queue.cc:1048] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:59:14.568707  6811 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:14.569269  6811 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 19 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
W20260709 12:59:14.570118  6983 log.cc:927] Time spent T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:59:14.570315  6811 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.565023  6970 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.511480  6809 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:14.582516  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 67603.9us
I20260709 12:59:14.517694  6935 raft_consensus.cc:2749] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:14.588502  6573 raft_consensus.cc:2804] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:14.589661  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:14.590317  6986 log.cc:927] Time spent T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.071s	user 0.004s	sys 0.000s
I20260709 12:59:14.590282  2344 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:14.592509  6573 raft_consensus.cc:697] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:14.593644  6573 consensus_queue.cc:237] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.598027  6964 consensus_queue.cc:237] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.604545  1610 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:59:14.634687  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 69506.6us
I20260709 12:59:14.628763  6935 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:14.658584  6898 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.659143  6898 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:14.661150  6898 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:14.653314  6935 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.670004  6935 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:14.673336  1645 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:14.675814  6830 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:14.676314  1641 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:59:14.681459  6700 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:14.702169  1717 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:14.705513  1643 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:59:14.705904  1643 pending_rounds.cc:85] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting all ops after (but not including) 8
I20260709 12:59:14.706125  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:14.707144  1720 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:59:14.706146  1643 pending_rounds.cc:107] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:59:14.708266  1643 raft_consensus.cc:2889] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:14.711796  6755 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:14.712925  6990 log.cc:927] Time spent T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:59:14.643400  6970 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:14.733943  6991 log.cc:927] Time spent T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.145s	user 0.003s	sys 0.000s
I20260709 12:59:14.741882  6763 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:14.742228  1720 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:14.744606  6756 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:14.763732  1570 raft_consensus.cc:2468] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 17.
W20260709 12:59:14.762393  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 123641us
I20260709 12:59:14.808512  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c533e32b324f8f80c12f5380f0c92d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:14.820953  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:14.856209  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b56889944b24c9cb46eb080b37a2d4b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:14.875075  6935 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.854808  6687 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
W20260709 12:59:14.858534  6993 log.cc:927] Time spent T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:59:14.891686  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:14.892307  2344 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:14.890848  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:14.884925  6935 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:14.898406  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:14.898962  1717 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:14.905896  6996 log.cc:927] Time spent T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:59:14.916018  6999 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:59:14.924324  1640 raft_consensus.cc:1240] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Rejecting Update request from peer 2af567a273d44ca89d2b3b0f7c815bd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:14.941349  1717 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:14.942582  2344 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:14.938133  6755 consensus_queue.cc:1059] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:59:14.977934  6820 raft_consensus.cc:3055] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:14.978315  6820 raft_consensus.cc:740] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:14.981076  1610 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:14.979115  6820 consensus_queue.cc:260] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:14.990511  6992 raft_consensus.cc:2804] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:15.002602  6992 raft_consensus.cc:697] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:15.003767  6992 consensus_queue.cc:237] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:15.016470  1567 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:59:15.025111  6820 raft_consensus.cc:3060] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:15.042805  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:15.043582  6964 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:15.044056  6975 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:15.052948  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:15.056643  1454 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 52bc0b3e08ea4bd78b344b833b97faed with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c05ea12435084ad9b281ed3a0a2ecebe is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:15.049099  1639 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:59:15.127733   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:15.133922  2344 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:59:15.136125  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 61655.8us
W20260709 12:59:15.139297  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 65352.3us
W20260709 12:59:15.140851  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 68265.2us
I20260709 12:59:15.157022  1569 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:15.171168  6981 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:15.194995  1641 raft_consensus.cc:1275] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:15.215571  7003 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:59:15.223562  6573 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:15.285059  6898 consensus_queue.cc:1048] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:15.285722  1567 raft_consensus.cc:1275] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:15.289495  6884 consensus_queue.cc:1048] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:15.276391  6476 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:59:15.372779  1466 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.395697  1466 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.409933  1466 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.423942  2344 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:59:15.431706  1567 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:59:15.432099  1567 pending_rounds.cc:85] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting all ops after (but not including) 12
I20260709 12:59:15.432312  1567 pending_rounds.cc:107] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:59:15.432528  1567 raft_consensus.cc:2889] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:15.443259  6935 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:15.456193  6935 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:59:15.474766  1463 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58424 (request call id 234) took 6638 ms. Trace:
I20260709 12:59:15.477242  1466 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.475270  1463 rpcz_store.cc:276] 0709 12:59:08.835993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.890436 (+ 54443us) service_pool.cc:224] Handling call
0709 12:59:15.474554 (+6584118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:13.729176 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:13.791190 (+ 62014us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:13.791243 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:59:13.791285 (+    42us) tablet.cc:662] Decoding operations
0709 12:59:13.945510 (+154225us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:13.951889 (+  6379us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:13.952582 (+   693us) tablet.cc:685] Acquiring locks for 37 operations
0709 12:59:13.976181 (+ 23599us) tablet.cc:701] Row locks acquired
0709 12:59:13.976234 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:59:13.976458 (+   224us) write_op.cc:270] Start()
0709 12:59:13.976632 (+   174us) write_op.cc:276] Timestamp: P: 1783601953976383 usec, L: 0
0709 12:59:13.976693 (+    61us) op_driver.cc:348] REPLICATION: starting
0709 12:59:13.977653 (+   960us) log.cc:844] Serialized 14504 byte log entry
0709 12:59:14.453096 (+475443us) op_driver.cc:464] REPLICATION: finished
0709 12:59:14.506697 (+ 53601us) write_op.cc:301] APPLY: starting
0709 12:59:14.506835 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:14.965094 (+458259us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:14.991965 (+ 26871us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:15.163156 (+171191us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:15.163617 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=74,key_file_lookups=74,delta_file_lookups=0,mrs_lookups=0
0709 12:59:15.163680 (+    63us) write_op.cc:312] APPLY: finished
0709 12:59:15.164297 (+   617us) log.cc:844] Serialized 316 byte log entry
0709 12:59:15.164487 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:15.164764 (+   277us) write_op.cc:454] Released schema lock
0709 12:59:15.164861 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:15.165325 (+   464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:15.165352 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":368585,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":53262,"apply.run_cpu_time_us":46661,"apply.run_wall_time_us":658619,"cfile_cache_hit":150,"cfile_cache_hit_bytes":158935,"num_ops":37,"prepare.queue_time_us":445960,"prepare.run_cpu_time_us":52192,"prepare.run_wall_time_us":365676,"raft.queue_time_us":245613,"raft.run_cpu_time_us":18626,"raft.run_wall_time_us":38656,"replication_time_us":476238,"thread_start_us":592586,"threads_started":4,"wal-append.queue_time_us":124896}]]}
I20260709 12:59:15.524626  1720 raft_consensus.cc:1275] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:59:15.525976  6875 consensus_queue.cc:1048] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:59:15.702709  1466 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46898 (request call id 134) took 48247 ms (client timeout 15000 ms). Trace:
W20260709 12:59:15.703256  1466 rpcz_store.cc:269] 0709 12:58:27.455732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.455986 (+   254us) service_pool.cc:224] Handling call
0709 12:58:27.581820 (+125834us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b54001c0610. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a3f4cfdb1 00007f6a3f610640 00007f6a484e7b76 00007f6a485f1c3e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:15.702605 (+48120785us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:15.512034 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:15.512661 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:15.512701 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:59:15.512721 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:15.513353 (+   632us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:15.513436 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:15.513468 (+    32us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:15.513868 (+   400us) tablet.cc:701] Row locks acquired
0709 12:59:15.513888 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:15.514041 (+   153us) write_op.cc:270] Start()
0709 12:59:15.514153 (+   112us) write_op.cc:276] Timestamp: P: 1783601955513995 usec, L: 0
0709 12:59:15.514185 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:59:15.514868 (+   683us) log.cc:844] Serialized 1686 byte log entry
0709 12:59:15.624224 (+109356us) op_driver.cc:464] REPLICATION: finished
0709 12:59:15.624580 (+   356us) write_op.cc:301] APPLY: starting
0709 12:59:15.624742 (+   162us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:15.627051 (+  2309us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:15.627153 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:15.631200 (+  4047us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:15.650200 (+ 19000us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:59:15.650247 (+    47us) write_op.cc:312] APPLY: finished
0709 12:59:15.650536 (+   289us) log.cc:844] Serialized 49 byte log entry
0709 12:59:15.650706 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:15.650801 (+    95us) write_op.cc:454] Released schema lock
0709 12:59:15.650841 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:15.651219 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:15.651256 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":765730,"reported_tablets":26,"spinlock_wait_cycles":44525696,"child_traces":[["op",{"apply.queue_time_us":138,"apply.run_cpu_time_us":6074,"apply.run_wall_time_us":26582,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16736,"num_ops":4,"prepare.queue_time_us":28431,"prepare.run_cpu_time_us":3227,"prepare.run_wall_time_us":9418,"replication_time_us":109897,"spinlock_wait_cycles":50048,"thread_start_us":15734,"threads_started":1}]]}
I20260709 12:59:15.712949  1462 catalog_manager.cc:5697] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 9 to 11, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 11 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:15.721400  1462 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:15.725587  1462 catalog_manager.cc:5697] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 7 to 10, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:15.738101  1462 catalog_manager.cc:5697] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:15.780831  6027 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:15.781411  6027 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:15.783512  6027 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:15.784437  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:15.785226  1720 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 17: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:15.786366  6700 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.786909  6700 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:15.790940  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
I20260709 12:59:15.791538  1567 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 17.
I20260709 12:59:15.803279  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:15.804080  6811 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:15.804435  6811 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:15.804826  6811 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:15.805766  6700 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:15.808497  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:15.809077  1720 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 17.
I20260709 12:59:15.810169  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:15.811506  6700 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:15.811872  6700 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.812198  6700 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:15.829031  6811 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:15.831964  1462 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 237) took 25002 ms (client timeout 15000 ms). Trace:
I20260709 12:59:15.807344  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:15.839507  2345 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 17.
W20260709 12:59:15.836930  1462 rpcz_store.cc:269] 0709 12:58:50.829603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.829829 (+   226us) service_pool.cc:224] Handling call
0709 12:59:15.831851 (+25002022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:15.755887 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:15.756449 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:15.756491 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:59:15.756509 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:15.757134 (+   625us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:15.757187 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:15.757217 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:15.757629 (+   412us) tablet.cc:701] Row locks acquired
0709 12:59:15.757649 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:15.757786 (+   137us) write_op.cc:270] Start()
0709 12:59:15.757882 (+    96us) write_op.cc:276] Timestamp: P: 1783601955757742 usec, L: 0
0709 12:59:15.757904 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:15.758511 (+   607us) log.cc:844] Serialized 1696 byte log entry
0709 12:59:15.762927 (+  4416us) op_driver.cc:464] REPLICATION: finished
0709 12:59:15.764204 (+  1277us) write_op.cc:301] APPLY: starting
0709 12:59:15.764290 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:15.766647 (+  2357us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:15.766743 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:15.774624 (+  7881us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:15.774807 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:59:15.774863 (+    56us) write_op.cc:312] APPLY: finished
0709 12:59:15.775092 (+   229us) log.cc:844] Serialized 49 byte log entry
0709 12:59:15.775893 (+   801us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:15.776014 (+   121us) write_op.cc:454] Released schema lock
0709 12:59:15.776071 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:15.776434 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:15.776475 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1586631,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":1021,"apply.run_cpu_time_us":6155,"apply.run_wall_time_us":12192,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16736,"num_ops":4,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":2869,"prepare.run_wall_time_us":2869,"replication_time_us":4885}]]}
I20260709 12:59:15.840674  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:15.841678  6811 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:15.842723  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:15.843477  1717 raft_consensus.cc:2393] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 17: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:15.856153  6700 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:15.859475  1565 raft_consensus.cc:2368] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for earlier term 17. Current term is 18.
I20260709 12:59:15.870941  2314 leader_election.cc:400] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 election: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for earlier term 17. Current term is 18.
I20260709 12:59:15.871241  2314 leader_election.cc:403] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:59:15.872368  6027 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:15.882175  1463 catalog_manager.cc:5697] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:15.883548  1463 catalog_manager.cc:5697] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.884366  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:15.884917  1717 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:15.884990  1463 catalog_manager.cc:5697] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 11, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.885980  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:15.886370  1463 catalog_manager.cc:5697] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 13 to 14, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.887611  1463 catalog_manager.cc:5697] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 12, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 12 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:15.890570  6700 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:15.891223  1717 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 18.
I20260709 12:59:15.892517  1537 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:15.901958  6763 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:15.902503  6763 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:15.903406  6763 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:15.909041  1463 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 12, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:15.910662  1463 catalog_manager.cc:5697] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.911795  1463 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 12 to 14, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.913062  1463 catalog_manager.cc:5697] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 6 to 14, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.891846  6027 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997) with higher term. Message: Invalid argument: T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe for earlier term 17. Current term is 18.
I20260709 12:59:15.914623  1463 catalog_manager.cc:5697] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.927098  1463 catalog_manager.cc:5697] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:15.928128  1463 catalog_manager.cc:5697] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 16 to 17, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.929085  1463 catalog_manager.cc:5697] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 9 to 10, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.930114  1463 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.931305  1463 catalog_manager.cc:5697] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.932451  2345 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 18.
I20260709 12:59:15.932574  1463 catalog_manager.cc:5697] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 15, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.937446  1463 catalog_manager.cc:5697] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.938511  1463 catalog_manager.cc:5697] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 5 to 14, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.939747  1463 catalog_manager.cc:5697] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 12 to 14, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.941186  1463 catalog_manager.cc:5697] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 11 to 13, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.942523  1463 catalog_manager.cc:5697] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 13 to 14, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.944031  1463 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:15.945231  1463 catalog_manager.cc:5697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 16, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } }
I20260709 12:59:15.946540  1463 catalog_manager.cc:5697] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.947940  1463 catalog_manager.cc:5697] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.949690  1463 catalog_manager.cc:5697] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 8 to 10, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 10 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:16.110241  1454 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 52bc0b3e08ea4bd78b344b833b97faed with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c05ea12435084ad9b281ed3a0a2ecebe is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:16.155277  1461 catalog_manager.cc:5697] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:16.161981  1461 catalog_manager.cc:5697] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:16.183324  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58792
I20260709 12:59:16.184033  1717 raft_consensus.cc:606] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Received request to transfer leadership
I20260709 12:59:16.198514  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58792
I20260709 12:59:16.199110  1717 raft_consensus.cc:606] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Received request to transfer leadership
W20260709 12:59:16.204933  1456 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 52bc0b3e08ea4bd78b344b833b97faed already in progress [suppressed 23 similar messages]
I20260709 12:59:16.226230  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58792
I20260709 12:59:16.226887  1717 raft_consensus.cc:606] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Received request to transfer leadership
I20260709 12:59:16.252126  6890 raft_consensus.cc:993] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:59:16.252745  6890 raft_consensus.cc:1081] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Signalling peer c05ea12435084ad9b281ed3a0a2ecebe to start an election
I20260709 12:59:16.267313  2344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:59:16.267931  2344 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.268323  2344 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:16.293382  2344 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:16.296214  2344 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:16.298679  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:16.299356  1565 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:16.301047  1461 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46898 (request call id 135) took 24090 ms (client timeout 15000 ms). Trace:
I20260709 12:59:16.306254  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:16.307564  1647 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:16.308947  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:16.309584  1717 raft_consensus.cc:3055] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:16.309798  1717 raft_consensus.cc:740] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:16.312323  1717 consensus_queue.cc:260] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:16.315938  1717 raft_consensus.cc:3060] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:16.322746  1647 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:59:16.325470  1565 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
W20260709 12:59:16.301548  1461 rpcz_store.cc:269] 0709 12:58:52.210626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.212761 (+  2135us) service_pool.cc:224] Handling call
0709 12:59:16.300965 (+24088204us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:16.202539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:16.202928 (+   389us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:16.202952 (+    24us) write_op.cc:435] Acquired schema lock
0709 12:59:16.202964 (+    12us) tablet.cc:662] Decoding operations
0709 12:59:16.203253 (+   289us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:16.203291 (+    38us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:16.203316 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:16.203669 (+   353us) tablet.cc:701] Row locks acquired
0709 12:59:16.203688 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:16.203830 (+   142us) write_op.cc:270] Start()
0709 12:59:16.203942 (+   112us) write_op.cc:276] Timestamp: P: 1783601956203786 usec, L: 0
0709 12:59:16.203963 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:16.204559 (+   596us) log.cc:844] Serialized 919 byte log entry
0709 12:59:16.207932 (+  3373us) op_driver.cc:464] REPLICATION: finished
0709 12:59:16.208754 (+   822us) write_op.cc:301] APPLY: starting
0709 12:59:16.208840 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:16.210289 (+  1449us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:16.210392 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:16.211682 (+  1290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:16.211869 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:59:16.211924 (+    55us) write_op.cc:312] APPLY: finished
0709 12:59:16.212127 (+   203us) log.cc:844] Serialized 33 byte log entry
0709 12:59:16.212292 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.212381 (+    89us) write_op.cc:454] Released schema lock
0709 12:59:16.212424 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:16.214097 (+  1673us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.214130 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":228064,"reported_tablets":26,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":595,"apply.run_cpu_time_us":4010,"apply.run_wall_time_us":5287,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8368,"num_ops":2,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":2303,"prepare.run_wall_time_us":2303,"replication_time_us":3834}]]}
I20260709 12:59:16.327867  1717 raft_consensus.cc:2468] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
I20260709 12:59:16.329859  2314 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:16.330781  6027 raft_consensus.cc:2804] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:16.331291  6027 raft_consensus.cc:697] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:16.332095  6027 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:16.344908  1518 auto_rebalancer.cc:893] Removing replace marker failed: Replica 20c9ad12e0d0435f95be2eda5b653b39 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:16.345561  1518 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 52bc0b3e08ea4bd78b344b833b97faed already in progress
W20260709 12:59:16.345937  1518 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 52bc0b3e08ea4bd78b344b833b97faed already in progress
I20260709 12:59:16.355571  1464 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 10 to 12, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:16.359294  2344 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:59:16.360749  6755 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:16.373880  1464 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 11 to 12, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.426350  1720 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:59:16.431162  6763 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:16.526814  1465 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 9 to 13, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:16.530263  1465 catalog_manager.cc:5697] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:16.547343  1465 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:16.548964  1465 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 12 to 15, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 15 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:16.562541  1464 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58430 (request call id 231) took 26414 ms (client timeout 15000 ms). Trace:
I20260709 12:59:16.563246  1465 catalog_manager.cc:5697] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 12 to 15, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 15 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:16.577529  1465 catalog_manager.cc:5697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 10 to 15, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.587667   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:16.578713  1464 rpcz_store.cc:269] 0709 12:58:50.148421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.148696 (+   275us) service_pool.cc:224] Handling call
0709 12:59:16.562463 (+26413767us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:16.382647 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:16.383215 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:16.383250 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:59:16.383263 (+    13us) tablet.cc:662] Decoding operations
0709 12:59:16.383702 (+   439us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:16.383754 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:16.383789 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:16.384125 (+   336us) tablet.cc:701] Row locks acquired
0709 12:59:16.384141 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:59:16.384285 (+   144us) write_op.cc:270] Start()
0709 12:59:16.384403 (+   118us) write_op.cc:276] Timestamp: P: 1783601956384239 usec, L: 0
0709 12:59:16.384422 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:59:16.385057 (+   635us) log.cc:844] Serialized 919 byte log entry
0709 12:59:16.386999 (+  1942us) op_driver.cc:464] REPLICATION: finished
0709 12:59:16.387436 (+   437us) write_op.cc:301] APPLY: starting
0709 12:59:16.387521 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:16.388982 (+  1461us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:16.389089 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:16.390734 (+  1645us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:16.390928 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:59:16.390988 (+    60us) write_op.cc:312] APPLY: finished
0709 12:59:16.391194 (+   206us) log.cc:844] Serialized 33 byte log entry
0709 12:59:16.391371 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.391461 (+    90us) write_op.cc:454] Released schema lock
0709 12:59:16.391505 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:16.391878 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.391916 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2133941,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":241,"apply.run_cpu_time_us":4397,"apply.run_wall_time_us":4397,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8368,"num_ops":2,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":2669,"prepare.run_wall_time_us":2676,"replication_time_us":2453}]]}
I20260709 12:59:16.758273  1469 catalog_manager.cc:5697] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 13 to 15, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 15 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:16.761096  1469 catalog_manager.cc:5697] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 15 to 16, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 16 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:16.779100  1465 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 238) took 8429 ms. Trace:
I20260709 12:59:16.781513  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58810
I20260709 12:59:16.782104  1720 raft_consensus.cc:606] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:16.782421  1720 raft_consensus.cc:614] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:16.779533  1465 rpcz_store.cc:276] 0709 12:59:08.349916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.350123 (+   207us) service_pool.cc:224] Handling call
0709 12:59:16.779013 (+8428890us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:16.588026 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:16.588584 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:16.588618 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:59:16.588636 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:16.589536 (+   900us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:16.589598 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:16.589625 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:59:16.590293 (+   668us) tablet.cc:701] Row locks acquired
0709 12:59:16.590344 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:59:16.590613 (+   269us) write_op.cc:270] Start()
0709 12:59:16.590801 (+   188us) write_op.cc:276] Timestamp: P: 1783601956590540 usec, L: 0
0709 12:59:16.590839 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:59:16.591910 (+  1071us) log.cc:844] Serialized 2452 byte log entry
0709 12:59:16.594023 (+  2113us) op_driver.cc:464] REPLICATION: finished
0709 12:59:16.594452 (+   429us) write_op.cc:301] APPLY: starting
0709 12:59:16.594527 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:16.597966 (+  3439us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:16.598055 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:16.687295 (+ 89240us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:16.707384 (+ 20089us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:59:16.707438 (+    54us) write_op.cc:312] APPLY: finished
0709 12:59:16.707712 (+   274us) log.cc:844] Serialized 65 byte log entry
0709 12:59:16.713290 (+  5578us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.713456 (+   166us) write_op.cc:454] Released schema lock
0709 12:59:16.713502 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:16.713903 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.713934 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":152944,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":245,"apply.run_cpu_time_us":8797,"apply.run_wall_time_us":119400,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25104,"num_ops":6,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":4218,"prepare.run_wall_time_us":4219,"replication_time_us":3070}]]}
I20260709 12:59:16.785122  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58810
I20260709 12:59:16.785667  1720 raft_consensus.cc:606] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:16.789665  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "963d2113f061422e874d4718ed8d9538"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58810
I20260709 12:59:16.790251  1718 raft_consensus.cc:606] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:16.792937  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58810
I20260709 12:59:16.793442  1718 raft_consensus.cc:606] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:16.793740  1718 raft_consensus.cc:614] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:16.796165  1569 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:16.799118  6974 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:16.812835  2345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:16.813387  2345 raft_consensus.cc:606] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 19 LEADER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:16.824398   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:16.824996  6981 raft_consensus.cc:993] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:16.825531  6981 raft_consensus.cc:1081] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Signalling peer 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:16.826222   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:16.827423  1647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "963d2113f061422e874d4718ed8d9538"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:59258
I20260709 12:59:16.828007  1647 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.828344  1647 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:16.858284  1639 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:16.864051  6974 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:59:16.865191  6942 raft_consensus.cc:993] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:16.865667  6942 raft_consensus.cc:1081] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Signalling peer 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:16.869282  1640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:59258
I20260709 12:59:16.869920  1640 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.870364  1640 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:16.886296  1717 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:16.889156  6027 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:59:16.919706  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46898 (request call id 136) took 7511 ms. Trace:
I20260709 12:59:16.920149  1469 rpcz_store.cc:276] 0709 12:59:09.408170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.264154 (+855984us) service_pool.cc:224] Handling call
0709 12:59:16.919642 (+6655488us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:16.838244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:16.838768 (+   524us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:16.838803 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:59:16.838818 (+    15us) tablet.cc:662] Decoding operations
0709 12:59:16.839233 (+   415us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:16.839294 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:16.839318 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:16.839639 (+   321us) tablet.cc:701] Row locks acquired
0709 12:59:16.839657 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:59:16.839806 (+   149us) write_op.cc:270] Start()
0709 12:59:16.839925 (+   119us) write_op.cc:276] Timestamp: P: 1783601956839764 usec, L: 0
0709 12:59:16.839946 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:16.840569 (+   623us) log.cc:844] Serialized 919 byte log entry
0709 12:59:16.843283 (+  2714us) op_driver.cc:464] REPLICATION: finished
0709 12:59:16.844616 (+  1333us) write_op.cc:301] APPLY: starting
0709 12:59:16.844706 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:16.845974 (+  1268us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:16.846056 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:16.847274 (+  1218us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:16.847455 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:59:16.847498 (+    43us) write_op.cc:312] APPLY: finished
0709 12:59:16.847693 (+   195us) log.cc:844] Serialized 33 byte log entry
0709 12:59:16.847878 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.847967 (+    89us) write_op.cc:454] Released schema lock
0709 12:59:16.848015 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:16.848366 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:16.848413 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5174,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":1128,"apply.run_cpu_time_us":3695,"apply.run_wall_time_us":3695,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8368,"num_ops":2,"prepare.queue_time_us":18060,"prepare.run_cpu_time_us":2590,"prepare.run_wall_time_us":2590,"replication_time_us":3235}]]}
I20260709 12:59:16.925674  1640 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:16.939615  1647 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:16.943864  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:16.944700  1569 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:16.977123  1640 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:16.978071  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:16.978704  1717 raft_consensus.cc:3055] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:16.979002  1717 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:16.979745  1717 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:16.980844  1717 raft_consensus.cc:3060] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:16.999970  1717 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:59:17.007486  1612 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:17.008697  6875 raft_consensus.cc:2804] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:17.009250  6875 raft_consensus.cc:697] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:17.010203  6875 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:17.026546  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58430 (request call id 232) took 5154 ms. Trace:
I20260709 12:59:17.027091  1470 rpcz_store.cc:276] 0709 12:59:11.871866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.522288 (+650422us) service_pool.cc:224] Handling call
0709 12:59:17.026366 (+4504078us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8043,"reported_tablets":51}
I20260709 12:59:17.086812  1647 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:17.087144  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:17.087811  1717 raft_consensus.cc:3055] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:17.088114  1717 raft_consensus.cc:740] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:17.088923  1717 consensus_queue.cc:260] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:17.090158  1717 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:17.090510  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "963d2113f061422e874d4718ed8d9538" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:17.091112  1567 raft_consensus.cc:3060] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:17.100049  1470 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 12 to 13, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 13 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:17.104296  1567 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:17.129400  1612 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:17.130422  7034 raft_consensus.cc:2804] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:17.133610  7034 raft_consensus.cc:697] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:17.134523  7034 consensus_queue.cc:237] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:17.140250  1717 raft_consensus.cc:2468] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:17.155437  1569 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:59:17.165408  7044 raft_consensus.cc:993] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:17.171631  7044 raft_consensus.cc:1081] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 19 LEADER]: Signalling peer 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:17.198267  1465 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 15 to 18, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.201614  1465 catalog_manager.cc:5697] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 16 to 17, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:17.221959  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 51850.6us
I20260709 12:59:17.230778  1645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58328
I20260709 12:59:17.231382  1645 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.231746  1645 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:17.246214  1645 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:17.249297  1470 catalog_manager.cc:5697] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 11, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.264845  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
I20260709 12:59:17.265466  1569 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:17.267138  1470 catalog_manager.cc:5697] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 14 to 15, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 15 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.278577  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a66d6152a24cf08a833d30477e5bbe" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:17.280536  2345 raft_consensus.cc:3055] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:59:17.280877  2345 raft_consensus.cc:740] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:17.281626  2345 consensus_queue.cc:260] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:17.282686  2345 raft_consensus.cc:3060] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:17.304224  2345 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 20.
I20260709 12:59:17.305369  1610 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:17.306524  7034 raft_consensus.cc:2804] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:59:17.307339  7034 raft_consensus.cc:697] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 20 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:17.308307  7034 consensus_queue.cc:237] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:17.275628  1569 raft_consensus.cc:2468] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 20.
I20260709 12:59:17.278622  1645 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 20 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:17.390815  1470 catalog_manager.cc:5697] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 19 to 20, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 20 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.572335  1640 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:59:17.577602  1468 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 236) took 53316 ms (client timeout 15000 ms). Trace:
W20260709 12:59:17.578064  1468 rpcz_store.cc:269] 0709 12:58:24.261083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.264849 (+  3766us) service_pool.cc:224] Handling call
0709 12:59:17.577402 (+53312553us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268228,"reported_tablets":51}
I20260709 12:59:17.604818  1718 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:17.606421  1565 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:17.609246  6992 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:17.617591  6875 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:59:17.623265  1610 consensus_peers.cc:597] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b5c0052ddab4e69a58f0da887bba56e. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:17.626344  1467 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58430 (request call id 230) took 55584 ms (client timeout 15000 ms). Trace:
W20260709 12:59:17.626784  1467 rpcz_store.cc:269] 0709 12:58:22.042083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.043733 (+  1650us) service_pool.cc:224] Handling call
0709 12:58:22.190381 (+146648us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540038a254. stack: 00007f6a3f615343 00007f6a3f615240 00007f6a3efa41d4 00007f6a48ce2304 00007f6a48ce2299 00007f6a4269e090 00007f6a4273cf3a 00007f6a484f31cc 00007f6a485f137e 00007f6a46ab22a4 00007f6a46ab2232 00007f6a46ab2161 00007f6a46ab20dc 00007f6a46ab1392 00007f6a40a6f48c 00007f6a40a6e8c6
0709 12:59:17.626152 (+55435771us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12552,"reported_tablets":51,"spinlock_wait_cycles":252165376}
I20260709 12:59:17.644922  6992 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:17.648357  1718 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:17.655130  1717 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:17.656682  6875 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:17.674775  1718 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:17.676558  7034 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:17.681109  1567 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:17.682509  1568 raft_consensus.cc:1275] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:17.688736  6875 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:17.690166  6875 consensus_queue.cc:1048] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:17.726894  1468 catalog_manager.cc:5697] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:17.817760  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 82873.8us
I20260709 12:59:17.824311  2345 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:59:17.827236   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:17.827150  7056 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 12:59:17.859567  1568 raft_consensus.cc:1275] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 20 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:59:18.033612  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 60400us
W20260709 12:59:18.179124  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 143988us
W20260709 12:59:18.186074  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 151331us
I20260709 12:59:18.104405  6875 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
W20260709 12:59:18.216547  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 200405us
I20260709 12:59:18.228048  1568 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:59:18.252619  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 212759us
I20260709 12:59:18.250499  7034 consensus_queue.cc:1048] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
W20260709 12:59:18.369809  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 127378us
W20260709 12:59:18.370539  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 180020us
I20260709 12:59:18.401364  2345 consensus_queue.cc:237] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:18.416841  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 111350us
I20260709 12:59:18.448994  1567 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:18.489604  7107 ts_tablet_manager.cc:933] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:18.533149  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 55708.7us
W20260709 12:59:18.538484  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 94408us
I20260709 12:59:18.541499  1640 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:18.551594  6027 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:59:18.556811  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 113691us
I20260709 12:59:18.562029  1567 raft_consensus.cc:1275] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:59:18.608088  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 140479us
I20260709 12:59:18.628978  7107 tablet_copy_client.cc:323] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:59:18.631186  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet 7b5c0052ddab4e69a58f0da887bba56e from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:59:18.631117  7097 consensus_queue.cc:1048] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:59:18.631927  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet 7b5c0052ddab4e69a58f0da887bba56e from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-7b5c0052ddab4e69a58f0da887bba56e
W20260709 12:59:18.659751  1535 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65bdb5c7faf24eb08b41f32ba12e1932. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:18.670855  1720 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:18.651043  1657 tablet_copy_source_session.cc:215] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:18.683933  1640 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:18.692912  6700 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:18.826478  7096 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:18.834679  1569 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:18.854895  1647 raft_consensus.cc:2955] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:18.824551  7076 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 12:59:18.828192  7107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5c0052ddab4e69a58f0da887bba56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:18.888233  1463 catalog_manager.cc:5697] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 4 to 10, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 13 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:18.893777  7117 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:18.904124  1647 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:18.957024  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52bc0b3e08ea4bd78b344b833b97faed with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 12:59:18.964141  1716 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:18.976173  1717 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:59:19.002534  1684 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218ace78ff9d4582bd0fa7fe82f9654f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:19.010387  1467 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:19.014763  1640 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:19.014458  1569 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:19.018332  7065 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:19.020329  7064 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:19.026036   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:19.078058  7129 ts_tablet_manager.cc:933] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997)
I20260709 12:59:19.087224  7107 tablet_copy_client.cc:806] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.095923  7107 tablet_copy_client.cc:670] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.110582  7107 tablet_copy_client.cc:538] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:19.123831  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58810
I20260709 12:59:19.124505  1716 raft_consensus.cc:606] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:19.129294  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13d708096220406385b27d464c8725f2"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:19.129974  2344 raft_consensus.cc:606] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:19.130308  7064 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:19.132854  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:19.133450  2344 raft_consensus.cc:606] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 LEADER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:19.132109  1569 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:59:19.143177  7126 log.cc:927] Time spent T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:59:19.146313  2347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:19.146922  2347 raft_consensus.cc:606] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:19.149907  2347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:19.150425  2347 raft_consensus.cc:606] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:19.151785  7107 tablet_bootstrap.cc:492] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:59:19.162293  1640 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:19.168821   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:19.170724   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:19.125375  7129 tablet_copy_client.cc:323] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39997
I20260709 12:59:19.177894  1582 tablet_copy_service.cc:140] P 2af567a273d44ca89d2b3b0f7c815bd1: Received BeginTabletCopySession request for tablet 65bdb5c7faf24eb08b41f32ba12e1932 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:53576)
I20260709 12:59:19.178464  1582 tablet_copy_service.cc:161] P 2af567a273d44ca89d2b3b0f7c815bd1: Beginning new tablet copy session on tablet 65bdb5c7faf24eb08b41f32ba12e1932 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:53576: session id = c05ea12435084ad9b281ed3a0a2ecebe-65bdb5c7faf24eb08b41f32ba12e1932
I20260709 12:59:19.187876  1718 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:19.192807  1582 tablet_copy_source_session.cc:215] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.196748  7129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bdb5c7faf24eb08b41f32ba12e1932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.216090  7061 raft_consensus.cc:993] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:19.217255  7061 raft_consensus.cc:1081] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 LEADER]: Signalling peer 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:19.219672  1640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58328
I20260709 12:59:19.220178  1640 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.220491  1640 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:19.238868  1640 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.242841  1640 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 19 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:19.243467  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:19.244295  1718 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:19.246160  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:59:19.246348  1684 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99331ae0325b4de6bd6d097c96af6d6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:19.246716  2344 raft_consensus.cc:3055] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:19.247071  2344 raft_consensus.cc:740] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:19.247787  2344 consensus_queue.cc:260] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.249442  2344 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:19.264910  2344 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 19.
I20260709 12:59:19.265995  1610 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:19.267170  7034 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:19.267666  7034 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:19.268558  7034 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.271283  1640 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:19.274542  1718 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 19.
I20260709 12:59:19.286216  1567 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:19.276122  7080 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:59:19.359292  7098 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 12:59:19.420441  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50836.6us
W20260709 12:59:19.422019  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 133253us
I20260709 12:59:19.428965  7129 tablet_copy_client.cc:806] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.429644  7129 tablet_copy_client.cc:670] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.469182  7065 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:19.469796  7065 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.475310  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:19.479353  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" is_pre_election: true
W20260709 12:59:19.481534  7132 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:59:19.482699  7065 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:19.485345  1686 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:19.488982  7074 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:19.509049  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 52bc0b3e08ea4bd78b344b833b97faed with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:58792
I20260709 12:59:19.520465  7129 tablet_copy_client.cc:538] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:19.527135  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 73394.5us
I20260709 12:59:19.557014  7142 raft_consensus.cc:993] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:59:19.557507  7142 raft_consensus.cc:1081] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Signalling peer 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:59:19.568758  1569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13d708096220406385b27d464c8725f2"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:53576
I20260709 12:59:19.569316  1569 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.569691  1569 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:19.571656  7097 raft_consensus.cc:993] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:59:19.572153  7097 raft_consensus.cc:1081] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:59:19.573912  1716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:59:19.574438  1716 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.574805  1716 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:19.578398  7137 raft_consensus.cc:993] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:59:19.578975  7098 raft_consensus.cc:1081] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Signalling peer 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:59:19.581416  1565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:45038
I20260709 12:59:19.581902  1565 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.582259  1565 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:19.484709  7065 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:19.591950  1569 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.593849  1569 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:19.594000  7129 tablet_bootstrap.cc:492] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:59:19.596700  1565 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:19.598645  1565 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:19.613510  7150 tablet_replica.cc:333] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:19.614296  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:19.615244  1718 raft_consensus.cc:3055] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:19.615572  1718 raft_consensus.cc:740] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:19.614789  7150 raft_consensus.cc:2243] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:19.618019  1718 consensus_queue.cc:260] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:19.617020  1716 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.621474  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:19.622494  1718 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:19.634958  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:19.635156  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:19.635720  1647 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:19.635771  2344 raft_consensus.cc:3055] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:19.636267  2344 raft_consensus.cc:740] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:19.636956  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:19.637115  2344 consensus_queue.cc:260] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.637616  1640 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:19.638314  2344 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:19.638679  1718 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:19.602252  1468 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:19.640509  1537 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 
I20260709 12:59:19.643563  1468 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 18 to 19, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 19 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.648506  2344 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:59:19.649446  1716 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:19.649694  1535 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:19.651757  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:19.652318  2345 raft_consensus.cc:3055] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:19.652732  2345 raft_consensus.cc:740] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:19.653489  2345 consensus_queue.cc:260] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.654402  2345 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:19.661103  2345 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 16.
I20260709 12:59:19.662767  1684 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:19.664580  1647 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 15.
I20260709 12:59:19.668272  1640 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 13.
I20260709 12:59:19.669087  1647 raft_consensus.cc:1240] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:19.671051  7114 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:19.671803  7069 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:19.672331  7069 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:19.673223  7069 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.675578  7098 raft_consensus.cc:2804] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:19.675959  7114 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:19.676095  7098 raft_consensus.cc:697] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:19.651206  7150 raft_consensus.cc:2272] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:19.676879  7114 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:19.677102  7098 consensus_queue.cc:237] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.681023  7150 ts_tablet_manager.cc:1916] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:19.670195  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe107547ec8e475786b8fa8f8c789648" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:19.692907  1640 raft_consensus.cc:3060] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:19.670006  1569 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:19.707372  1640 raft_consensus.cc:2468] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 16.
I20260709 12:59:19.734086  7154 ts_tablet_manager.cc:933] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:19.778716  7154 tablet_copy_client.cc:323] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:59:19.777316  7151 raft_consensus.cc:993] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:19.786134  7151 raft_consensus.cc:1081] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Signalling peer 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:19.789834  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet 218ace78ff9d4582bd0fa7fe82f9654f from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:59:19.790393  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet 218ace78ff9d4582bd0fa7fe82f9654f from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-218ace78ff9d4582bd0fa7fe82f9654f
I20260709 12:59:19.793596  1640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58328
I20260709 12:59:19.794138  1640 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.794474  1640 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.784490  7107 tablet_bootstrap.cc:492] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:19.807782  7107 tablet_bootstrap.cc:492] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:59:19.808678  7107 ts_tablet_manager.cc:1403] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.657s	user 0.045s	sys 0.008s
I20260709 12:59:19.819672  1730 tablet_copy_source_session.cc:215] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.823551  7154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218ace78ff9d4582bd0fa7fe82f9654f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.815516  1647 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:19.830415  1716 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:59:19.830335  1640 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.832991  1640 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:19.833983  7077 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:19.834281  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:19.836427  1716 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.839165  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:19.839787  2345 raft_consensus.cc:3055] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:19.840080  2345 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:19.840893  2345 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.842041  2345 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.869637  2345 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:59:19.871230  1716 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
I20260709 12:59:19.871438  1610 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:19.933046  7094 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:19.933759  7094 raft_consensus.cc:697] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:19.934878  7094 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:19.938815  7107 raft_consensus.cc:359] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:19.939735  7107 raft_consensus.cc:740] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:59:19.947101  7154 tablet_copy_client.cc:806] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.947772  7154 tablet_copy_client.cc:670] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.984567  7150 ts_tablet_manager.cc:1929] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 12:59:19.988858  7150 log.cc:1199] T 52bc0b3e08ea4bd78b344b833b97faed P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/52bc0b3e08ea4bd78b344b833b97faed
I20260709 12:59:19.989140  2347 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:59:19.990772  7078 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:59:19.940466  7107 consensus_queue.cc:260] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:20.031656  7154 tablet_copy_client.cc:538] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:20.049986  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet 52bc0b3e08ea4bd78b344b833b97faed (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:59:20.075474  7159 ts_tablet_manager.cc:933] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:20.093173  7160 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:59:20.113292  1640 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:20.121798  7107 ts_tablet_manager.cc:1434] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.313s	user 0.009s	sys 0.000s
I20260709 12:59:20.127031  7074 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:20.132323  1647 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:20.134068  7068 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:59:20.171274  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 82924.5us
I20260709 12:59:20.180549  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-7b5c0052ddab4e69a58f0da887bba56e received from {username='slave'} at 127.0.0.1:58328
I20260709 12:59:20.181113  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-7b5c0052ddab4e69a58f0da887bba56e on tablet 7b5c0052ddab4e69a58f0da887bba56e with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:20.177343  7159 tablet_copy_client.cc:323] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
W20260709 12:59:20.247829  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46696.2us
I20260709 12:59:20.252323  2347 raft_consensus.cc:1275] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:20.283600  2347 raft_consensus.cc:1217] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 12:59:20.314744  1716 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:20.277742  7074 consensus_queue.cc:1048] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:59:20.330703  7069 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:20.341795   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:20.357383  1641 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:20.369885  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet 99331ae0325b4de6bd6d097c96af6d6c from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:59:20.370711  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet 99331ae0325b4de6bd6d097c96af6d6c from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-99331ae0325b4de6bd6d097c96af6d6c
W20260709 12:59:20.375818  7173 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:59:20.357800  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 103553us
I20260709 12:59:20.400022  7154 tablet_bootstrap.cc:492] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
W20260709 12:59:20.424979  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 191255us
I20260709 12:59:20.396504  1730 tablet_copy_source_session.cc:215] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:20.430713  2345 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:20.445218  7068 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 12:59:20.541117  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 86440.4us
I20260709 12:59:20.543605  1463 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58410 (request call id 247) took 1021 ms. Trace:
I20260709 12:59:20.544018  1463 rpcz_store.cc:276] 0709 12:59:19.522501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.522652 (+   151us) service_pool.cc:224] Handling call
0709 12:59:20.543543 (+1020891us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75406,"reported_tablets":2}
W20260709 12:59:20.570099  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 60218.5us
I20260709 12:59:20.576871  7076 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 12:59:20.620900  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 47738.4us
W20260709 12:59:20.720620  1610 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:43269, user_credentials={real_user=slave}} blocked reactor thread for 107293us
W20260709 12:59:20.836894  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 224445us
I20260709 12:59:20.847726  2345 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:59:20.858896  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 104146us
W20260709 12:59:20.862679  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 246014us
W20260709 12:59:20.888125  7190 log.cc:927] Time spent T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:59:20.868499  7185 log.cc:927] Time spent T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
W20260709 12:59:20.961525  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 374460us
I20260709 12:59:20.922633  7159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99331ae0325b4de6bd6d097c96af6d6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:20.965122  7188 log.cc:927] Time spent T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 12:59:20.866057  7078 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
W20260709 12:59:21.024706  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 424995us
W20260709 12:59:21.027231  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 46806.8us
W20260709 12:59:21.073320  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 50126.8us
W20260709 12:59:21.130607  7210 log.cc:927] Time spent T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:59:21.161878  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 136071us
I20260709 12:59:21.186906  7129 tablet_bootstrap.cc:492] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:21.188143  7129 tablet_bootstrap.cc:492] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:59:21.188953  7129 ts_tablet_manager.cc:1403] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 1.595s	user 0.045s	sys 0.016s
W20260709 12:59:21.196873  7196 log.cc:927] Time spent T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: Append to log took a long time: real 0.380s	user 0.007s	sys 0.000s
W20260709 12:59:21.225039  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 62242.3us
I20260709 12:59:21.226234  1463 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 14 to 15, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:21.254163  7159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59826 (request call id 655) took 1501 ms. Trace:
I20260709 12:59:21.255219  7159 rpcz_store.cc:276] 0709 12:59:19.752487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.752872 (+   385us) service_pool.cc:224] Handling call
0709 12:59:20.085523 (+332651us) ts_tablet_manager.cc:934] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
0709 12:59:20.540466 (+454943us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:21.173329 (+632863us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:21.173452 (+   123us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:21.253434 (+ 79982us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:21.253706 (+   272us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:21.254020 (+   314us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:21.254077 (+    57us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":58193,"tablet-copy.queue_time_us":166185,"thread_start_us":163971,"threads_started":2}
I20260709 12:59:21.236549  1463 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 7, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:21.262236  1463 catalog_manager.cc:5697] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 10 to 11, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.264340  1463 catalog_manager.cc:5697] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 15 to 16, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:21.268602  1716 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:21.269320  7159 tablet_copy_client.cc:806] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
W20260709 12:59:21.293226  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 272178us
I20260709 12:59:21.331741  7159 tablet_copy_client.cc:670] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:21.400133  7129 raft_consensus.cc:359] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:21.401077  7129 raft_consensus.cc:740] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:59:21.401808  7129 consensus_queue.cc:260] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:21.404188  7129 ts_tablet_manager.cc:1434] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.215s	user 0.006s	sys 0.001s
W20260709 12:59:21.410181  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 76937.4us
W20260709 12:59:21.415102  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 81762.2us
I20260709 12:59:21.451777  1582 tablet_copy_service.cc:342] P 2af567a273d44ca89d2b3b0f7c815bd1: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-65bdb5c7faf24eb08b41f32ba12e1932 received from {username='slave'} at 127.0.0.1:53576
I20260709 12:59:21.452322  1582 tablet_copy_service.cc:434] P 2af567a273d44ca89d2b3b0f7c815bd1: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-65bdb5c7faf24eb08b41f32ba12e1932 on tablet 65bdb5c7faf24eb08b41f32ba12e1932 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:21.456857  7176 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:21.469223  7180 raft_consensus.cc:1064] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:59:21.489342  7159 tablet_copy_client.cc:538] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:21.529059  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 67696.4us
W20260709 12:59:21.534822  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 71114.1us
I20260709 12:59:21.544471  7180 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:21.564056  7154 tablet_bootstrap.cc:492] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:59:21.565297  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 180646us
I20260709 12:59:21.589152  2345 raft_consensus.cc:1217] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 12:59:21.604144  7154 tablet_bootstrap.cc:492] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:59:21.606550  7154 ts_tablet_manager.cc:1403] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 1.207s	user 0.040s	sys 0.013s
I20260709 12:59:21.619242   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:21.630491  2347 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:21.632386  7212 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:21.633749  1718 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:21.635263  7212 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:21.643702  1564 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:21.645551  7176 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:21.654937  7159 tablet_bootstrap.cc:492] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:59:21.677531  7154 raft_consensus.cc:359] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:21.678946  7154 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:59:21.679677  7154 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:21.686818  7172 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:21.710843  7154 ts_tablet_manager.cc:1434] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.001s
I20260709 12:59:21.732064  2347 raft_consensus.cc:1217] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:59:21.738286  2347 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:21.748171  1467 catalog_manager.cc:5697] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 12 to 13, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.764920  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-218ace78ff9d4582bd0fa7fe82f9654f received from {username='slave'} at 127.0.0.1:48852
I20260709 12:59:21.765501  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-218ace78ff9d4582bd0fa7fe82f9654f on tablet 218ace78ff9d4582bd0fa7fe82f9654f with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:21.779098  1717 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:21.806648  1568 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:21.845567  1468 catalog_manager.cc:5697] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:21.879756  2342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3"
dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
mode: GRACEFUL
new_leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:59:21.880465  2342 raft_consensus.cc:606] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Received request to transfer leadership to TS 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:21.884963  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58810
I20260709 12:59:21.885537  1716 raft_consensus.cc:606] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:21.888818  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
mode: GRACEFUL
new_leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:58810
I20260709 12:59:21.889362  1716 raft_consensus.cc:606] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Received request to transfer leadership to TS 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:21.890731   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:21.892717   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:21.929064  1647 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:21.938834  2347 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:21.949338  1716 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:59:21.962428  7159 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:59:21.949326  7139 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:59:21.978392  7094 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:59:22.087471  7174 raft_consensus.cc:993] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:59:22.102542  7174 raft_consensus.cc:1081] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Signalling peer 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
W20260709 12:59:22.154325  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 154703us
I20260709 12:59:22.282043  1568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:45038
I20260709 12:59:22.282646  1568 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.283027  1568 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:22.291364  1568 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:22.294251  1568 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:22.350077  7159 log.cc:927] Time spent T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:22.362102  7069 raft_consensus.cc:1064] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:59:22.386126  7069 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:22.390426  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:22.391134  1647 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:22.398524  1647 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:22.426144  1535 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:22.427685  7257 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:22.428202  7257 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:22.430431  7257 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:22.463459  1645 raft_consensus.cc:1240] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Rejecting Update request from peer 20c9ad12e0d0435f95be2eda5b653b39 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:22.482445  1645 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:22.487040  7183 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:59:22.488714  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:22.493661  1718 raft_consensus.cc:3055] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:22.494035  1718 raft_consensus.cc:740] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:22.494828  1718 consensus_queue.cc:260] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:22.489966  7176 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:22.501343  1718 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:22.505600  7159 tablet_bootstrap.cc:492] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:22.517365  7159 tablet_bootstrap.cc:492] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:59:22.518848  7204 raft_consensus.cc:993] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: : Instructing follower 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:22.523802  7204 raft_consensus.cc:1081] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Signalling peer 7a04d0a2963b4860beb7cd14e0b4939a to start an election
I20260709 12:59:22.526798  1646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
 from {username='slave'} at 127.0.0.1:58328
I20260709 12:59:22.527315  1646 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.527670  1646 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:22.530045  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 57463.9us
I20260709 12:59:22.537657  1646 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:22.539978  1646 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 election: Requested vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:22.538087  7159 ts_tablet_manager.cc:1403] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.883s	user 0.027s	sys 0.012s
I20260709 12:59:22.540737  1467 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 13 to 14, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:22.539759  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 51570.5us
I20260709 12:59:22.543476  7159 raft_consensus.cc:359] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:22.545024  7159 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:59:22.546988  7159 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:22.549865  7159 ts_tablet_manager.cc:1434] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 12:59:22.574457  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.576808  2342 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:22.567215  1714 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:22.588896  1718 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 14.
I20260709 12:59:22.590215  2347 raft_consensus.cc:2955] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:22.599494  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:22.600322  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:22.600901  2345 raft_consensus.cc:3055] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:22.601207  2345 raft_consensus.cc:740] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:22.600055  1714 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:22.601966  2345 consensus_queue.cc:260] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:22.598541  7257 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:59:22.603044  2345 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:22.584949  7214 raft_consensus.cc:993] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: : Instructing follower 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:59:22.608184  1714 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 17.
I20260709 12:59:22.619362  2345 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 17.
I20260709 12:59:22.620801  1610 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:22.625228  7214 raft_consensus.cc:1081] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Signalling peer 2af567a273d44ca89d2b3b0f7c815bd1 to start an election
I20260709 12:59:22.627139  7250 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:22.627789  7250 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:22.628876  7250 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:22.639050  1565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c"
dest_uuid: "2af567a273d44ca89d2b3b0f7c815bd1"
 from {username='slave'} at 127.0.0.1:45038
I20260709 12:59:22.639663  1565 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.640089  1565 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.642616  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b5c0052ddab4e69a58f0da887bba56e with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:22.654826  1565 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:22.674196  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:22.674786  1647 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.676301  1565 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:22.668005  1468 catalog_manager.cc:5697] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 10 to 11, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 15 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:22.693801  1647 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:59:22.696280  1535 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:22.693626  1645 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:22.699489  1714 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:22.705159  7257 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:22.705677  7257 raft_consensus.cc:697] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Becoming Leader. State: Replica: 2af567a273d44ca89d2b3b0f7c815bd1, State: Running, Role: LEADER
I20260709 12:59:22.706552  7257 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:22.693778  7183 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:22.716679  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:22.717253  1714 raft_consensus.cc:3055] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:22.717521  1714 raft_consensus.cc:740] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:22.718256  1714 consensus_queue.cc:260] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:22.719769  1714 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:22.728885  1464 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 16 to 17, leader changed from c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 17 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.731155  1714 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af567a273d44ca89d2b3b0f7c815bd1 in term 11.
I20260709 12:59:22.759613  7069 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:22.765614  1714 raft_consensus.cc:1240] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Rejecting Update request from peer c05ea12435084ad9b281ed3a0a2ecebe for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:22.767174  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-99331ae0325b4de6bd6d097c96af6d6c received from {username='slave'} at 127.0.0.1:48852
I20260709 12:59:22.767710  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-99331ae0325b4de6bd6d097c96af6d6c on tablet 99331ae0325b4de6bd6d097c96af6d6c with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:22.799047  1468 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:22.829454  1714 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:22.861719  1464 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: term changed from 10 to 11, leader changed from 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) to 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.884243  2347 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:22.917130  2345 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEARNER]: Advancing to term 14
I20260709 12:59:22.918190  1647 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:22.919533  7177 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:22.925598  2345 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:22.929549  7183 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:22.935189   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:22.990808  1556 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b5c0052ddab4e69a58f0da887bba56e with delete_type TABLET_DATA_TOMBSTONED (TS 2af567a273d44ca89d2b3b0f7c815bd1 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:60698
I20260709 12:59:23.036460  7277 tablet_replica.cc:333] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:23.037639  7277 raft_consensus.cc:2243] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:23.038339  7277 raft_consensus.cc:2272] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:23.042770  7232 raft_consensus.cc:1064] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
W20260709 12:59:23.043197  7232 raft_consensus.cc:1068] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: Unable to promote non-voter c05ea12435084ad9b281ed3a0a2ecebe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:23.061923  1714 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:23.063119  7277 ts_tablet_manager.cc:1916] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:23.067551  7179 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:23.048592  1568 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:23.078904  2345 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:23.081156  7232 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:23.090346  1646 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:23.130409  7232 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.137940  2345 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:59:23.146102  7094 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:59:23.155067  7277 ts_tablet_manager.cc:1929] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 12:59:23.155583  7277 log.cc:1199] T 7b5c0052ddab4e69a58f0da887bba56e P 2af567a273d44ca89d2b3b0f7c815bd1: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-0-root/wals/7b5c0052ddab4e69a58f0da887bba56e
I20260709 12:59:23.158737  2345 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEARNER]: Advancing to term 11
I20260709 12:59:23.156711  7179 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:23.173698  2345 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:23.177596  2345 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.178510  7069 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:59:23.190173  7220 raft_consensus.cc:1064] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:59:23.198081  1456 catalog_manager.cc:5028] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): tablet 7b5c0052ddab4e69a58f0da887bba56e (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:59:23.204731  7220 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:23.215934  1640 raft_consensus.cc:2955] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.228312  1714 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:59:23.236075  7180 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:23.252956  1467 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 10 to 11, VOTER 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195) evicted. New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.293978  1718 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:23.295188  2342 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:23.296662  1640 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:23.326926  7183 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:59:23.360862  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 68183us
I20260709 12:59:23.365793  7232 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:59:23.361100  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 54310.3us
I20260709 12:59:23.374408  1640 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:23.397269  1719 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:23.399410  7183 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:23.462325  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65bdb5c7faf24eb08b41f32ba12e1932 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:23.487349  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bdb5c7faf24eb08b41f32ba12e1932 with delete_type TABLET_DATA_TOMBSTONED (TS 20c9ad12e0d0435f95be2eda5b653b39 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:58792
I20260709 12:59:23.497972  7069 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:23.585382  7295 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 8 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.598644  7220 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:23.652951  7286 raft_consensus.cc:1064] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
W20260709 12:59:23.670969  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 45795.8us
I20260709 12:59:23.680245  1643 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 8 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.697294  7292 tablet_replica.cc:333] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:23.699735  7292 raft_consensus.cc:2243] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:23.701679  7292 raft_consensus.cc:2272] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:23.710084  2347 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 8 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.745510  7292 ts_tablet_manager.cc:1916] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:23.762717  7286 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:23.788017  1717 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:23.783604  1468 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 8 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.811339  7069 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:23.813866  1717 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 8 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.831614  2345 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEARNER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:23.843153  1643 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:23.906103  7069 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:23.922224  7069 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:23.953248  7292 ts_tablet_manager.cc:1929] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:59:23.953927  1565 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:23.953504  7220 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 7 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.957355  2347 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.977779  7292 log.cc:1199] T 65bdb5c7faf24eb08b41f32ba12e1932 P 20c9ad12e0d0435f95be2eda5b653b39: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-2-root/wals/65bdb5c7faf24eb08b41f32ba12e1932
I20260709 12:59:23.980187  2345 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:23.982359  7286 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:23.989661  1456 catalog_manager.cc:5028] TS 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): tablet 65bdb5c7faf24eb08b41f32ba12e1932 (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:59:23.992690  7069 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:23.994642  2342 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:24.001327  1717 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:24.002851  7286 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:24.004984  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 218ace78ff9d4582bd0fa7fe82f9654f with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:24.012007  1717 raft_consensus.cc:2955] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:24.014967  1467 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 10 to 11, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 14 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.033522  1718 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:24.046885  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet 218ace78ff9d4582bd0fa7fe82f9654f with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:57522
I20260709 12:59:24.059413  1467 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 reported cstate change: config changed from index 7 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.066975  1643 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:24.094276  7300 tablet_replica.cc:333] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:24.095665  7300 raft_consensus.cc:2243] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:24.109723  1567 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:24.124930  7300 raft_consensus.cc:2272] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:24.141506  2347 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:24.144843  7069 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:24.167303  1718 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 2af567a273d44ca89d2b3b0f7c815bd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:24.176402  7295 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:24.178386  7295 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:24.179425   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:24.188169  1718 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:24.200136  2345 raft_consensus.cc:2955] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:24.197556  7300 ts_tablet_manager.cc:1916] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:24.226285  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99331ae0325b4de6bd6d097c96af6d6c with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:24.258821  1468 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 9 to 10, VOTER 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) evicted. New cstate: current_term: 11 leader_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:24.307931  1628 tablet_service.cc:1558] Processing DeleteTablet for tablet 99331ae0325b4de6bd6d097c96af6d6c with delete_type TABLET_DATA_TOMBSTONED (TS 7a04d0a2963b4860beb7cd14e0b4939a not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:57522
I20260709 12:59:24.322002  7300 ts_tablet_manager.cc:1929] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:59:24.327581  7300 log.cc:1199] T 218ace78ff9d4582bd0fa7fe82f9654f P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/218ace78ff9d4582bd0fa7fe82f9654f
I20260709 12:59:24.335212  7300 tablet_replica.cc:333] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:24.335219  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet 218ace78ff9d4582bd0fa7fe82f9654f (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:59:24.336495  7300 raft_consensus.cc:2243] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:24.337415  7300 raft_consensus.cc:2272] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:24.349967  7300 ts_tablet_manager.cc:1916] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:24.394688  7300 ts_tablet_manager.cc:1929] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:59:24.395192  7300 log.cc:1199] T 99331ae0325b4de6bd6d097c96af6d6c P 7a04d0a2963b4860beb7cd14e0b4939a: Deleting WAL directory at /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601766316156-431-0/minicluster-data/ts-1-root/wals/99331ae0325b4de6bd6d097c96af6d6c
I20260709 12:59:24.397032  1454 catalog_manager.cc:5028] TS 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): tablet 99331ae0325b4de6bd6d097c96af6d6c (table test-workload [id=a8543a44953d40aba702514824998735]) successfully deleted
I20260709 12:59:24.403271  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4"
dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
mode: GRACEFUL
new_leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46424
I20260709 12:59:24.403975  1646 raft_consensus.cc:606] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Received request to transfer leadership to TS 20c9ad12e0d0435f95be2eda5b653b39
I20260709 12:59:24.407742   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:59:24.410722   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:24.708772  7144 raft_consensus.cc:993] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: : Instructing follower 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:59:24.709316  7144 raft_consensus.cc:1081] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Signalling peer 20c9ad12e0d0435f95be2eda5b653b39 to start an election
I20260709 12:59:24.714834  1718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4"
dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
 from {username='slave'} at 127.0.0.1:46160
I20260709 12:59:24.715471  1718 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.715788  1718 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:24.737986  1718 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:24.753748  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:24.754490  1646 raft_consensus.cc:3055] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:24.754805  1646 raft_consensus.cc:740] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:24.755667  1646 consensus_queue.cc:260] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:24.762343  1646 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:24.772372  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997bea07114b4964bbe0c9bc9185a7f4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:24.773003  2345 raft_consensus.cc:3060] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:24.780505  2345 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:24.786108  1684 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:24.787103  7211 raft_consensus.cc:2804] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:24.787622  7211 raft_consensus.cc:697] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:24.788532  7211 consensus_queue.cc:237] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:24.796696  1718 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:24.809705  1646 raft_consensus.cc:2468] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 12.
I20260709 12:59:24.812148  1464 catalog_manager.cc:5697] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 11 to 12, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.283787  2345 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:25.299757  7170 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:25.364465  1643 raft_consensus.cc:1275] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:59:25.368191  7214 consensus_queue.cc:1048] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:25.414731   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:25.481590  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 52290.6us
I20260709 12:59:25.554677  1717 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:59:25.588733  1684 consensus_peers.cc:597] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af922e165f0c427eacd26ca4bc111d76. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.589771  1646 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:25.593614  1565 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:25.597071  7211 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:25.599092  7211 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:25.614382   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 12:59:25.617362  1612 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:25.621722  7170 raft_consensus.cc:2955] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:59:25.624485  1612 consensus_peers.cc:597] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.648479  1612 consensus_peers.cc:597] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.676010  1612 consensus_peers.cc:597] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.678799  1686 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.679003  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.681412  1686 consensus_peers.cc:597] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.708319  1646 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:25.708935  1645 raft_consensus.cc:2955] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:59:25.713601  1686 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.747514  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.752460  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.758468  1686 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.762779  1717 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:59:25.768921  1686 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.772583  1612 consensus_peers.cc:597] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.772415  7311 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:59:25.778180  1610 consensus_peers.cc:597] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85c93ae6dea242bf9de5cf30087783be. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.784097  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.785934  1612 consensus_peers.cc:597] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.794494  1612 consensus_peers.cc:597] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.795997  1464 catalog_manager.cc:5697] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:25.820528  1686 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.859274  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.877696  7144 raft_consensus.cc:2955] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index -1 to 10, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:25.880451  1717 raft_consensus.cc:2955] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index -1 to 10, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
W20260709 12:59:25.898548  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.901499  1686 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.902285  1686 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.908783  1686 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.915426  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.927534  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 81235.5us
W20260709 12:59:25.930586  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.947049  1686 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.955251  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.958848  1612 consensus_peers.cc:597] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.978636  1612 consensus_peers.cc:597] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.986303  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:25.992264  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.010417  1645 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:26.030992   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:26.040369   431 tablet_replica.cc:333] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.049238   431 raft_consensus.cc:2243] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.050621   431 raft_consensus.cc:2272] T 26cba50eaa264fd889cd8a4587b03948 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:26.056759  1610 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26cba50eaa264fd889cd8a4587b03948. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.058467   431 tablet_replica.cc:333] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.059684   431 raft_consensus.cc:2243] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.061043   431 raft_consensus.cc:2272] T a2aea8dafba3428dbb6d189666a9957b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.067359   431 tablet_replica.cc:333] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.068411  7330 ts_tablet_manager.cc:933] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:26.085525  1686 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.090750   431 raft_consensus.cc:2243] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.094269   431 raft_consensus.cc:2272] T 13d708096220406385b27d464c8725f2 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.107949  1717 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:26.113703  7094 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:26.115823  7330 tablet_copy_client.cc:323] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:59:26.123509   431 tablet_replica.cc:333] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.126325  1730 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet af922e165f0c427eacd26ca4bc111d76 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:59:26.126945  1730 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet af922e165f0c427eacd26ca4bc111d76 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-af922e165f0c427eacd26ca4bc111d76
W20260709 12:59:26.130951  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:26.132404  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.124502   431 raft_consensus.cc:2243] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.137603   431 raft_consensus.cc:2272] T 523c299f124340818ee040d8a887dba6 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.140769   431 tablet_replica.cc:333] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.141016  1730 tablet_copy_source_session.cc:215] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.141698   431 raft_consensus.cc:2243] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.142361   431 raft_consensus.cc:2272] T 85c93ae6dea242bf9de5cf30087783be P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:26.152777  1686 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.153646  7330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af922e165f0c427eacd26ca4bc111d76. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:26.158788  1612 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:26.161372  1612 consensus_peers.cc:597] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.166968   431 tablet_replica.cc:333] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.167991   431 raft_consensus.cc:2243] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.168700   431 raft_consensus.cc:2272] T a3d04144cd804a9b886ecfd1a986ec95 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.172024   431 tablet_replica.cc:333] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.172910   431 raft_consensus.cc:2243] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.173662   431 raft_consensus.cc:2272] T 4da9bedf7aba45139d86ca314258a105 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.176667  1464 catalog_manager.cc:5697] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 10, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 11 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:26.202836  7330 tablet_copy_client.cc:806] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:26.203526  7330 tablet_copy_client.cc:670] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:26.208483  7144 raft_consensus.cc:2955] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:26.210237  1718 raft_consensus.cc:2955] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:26.222249   431 tablet_replica.cc:333] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.223187   431 raft_consensus.cc:2243] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.223832   431 raft_consensus.cc:2272] T 1b56889944b24c9cb46eb080b37a2d4b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.238200  7330 tablet_copy_client.cc:538] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:26.248286   431 tablet_replica.cc:333] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.264719   431 raft_consensus.cc:2243] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.266047   431 raft_consensus.cc:2272] T 598f1b27b4ab45cfac5cc13489b2e687 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.269876   431 tablet_replica.cc:333] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.274046   431 raft_consensus.cc:2243] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.275739   431 raft_consensus.cc:2272] T a598709808884384ad6ce3e99aa4345a P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.270316  1718 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:26.278313  7330 tablet_bootstrap.cc:492] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:59:26.293493  1464 catalog_manager.cc:5697] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index -1 to 8, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:26.294984   431 tablet_replica.cc:333] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.306664   431 raft_consensus.cc:2243] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.307343   431 raft_consensus.cc:2272] T 35c533e32b324f8f80c12f5380f0c92d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.310285   431 tablet_replica.cc:333] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.315369  1645 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:59:26.319726  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:26.322585  1684 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269): Couldn't send request to peer c05ea12435084ad9b281ed3a0a2ecebe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45ae77627c4743fc864bb7da44bb00b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.323866  7211 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:26.342155   431 raft_consensus.cc:2243] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.346230   431 raft_consensus.cc:2272] T 57f5c2cabd34469aa65eff4ffae3e350 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.356240   431 tablet_replica.cc:333] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.378005   431 raft_consensus.cc:2243] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.384873  7170 raft_consensus.cc:2955] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:26.386965   431 raft_consensus.cc:2272] T b51b349fdba540c3a8c0e167720c3a7c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.391414   431 tablet_replica.cc:333] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.397950   431 raft_consensus.cc:2243] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.416182   431 raft_consensus.cc:2272] T 3df7e2e5458047a9a8b0d6a07577bbbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.394479  1645 raft_consensus.cc:2955] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:26.419123   431 tablet_replica.cc:333] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.421453   431 raft_consensus.cc:2243] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.422116   431 raft_consensus.cc:2272] T d5a66d6152a24cf08a833d30477e5bbe P 2af567a273d44ca89d2b3b0f7c815bd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.424574  7338 ts_tablet_manager.cc:933] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:26.430763   431 tablet_replica.cc:333] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.431715   431 raft_consensus.cc:2243] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.449793   431 raft_consensus.cc:2272] T 963d2113f061422e874d4718ed8d9538 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.454176   431 tablet_replica.cc:333] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.455065   431 raft_consensus.cc:2243] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.455732  7338 tablet_copy_client.cc:323] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:59:26.455727   431 raft_consensus.cc:2272] T acc3fcdecc7546fe92075e15e904c331 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.457993  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet 85c93ae6dea242bf9de5cf30087783be from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:59:26.458588  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet 85c93ae6dea242bf9de5cf30087783be from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-85c93ae6dea242bf9de5cf30087783be
I20260709 12:59:26.460301   431 tablet_replica.cc:333] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.461786   431 raft_consensus.cc:2243] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.456961  1463 catalog_manager.cc:5697] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index -1 to 9, NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } }
I20260709 12:59:26.463899   431 raft_consensus.cc:2272] T 99331ae0325b4de6bd6d097c96af6d6c P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.473131   431 tablet_replica.cc:333] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.478165   431 raft_consensus.cc:2243] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.479590   431 raft_consensus.cc:2272] T c680cef608164c689f7de9b00b60e72d P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.483538   431 tablet_replica.cc:333] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.484369   431 raft_consensus.cc:2243] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.485121   431 raft_consensus.cc:2272] T fdd982fdd5b6440bbcf0eaf350f5124f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.508706  1657 tablet_copy_source_session.cc:215] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.518222   431 tablet_replica.cc:333] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.519214   431 raft_consensus.cc:2243] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.519800   431 pending_rounds.cc:70] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Trying to abort 1 pending ops.
I20260709 12:59:26.520052   431 pending_rounds.cc:77] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1: Aborting op as it isn't in flight: id { term: 13 index: 8 } timestamp: 7305633650906693632 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "af922e165f0c427eacd26ca4bc111d76" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } } new_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } } } }
I20260709 12:59:26.521090   431 raft_consensus.cc:2917] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Aborting config change with OpId 13.8: Aborted: Op aborted
I20260709 12:59:26.521724   431 raft_consensus.cc:2889] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:59:26.522099   431 raft_consensus.cc:2272] T af922e165f0c427eacd26ca4bc111d76 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.522746  7338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c93ae6dea242bf9de5cf30087783be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:26.540841   431 tablet_replica.cc:333] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.545363   431 raft_consensus.cc:2243] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.546478   431 raft_consensus.cc:2272] T 295d06aa958a45069eef5737c8adf1ff P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.552109  7338 tablet_copy_client.cc:806] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:26.561751  7338 tablet_copy_client.cc:670] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:26.541217  7341 ts_tablet_manager.cc:933] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:26.564241   431 tablet_replica.cc:333] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.566009  7338 tablet_copy_client.cc:538] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:26.574183   431 raft_consensus.cc:2243] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.581010  7341 tablet_copy_client.cc:323] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33881
I20260709 12:59:26.581455   431 raft_consensus.cc:2272] T a008f8fc81244052803539fc7317853b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.585027   431 tablet_replica.cc:333] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.585995   431 raft_consensus.cc:2243] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.586804   431 raft_consensus.cc:2272] T 46fb86b9f3304b99a092fa35dffe1813 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.590008   431 tablet_replica.cc:333] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.590504  1657 tablet_copy_service.cc:140] P 7a04d0a2963b4860beb7cd14e0b4939a: Received BeginTabletCopySession request for tablet 26cba50eaa264fd889cd8a4587b03948 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:58328)
I20260709 12:59:26.590837   431 raft_consensus.cc:2243] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.591210  1657 tablet_copy_service.cc:161] P 7a04d0a2963b4860beb7cd14e0b4939a: Beginning new tablet copy session on tablet 26cba50eaa264fd889cd8a4587b03948 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:58328: session id = c05ea12435084ad9b281ed3a0a2ecebe-26cba50eaa264fd889cd8a4587b03948
I20260709 12:59:26.591744   431 raft_consensus.cc:2272] T 508332d25a2b4288bc6411b566044758 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.599016   431 tablet_replica.cc:333] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.599910   431 raft_consensus.cc:2243] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.601155   431 raft_consensus.cc:2272] T 089ef23951ac45c3a80b53b6e8127c61 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.604452   431 tablet_replica.cc:333] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.605363   431 raft_consensus.cc:2243] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.607678  1657 tablet_copy_source_session.cc:215] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.611780  7338 tablet_bootstrap.cc:492] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:59:26.617106  7341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cba50eaa264fd889cd8a4587b03948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:26.621601  7320 raft_consensus.cc:493] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:26.622141  7320 raft_consensus.cc:515] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:26.624327  7320 leader_election.cc:290] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:26.606484   431 raft_consensus.cc:2272] T 88ae4cb056ac43519786f1fb62431bc4 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.629592  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:26.626246  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27982349e557426eb54944f0699b5f79" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:26.644784   431 tablet_replica.cc:333] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.645728   431 raft_consensus.cc:2243] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.647454  1535 leader_election.cc:304] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:26.648280  7320 raft_consensus.cc:2749] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:26.647655   431 raft_consensus.cc:2272] T 061154c4edb1414ca27eef7f6a49a794 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.653187   431 tablet_replica.cc:333] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.657505   431 raft_consensus.cc:2243] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.663527   431 raft_consensus.cc:2272] T a3e979717db64b77b569522980fab6af P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.669508  7341 tablet_copy_client.cc:806] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:26.671459  7341 tablet_copy_client.cc:670] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:26.744299  7320 raft_consensus.cc:493] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:26.745066  7320 raft_consensus.cc:515] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:26.768939   431 tablet_replica.cc:333] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.769891   431 raft_consensus.cc:2243] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.770299  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:26.771055   431 raft_consensus.cc:2272] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:26.772876  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 52814us
I20260709 12:59:26.774556  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dd8bcf618a48bb9d3dc5e16f488fcf" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:26.776748  7341 tablet_copy_client.cc:538] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:26.777287  1535 leader_election.cc:304] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:26.772737  7320 leader_election.cc:290] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:26.778276  7320 raft_consensus.cc:2749] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:26.778434  7330 tablet_bootstrap.cc:492] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:26.779451  7330 tablet_bootstrap.cc:492] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:59:26.776737  7325 raft_consensus.cc:493] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:26.785710  7325 raft_consensus.cc:515] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:26.787978  7325 leader_election.cc:290] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:26.793293  7325 raft_consensus.cc:493] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:26.796607  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:26.800226  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc0b3e08ea4bd78b344b833b97faed" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:26.794940  7341 tablet_bootstrap.cc:492] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
I20260709 12:59:26.803020  7343 raft_consensus.cc:493] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:26.794166  7325 raft_consensus.cc:515] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:26.827137  7325 leader_election.cc:290] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:26.827445  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:26.832221  7343 raft_consensus.cc:515] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:26.835371  7343 leader_election.cc:290] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:26.835562  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:26.835860  7343 raft_consensus.cc:493] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:26.801909  7330 ts_tablet_manager.cc:1403] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.522s	user 0.030s	sys 0.012s
I20260709 12:59:26.838616   431 tablet_replica.cc:333] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.794516  7320 raft_consensus.cc:493] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:26.879549  7344 ts_tablet_manager.cc:933] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: Initiating tablet copy from peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:26.890941   431 raft_consensus.cc:2243] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.909271  7330 raft_consensus.cc:359] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:26.836417  7343 raft_consensus.cc:515] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:26.940984  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 138918us
I20260709 12:59:26.944047  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30729cf665ff46d199eb9632bd1f5ad1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:26.944780  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5064e0cc33a4a9383fca6c8ee736c18" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:26.945550  7325 raft_consensus.cc:493] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:26.946055  7325 raft_consensus.cc:515] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:26.948736  1535 leader_election.cc:304] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:26.897764  7320 raft_consensus.cc:515] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:26.950919  1535 leader_election.cc:304] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:26.951071  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:26.956238  7345 raft_consensus.cc:493] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:26.958567   431 raft_consensus.cc:2272] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.957770  7345 raft_consensus.cc:515] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:26.978260   431 tablet_replica.cc:333] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.979293   431 raft_consensus.cc:2243] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:26.981410   431 raft_consensus.cc:2272] T db00224dfea24cb2a0a2400d9b4a907f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.982754  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:26.983144  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:26.948027  7325 leader_election.cc:290] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:26.989185   431 tablet_replica.cc:333] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:26.941422  7330 raft_consensus.cc:740] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:59:26.995716   431 raft_consensus.cc:2243] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.998119  7345 leader_election.cc:290] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:27.000983  7350 raft_consensus.cc:2749] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:27.001785  7350 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:27.002362  7350 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.004878  7320 leader_election.cc:290] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:27.013741  7347 raft_consensus.cc:493] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:27.020761  7338 tablet_bootstrap.cc:492] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.051478  7347 raft_consensus.cc:515] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.052073  7338 tablet_bootstrap.cc:492] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
I20260709 12:59:27.052922  7338 ts_tablet_manager.cc:1403] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.446s	user 0.055s	sys 0.035s
I20260709 12:59:26.994699  7343 leader_election.cc:290] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:26.992311  7325 raft_consensus.cc:2749] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:27.056559  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.023204  7330 consensus_queue.cc:260] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:27.060702  7330 ts_tablet_manager.cc:1434] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.204s	user 0.010s	sys 0.000s
I20260709 12:59:27.062065  7170 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.031754  7326 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.062561  7170 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.062934  7326 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.040809  7348 raft_consensus.cc:493] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:27.068104  7348 raft_consensus.cc:515] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.070309  7348 leader_election.cc:290] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:27.072618  2314 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.045308   431 raft_consensus.cc:2272] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:27.049180  1535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 98320.6us
I20260709 12:59:27.075909  1535 leader_election.cc:304] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:27.076527  1535 raft_consensus.cc:2686] T c5064e0cc33a4a9383fca6c8ee736c18 P 2af567a273d44ca89d2b3b0f7c815bd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:59:27.079679  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.081362  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d01fa5de23643a7bc42ad00178a7f51" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:27.081705  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b62689c0094341b01c7263292dd753" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:27.082147  1686 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.082731  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:27.082875  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302e4f74a6c4ff2915495d3ac0982bc" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:27.083650  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:27.085505  7214 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:27.085817  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.087091  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa36fcde2c4a1fa46a60cb9a82a16f" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.087601  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.088342  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89071a75dff1449588d2f1f4d1b1fb15" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.088958  2312 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:27.089854  7204 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:27.054896  7347 leader_election.cc:290] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.093842  7347 raft_consensus.cc:493] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:27.094300  7347 raft_consensus.cc:515] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.096283  7347 leader_election.cc:290] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.024495  7345 raft_consensus.cc:493] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:27.096904  7345 raft_consensus.cc:515] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.099431  7345 leader_election.cc:290] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:27.067507  7326 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:27.064446  7170 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:27.136623  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 51878.4us
I20260709 12:59:27.139061  7338 raft_consensus.cc:359] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:27.140089  7338 raft_consensus.cc:740] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:59:27.141330   431 tablet_replica.cc:333] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.140822  7338 consensus_queue.cc:260] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:27.142216   431 raft_consensus.cc:2243] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.143595  7338 ts_tablet_manager.cc:1434] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260709 12:59:27.144424  1535 leader_election.cc:304] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:27.144618  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:27.145936  1535 leader_election.cc:304] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:27.145967  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-85c93ae6dea242bf9de5cf30087783be received from {username='slave'} at 127.0.0.1:58328
I20260709 12:59:27.147406  1535 leader_election.cc:304] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:27.151036  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-85c93ae6dea242bf9de5cf30087783be on tablet 85c93ae6dea242bf9de5cf30087783be with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:27.158746   431 raft_consensus.cc:2272] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.162447  7320 raft_consensus.cc:2749] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:27.164960  7350 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.157258  7347 raft_consensus.cc:2749] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:27.167618  1535 leader_election.cc:304] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:27.148178  7345 raft_consensus.cc:493] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c05ea12435084ad9b281ed3a0a2ecebe)
I20260709 12:59:27.173506   431 tablet_replica.cc:333] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.177285   431 raft_consensus.cc:2243] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.177882   431 raft_consensus.cc:2272] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:27.190147  1535 raft_consensus.cc:2686] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 2af567a273d44ca89d2b3b0f7c815bd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:59:27.191274  1535 leader_election.cc:304] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:27.162207  7344 tablet_copy_client.cc:323] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:36649
I20260709 12:59:27.187835   431 tablet_replica.cc:333] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.197535  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fb4f5285564d94ab4d48e9ec00f31b" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.169895  7343 raft_consensus.cc:2749] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:27.199736  7345 raft_consensus.cc:515] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.219208  7345 leader_election.cc:290] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:27.224527  1731 tablet_copy_service.cc:140] P 20c9ad12e0d0435f95be2eda5b653b39: Received BeginTabletCopySession request for tablet 45ae77627c4743fc864bb7da44bb00b3 from peer c05ea12435084ad9b281ed3a0a2ecebe ({username='slave'} at 127.0.0.1:48852)
I20260709 12:59:27.232511   431 raft_consensus.cc:2243] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.204038  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.205493  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbeca1b8e9f46c5843a82bafe73b5a8" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.207365  1537 leader_election.cc:304] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:27.207614  1730 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-af922e165f0c427eacd26ca4bc111d76 received from {username='slave'} at 127.0.0.1:48852
I20260709 12:59:27.209017  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.195834  7350 raft_consensus.cc:2749] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:27.246861  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:27.251170  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 43996.6us
I20260709 12:59:27.257901  1730 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-af922e165f0c427eacd26ca4bc111d76 on tablet af922e165f0c427eacd26ca4bc111d76 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:27.259117  7347 raft_consensus.cc:2749] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:27.264068  1731 tablet_copy_service.cc:161] P 20c9ad12e0d0435f95be2eda5b653b39: Beginning new tablet copy session on tablet 45ae77627c4743fc864bb7da44bb00b3 from peer c05ea12435084ad9b281ed3a0a2ecebe at {username='slave'} at 127.0.0.1:48852: session id = c05ea12435084ad9b281ed3a0a2ecebe-45ae77627c4743fc864bb7da44bb00b3
I20260709 12:59:27.274298  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed697fc3d1e49f2ac09064ed3b8abc1" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.278057  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae77627c4743fc864bb7da44bb00b3" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.282959  1537 leader_election.cc:304] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:27.286490  1537 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:27.287701  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b6c0f44a54d0cb3e8050968db2158" candidate_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
W20260709 12:59:27.291106  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 114969us
W20260709 12:59:27.295796  1537 raft_consensus.cc:2686] T 45ae77627c4743fc864bb7da44bb00b3 P 2af567a273d44ca89d2b3b0f7c815bd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:59:27.296860  1535 leader_election.cc:304] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:27.289893  7343 raft_consensus.cc:2749] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:27.306010  7347 raft_consensus.cc:2706] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Received pre-election callback for term 11 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:59:27.306617   431 raft_consensus.cc:2272] T 075b6c0f44a54d0cb3e8050968db2158 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.312884   431 tablet_replica.cc:333] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.314005   431 raft_consensus.cc:2243] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:27.316799   431 raft_consensus.cc:2272] T 218ace78ff9d4582bd0fa7fe82f9654f P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.321259  1537 leader_election.cc:304] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af567a273d44ca89d2b3b0f7c815bd1; no voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:27.330536  1537 raft_consensus.cc:2686] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 2af567a273d44ca89d2b3b0f7c815bd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:59:27.334299  1731 tablet_copy_source_session.cc:215] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:27.336187   431 tablet_replica.cc:333] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.337028   431 raft_consensus.cc:2243] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.337661   431 raft_consensus.cc:2272] T 30729cf665ff46d199eb9632bd1f5ad1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.358771  7344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ae77627c4743fc864bb7da44bb00b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:27.389753   431 tablet_replica.cc:333] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.391368   431 raft_consensus.cc:2243] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.392817   431 raft_consensus.cc:2272] T 52bc0b3e08ea4bd78b344b833b97faed P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:27.404273  2312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 135562us
I20260709 12:59:27.430027  2344 raft_consensus.cc:1217] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEARNER]: Deduplicated request from leader. Original: 11.9->[11.10-11.10]   Dedup: 11.10->[]
I20260709 12:59:27.444969   431 tablet_replica.cc:333] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.448885  7358 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.456990  7358 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.458254  7094 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.458787  7094 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.459715  7358 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:27.460675  7094 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.460752  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:27.461334   431 raft_consensus.cc:2243] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.461521  2344 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:27.462598  1610 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:27.461982   431 raft_consensus.cc:2272] T 27982349e557426eb54944f0699b5f79 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.471823  7358 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:27.472265  7358 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.472675  7358 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:27.471287  1612 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:27.475181  1612 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.485133   431 tablet_replica.cc:333] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.486063   431 raft_consensus.cc:2243] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:27.487206   431 raft_consensus.cc:2272] T bdbdfb43cea249489bc1a1b1cc104254 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.491561  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.492229  1716 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 11.
W20260709 12:59:27.474169  7341 log.cc:927] Time spent T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:59:27.495782   431 tablet_replica.cc:333] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.496759   431 raft_consensus.cc:2243] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.498364   431 raft_consensus.cc:2272] T 87fb4f5285564d94ab4d48e9ec00f31b P 2af567a273d44ca89d2b3b0f7c815bd1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.499011  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:27.507421   431 tablet_replica.cc:333] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.508318   431 raft_consensus.cc:2243] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:27.508769  7094 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:27.510769  7094 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.513545  7094 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.513630  2344 raft_consensus.cc:1217] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:59:27.509438   431 raft_consensus.cc:2272] T 9d74d4e4a65d434897c3095399228ce1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.493271  7344 tablet_copy_client.cc:806] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:27.526921  7344 tablet_copy_client.cc:670] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:27.528383   431 tablet_replica.cc:333] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.528046  7358 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.530422   431 raft_consensus.cc:2243] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.530777  7344 tablet_copy_client.cc:538] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:27.531080   431 raft_consensus.cc:2272] T 89071a75dff1449588d2f1f4d1b1fb15 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.534121   431 tablet_replica.cc:333] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.534739  7353 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.534894   431 raft_consensus.cc:2243] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.535353  7353 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.535764   431 raft_consensus.cc:2272] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.537660  7353 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:27.534750  7358 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:27.538414  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d708096220406385b27d464c8725f2" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:27.538441   431 tablet_replica.cc:333] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.539115  2344 raft_consensus.cc:3060] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:27.539829   431 raft_consensus.cc:2243] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:59:27.540426  1686 leader_election.cc:336] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.543021  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:27.544744  1684 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:27.546941  7305 raft_consensus.cc:2749] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:27.552806   431 raft_consensus.cc:2272] T b302e4f74a6c4ff2915495d3ac0982bc P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.557070   431 tablet_replica.cc:333] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.557883   431 raft_consensus.cc:2243] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.558477   431 raft_consensus.cc:2272] T 6d01fa5de23643a7bc42ad00178a7f51 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.561862  7094 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.582129  7094 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.575670  7344 tablet_bootstrap.cc:492] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap starting.
W20260709 12:59:27.575544  1612 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.584267  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2aea8dafba3428dbb6d189666a9957b" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:27.584946  1716 raft_consensus.cc:3060] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.594354  1716 raft_consensus.cc:2468] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:27.579747  2344 raft_consensus.cc:2468] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 16.
I20260709 12:59:27.571627   431 tablet_replica.cc:333] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.605667   431 raft_consensus.cc:2243] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.606094  1610 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:27.606361   431 raft_consensus.cc:2272] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.607378  7358 raft_consensus.cc:2804] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:27.607957  7358 raft_consensus.cc:697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:27.608973  7358 consensus_queue.cc:237] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.577443  7341 tablet_bootstrap.cc:492] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.618366  7341 tablet_bootstrap.cc:492] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
W20260709 12:59:27.601301  1612 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.620288  7341 ts_tablet_manager.cc:1403] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.828s	user 0.048s	sys 0.006s
I20260709 12:59:27.609624   431 tablet_replica.cc:333] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.621310   431 raft_consensus.cc:2243] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.622282   431 raft_consensus.cc:2272] T 39b62689c0094341b01c7263292dd753 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.624631  1612 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:27.625586  7094 raft_consensus.cc:2804] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:27.627568   431 tablet_replica.cc:333] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1: stopping tablet replica
I20260709 12:59:27.628419   431 raft_consensus.cc:2243] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:27.631425  7094 raft_consensus.cc:697] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:27.632412  7094 consensus_queue.cc:237] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.644959  7311 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.645562  7311 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.647639  7311 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.650422  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.651409   431 raft_consensus.cc:2272] T 65bdb5c7faf24eb08b41f32ba12e1932 P 2af567a273d44ca89d2b3b0f7c815bd1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:27.657828  1612 leader_election.cc:336] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.663975  1468 catalog_manager.cc:5697] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 15 to 16, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 16 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.658254  1612 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:27.668239  7311 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.636469  7341 raft_consensus.cc:359] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:27.672580  7311 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.669920  7355 raft_consensus.cc:2749] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:27.677910  7311 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.689492  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.702241  7254 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.702868  7254 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.705646  7254 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.675132  7341 raft_consensus.cc:740] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:59:27.709278  7341 consensus_queue.cc:260] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:27.712090  7341 ts_tablet_manager.cc:1434] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.003s
I20260709 12:59:27.718407  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.719053  1716 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 18.
I20260709 12:59:27.733884  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:27.734675  7254 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:27.735118  7254 raft_consensus.cc:493] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.736953  7254 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:59:27.743871  1612 leader_election.cc:336] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.744454  1612 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:27.747701  7358 raft_consensus.cc:2749] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:27.748427  7358 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.749030  7358 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:27.734777  2314 leader_election.cc:336] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.753778  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.755008  7358 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:27.759670  1612 leader_election.cc:336] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.760525  1612 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:27.762791  7311 raft_consensus.cc:2749] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:27.765781  1657 tablet_copy_service.cc:342] P 7a04d0a2963b4860beb7cd14e0b4939a: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-26cba50eaa264fd889cd8a4587b03948 received from {username='slave'} at 127.0.0.1:58328
I20260709 12:59:27.766232  1657 tablet_copy_service.cc:434] P 7a04d0a2963b4860beb7cd14e0b4939a: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-26cba50eaa264fd889cd8a4587b03948 on tablet 26cba50eaa264fd889cd8a4587b03948 with peer c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:27.776693  7353 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.779821  7353 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.782258  7353 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:27.783849  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.784509  1641 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 13.
I20260709 12:59:27.786527  1684 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:27.788286  7214 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:27.788695  7214 raft_consensus.cc:493] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.789047  7214 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:27.797976  7214 raft_consensus.cc:515] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.770313  7254 raft_consensus.cc:515] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.811626  7254 leader_election.cc:290] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.814764  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f5c2cabd34469aa65eff4ffae3e350" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:27.815440  1716 raft_consensus.cc:3060] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:27.798882  7360 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:59:27.816411  1686 leader_election.cc:336] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.821331  7360 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.828622  7305 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.843954  7360 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.855767  7354 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.856396  7354 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.858697  7354 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:27.866082  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.869704  7305 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:27.871701  1686 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.879051  1686 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:27.879796  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:27.880517  1720 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
I20260709 12:59:27.882365  7353 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.882848  7353 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.883422  7354 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:27.885330  2314 leader_election.cc:336] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.872066  7305 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:27.873719  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:27.888873  7353 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:27.889036  2344 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
I20260709 12:59:27.894865  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.896171  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a598709808884384ad6ce3e99aa4345a" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:27.896730  1645 raft_consensus.cc:3060] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:27.899223  7094 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.899353  1716 raft_consensus.cc:2468] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 19.
I20260709 12:59:27.899955  7094 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.902456  7094 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.902673  1684 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:27.904110  7353 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:27.904471  7353 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.904858  7353 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:27.907549  1645 raft_consensus.cc:2468] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:59:27.908965  1684 leader_election.cc:304] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
W20260709 12:59:27.909446  1612 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.910144  7305 raft_consensus.cc:2804] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:27.910660  7354 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.911239  7354 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.913507  7354 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:27.914101  7305 raft_consensus.cc:697] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:27.915103  7305 consensus_queue.cc:237] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.916199  7094 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.890100  7214 leader_election.cc:290] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:27.916678  7094 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:27.918490  7094 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:27.918537  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:27.890440  2314 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:27.920683  7360 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:27.921173  7360 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:27.921672  7360 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:27.929266  2314 leader_election.cc:336] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.933326  7353 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.943306  7353 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:27.943862  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
W20260709 12:59:27.954641  1612 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.972944  2347 raft_consensus.cc:1217] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Deduplicated request from leader. Original: 14.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 12:59:27.987530  7144 raft_consensus.cc:1064] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:59:27.990314  7144 consensus_queue.cc:237] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:27.996232  2314 leader_election.cc:304] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:27.997007  7204 raft_consensus.cc:2804] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:27.997500  7204 raft_consensus.cc:697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:27.998281  7204 consensus_queue.cc:237] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:28.000583  1463 catalog_manager.cc:5697] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 13 to 14, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.983248  7360 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:28.029431  2344 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c9ad12e0d0435f95be2eda5b653b39 in current term 12: Already voted for candidate c05ea12435084ad9b281ed3a0a2ecebe in this term.
I20260709 12:59:28.035450  7360 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:28.039929  2347 raft_consensus.cc:1275] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:28.041638  7358 consensus_queue.cc:1048] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:28.057364  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:28.058125  1716 raft_consensus.cc:2393] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c05ea12435084ad9b281ed3a0a2ecebe in current term 12: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:28.067649  7214 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.068420  7214 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.071110  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:28.071702  1717 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:28.073689  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:28.074270  1718 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:28.059749  7354 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:59:28.119078  1686 leader_election.cc:336] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:28.126924  1686 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:28.127475  1686 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:28.131876  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 61356.9us
W20260709 12:59:28.138440  1686 leader_election.cc:336] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:28.139353  1686 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:28.139736  1686 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:28.140769  1686 leader_election.cc:336] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:28.141167  1686 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:28.153380  2314 leader_election.cc:336] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:28.154160  2314 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:28.156827  7204 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:28.153374  1468 catalog_manager.cc:5697] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 18 to 19, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 19 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:28.159921  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.133481  7354 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.163699  7214 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:28.164379  7214 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:28.165046  7214 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:28.165621  7214 raft_consensus.cc:2749] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:28.174932  2344 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:28.176975  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:28.177654  1647 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:28.177466  7358 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:28.182829  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:28.198975  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:28.200233  7094 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:28.201568  7094 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.201968  7094 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:28.182201  7354 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:28.231032  1464 catalog_manager.cc:5697] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 11 to 12, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 12 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.210640  7358 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:28.237972  7382 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
W20260709 12:59:28.240589  7372 log.cc:927] Time spent T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:59:28.237084  7358 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.246554  7358 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:28.240686  7371 log.cc:927] Time spent T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:59:28.241026  7382 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.257756  1684 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:28.264146  7378 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:28.264606  7378 raft_consensus.cc:493] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.265004  7378 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:28.273983  1716 raft_consensus.cc:1275] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:28.277837  7094 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.290197  7382 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:28.293644  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.294193  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.294622  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.300217  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:28.302306  7369 raft_consensus.cc:1064] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:59:28.302772  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:28.303398  1641 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
I20260709 12:59:28.304780  7369 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:28.308362  7094 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:28.311344  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:28.318921  7384 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:28.319523  7344 tablet_bootstrap.cc:492] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:28.309389  7358 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:28.328958  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 125768us
I20260709 12:59:28.334190  7358 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:28.326807  7384 raft_consensus.cc:493] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.340209  7344 tablet_bootstrap.cc:492] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: Bootstrap complete.
W20260709 12:59:28.341152  1686 leader_election.cc:336] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:28.342577  1686 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.346040  1686 leader_election.cc:336] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:28.341055  7344 ts_tablet_manager.cc:1403] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent bootstrapping tablet: real 0.766s	user 0.055s	sys 0.017s
I20260709 12:59:28.340986  7378 raft_consensus.cc:515] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.352276  7378 leader_election.cc:290] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:28.348992  7384 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:28.355086  7344 raft_consensus.cc:359] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
I20260709 12:59:28.355528  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295d06aa958a45069eef5737c8adf1ff" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:28.356178  1645 raft_consensus.cc:3060] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:28.363471  1645 raft_consensus.cc:2468] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 16.
I20260709 12:59:28.363933  7344 raft_consensus.cc:740] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Initialized, Role: LEARNER
I20260709 12:59:28.378821  7344 consensus_queue.cc:260] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: true } }
W20260709 12:59:28.366674  1686 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.380191  1686 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:28.376746  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 47197.8us
I20260709 12:59:28.376940  1684 leader_election.cc:304] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:28.380573  1686 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:28.381211  7378 raft_consensus.cc:2804] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:59:28.381647  1686 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.381969  7378 raft_consensus.cc:697] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
W20260709 12:59:28.382400  1686 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.383177  7378 consensus_queue.cc:237] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.381248  7353 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:28.386379  1686 leader_election.cc:336] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:28.366233  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.393801  1686 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:28.397464  7344 ts_tablet_manager.cc:1434] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:59:28.406915  7144 consensus_queue.cc:1048] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:28.409170  1731 tablet_copy_service.cc:342] P 20c9ad12e0d0435f95be2eda5b653b39: Request end of tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-45ae77627c4743fc864bb7da44bb00b3 received from {username='slave'} at 127.0.0.1:48852
I20260709 12:59:28.409655  1731 tablet_copy_service.cc:434] P 20c9ad12e0d0435f95be2eda5b653b39: ending tablet copy session c05ea12435084ad9b281ed3a0a2ecebe-45ae77627c4743fc864bb7da44bb00b3 on tablet 45ae77627c4743fc864bb7da44bb00b3 with peer c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:28.411572  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.412182  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.412794  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.431989  7094 raft_consensus.cc:1064] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:59:28.434309  7094 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 6, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:28.434497  1464 catalog_manager.cc:5697] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 15 to 16, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.448673  2344 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:59:28.448768  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.453197  7378 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:28.469588  1645 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:59:28.469686  1686 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.471009  7369 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:59:28.471721  1686 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.478127  1718 raft_consensus.cc:1275] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:28.483168  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089ef23951ac45c3a80b53b6e8127c61" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:28.482728  7353 raft_consensus.cc:2955] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:28.484840  1718 raft_consensus.cc:3060] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:28.484155  1641 raft_consensus.cc:2955] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:28.484238  2344 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:28.492507  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c680cef608164c689f7de9b00b60e72d" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:28.493106  1720 raft_consensus.cc:3060] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:28.494925  7094 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:59:28.500445  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.507468  2344 raft_consensus.cc:2955] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:28.513046  7384 raft_consensus.cc:515] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.515175  7384 leader_election.cc:290] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:28.516122  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ae4cb056ac43519786f1fb62431bc4" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:28.516822  1645 raft_consensus.cc:3060] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:28.516559  1464 catalog_manager.cc:5697] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 8 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:28.503476  1686 consensus_peers.cc:597] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:28.505811  1641 raft_consensus.cc:1275] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:28.529215  1718 raft_consensus.cc:2468] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:28.528141  7384 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.531870  1720 raft_consensus.cc:2468] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:28.533908  1645 raft_consensus.cc:2468] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:28.530797  7384 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.535466  1684 leader_election.cc:304] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:28.536262  7384 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:28.536703  7378 raft_consensus.cc:2804] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:28.537246  7378 raft_consensus.cc:697] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:28.538262  7356 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.538178  7378 consensus_queue.cc:237] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.538810  7356 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.540804  7356 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:28.544822  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:28.544484  7353 consensus_queue.cc:1048] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:59:28.556175  1718 consensus_queue.cc:237] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:28.558277  1686 leader_election.cc:336] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:28.567606  1686 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:28.568223  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:28.587095  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:28.585876  7369 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:28.591785  2342 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:28.594525  1718 raft_consensus.cc:1275] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:59:28.595407  7094 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.595904  7094 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.598086  1645 raft_consensus.cc:1275] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:28.596998  7369 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:59:28.605329  7094 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:28.598289  7144 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.621657  7144 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.622937  2344 raft_consensus.cc:2955] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:28.635962  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 81965.9us
I20260709 12:59:28.639590  7144 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:28.640851  7204 consensus_queue.cc:1048] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:59:28.652493  1686 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.629189  7378 consensus_queue.cc:1048] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 12:59:28.672242  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.674144  1686 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.676892  1641 raft_consensus.cc:2955] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:28.665460  1612 connection.cc:769] client connection to 127.0.107.193:39997 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:59:28.671387  7369 raft_consensus.cc:2955] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:28.688828  1716 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:28.682435  1464 catalog_manager.cc:5697] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 14 to 15, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:28.721554  1686 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.722558  1686 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.732196  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:28.732942  1720 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 16.
I20260709 12:59:28.734892  1468 catalog_manager.cc:5697] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 9 to 10, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 13 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:28.723632  7360 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.742350  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:28.743166  1717 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 14.
I20260709 12:59:28.748628  7360 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:28.754688  7360 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:28.780867  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 53427.4us
I20260709 12:59:28.784557  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:28.785356  1716 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
W20260709 12:59:28.795943  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.792068  7094 consensus_queue.cc:1048] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:28.801117  2314 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:28.806326  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:28.806964  1718 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 12.
I20260709 12:59:28.809360  1612 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:28.812397  1612 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:28.815471  7355 raft_consensus.cc:2804] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:28.816125  7355 raft_consensus.cc:697] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:28.817239  7355 consensus_queue.cc:237] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.820925  7358 raft_consensus.cc:2804] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:59:28.823676  2314 leader_election.cc:336] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:28.810467  7360 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:28.810961  7388 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.843156  7144 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.845086  7144 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:28.841749  7360 raft_consensus.cc:493] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.885501  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:28.884253  7144 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:28.886929  7358 raft_consensus.cc:697] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:28.890106  7358 consensus_queue.cc:237] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.887157  7360 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:28.885890  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 72385.4us
I20260709 12:59:28.893844  7356 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:28.895512  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:28.897666  7144 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:28.898020  7144 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.898335  7383 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.898381  7144 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:28.847582  7388 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.899875  7360 raft_consensus.cc:515] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:28.901098  7388 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:28.898859  7383 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.902724  7360 leader_election.cc:290] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:28.915961  7144 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:28.920320  7144 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:28.904929  7383 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:28.976850  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36649, user_credentials={real_user=slave}} blocked reactor thread for 80549us
I20260709 12:59:28.977738  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:28.978591  7356 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:28.978983  7356 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.979318  7356 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:28.987475  7356 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:28.990276  2314 leader_election.cc:336] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:28.991847  7356 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:28.993669  1686 leader_election.cc:336] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:28.994335  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:28.994740  1686 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:28.990345  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:28.996206  7388 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:28.996598  7388 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:28.997004  7388 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:29.007476  1612 consensus_peers.cc:597] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:29.008082  1612 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:29.008527  1612 consensus_peers.cc:597] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:29.009037  1612 consensus_peers.cc:597] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:29.011556  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 178484us
I20260709 12:59:29.015117  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ace78ff9d4582bd0fa7fe82f9654f" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
W20260709 12:59:29.009500  1612 consensus_peers.cc:597] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:29.015787  1720 raft_consensus.cc:3060] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:29.015944  1612 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:29.017868  2344 raft_consensus.cc:1217] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 12:59:29.019368  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:29.019529  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af922e165f0c427eacd26ca4bc111d76 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:29.019892  1645 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
W20260709 12:59:29.021057  1612 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:29.024045  1612 consensus_peers.cc:597] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:29.030377  1612 consensus_peers.cc:597] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:29.035300  1612 consensus_peers.cc:597] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.036794  1646 raft_consensus.cc:1275] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:59:29.046767  1686 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:29.048452  1612 consensus_peers.cc:597] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:29.050783  1612 consensus_peers.cc:597] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.053680  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:59:29.055550  1456 catalog_manager.cc:4755] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet af922e165f0c427eacd26ca4bc111d76: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:29.060817  7353 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:29.061203  7353 raft_consensus.cc:493] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:29.061599  7353 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:29.064180  1720 raft_consensus.cc:2468] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:29.076237  2314 leader_election.cc:304] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:29.077003  7360 raft_consensus.cc:2804] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:29.077502  7360 raft_consensus.cc:697] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:29.078411  7360 consensus_queue.cc:237] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:29.077286  7388 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:29.079833  1468 catalog_manager.cc:5697] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 13 to 14, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.080976  7388 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:29.076447  1686 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.081636  1468 catalog_manager.cc:5697] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 14 to 15, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 15 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.087674  7407 consensus_queue.cc:1048] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:29.089640  7353 raft_consensus.cc:515] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:29.097172  1640 raft_consensus.cc:1275] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:29.099207  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:29.099742  1646 raft_consensus.cc:3060] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:29.102676  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaf4486c502440fb4b5bc1ef7cc7256" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:29.103209  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74d4e4a65d434897c3095399228ce1" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:29.104025  1717 raft_consensus.cc:2393] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a04d0a2963b4860beb7cd14e0b4939a in current term 16: Already voted for candidate 20c9ad12e0d0435f95be2eda5b653b39 in this term.
I20260709 12:59:29.104456  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbdfb43cea249489bc1a1b1cc104254" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:29.105051  1721 raft_consensus.cc:3060] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:29.103259  1716 raft_consensus.cc:3060] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:29.091570  7353 leader_election.cc:290] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:29.118661  7204 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:29.122176  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db00224dfea24cb2a0a2400d9b4a907f" candidate_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:29.122769  1715 raft_consensus.cc:3060] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:29.127956  1721 raft_consensus.cc:2468] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 15.
I20260709 12:59:29.126287  7204 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:29.138056  7204 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:29.145694  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" is_pre_election: true
I20260709 12:59:29.146324  1645 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:59:29.139676  7384 consensus_queue.cc:1048] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:59:29.158757  2312 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
W20260709 12:59:29.159118  1686 leader_election.cc:336] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:29.140098  1716 raft_consensus.cc:2468] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 17.
I20260709 12:59:29.167717  1646 raft_consensus.cc:2468] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 16.
I20260709 12:59:29.173748  7360 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:29.183842  1612 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:29.183475  7360 raft_consensus.cc:493] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2af567a273d44ca89d2b3b0f7c815bd1)
I20260709 12:59:29.185113  7360 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:29.186045  1612 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 
I20260709 12:59:29.186779  7094 raft_consensus.cc:2804] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:59:29.187372  1612 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:29.187762  7094 raft_consensus.cc:697] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:29.189191  7311 raft_consensus.cc:2804] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:29.192581  1463 catalog_manager.cc:5697] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 14 to 15, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 15 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:29.212605  1612 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:29.219019  1612 consensus_peers.cc:597] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:29.219549  1612 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:29.243570  1684 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:29.244472  1715 raft_consensus.cc:2468] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a04d0a2963b4860beb7cd14e0b4939a in term 13.
I20260709 12:59:29.232430  7311 raft_consensus.cc:697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:29.249313  7407 raft_consensus.cc:2804] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:29.250161  7407 raft_consensus.cc:697] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:29.250258  7311 consensus_queue.cc:237] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:29.251979  1612 leader_election.cc:336] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:29.251461  7407 consensus_queue.cc:237] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:29.252421  1612 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:29.241178  7094 consensus_queue.cc:237] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:29.257213  1612 leader_election.cc:336] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:29.257688  1612 leader_election.cc:304] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
W20260709 12:59:29.258606  1612 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:29.259284  1612 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:29.259821  2314 leader_election.cc:336] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:29.260109  1612 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:29.258976  7410 raft_consensus.cc:2749] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:29.262353  7356 raft_consensus.cc:2749] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:29.282622  1612 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:29.320159  1715 raft_consensus.cc:1275] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:29.311164  7388 raft_consensus.cc:2804] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:29.324595  7388 raft_consensus.cc:697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Becoming Leader. State: Replica: 7a04d0a2963b4860beb7cd14e0b4939a, State: Running, Role: LEADER
I20260709 12:59:29.325405  7388 consensus_queue.cc:237] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:29.328866  7356 consensus_queue.cc:1048] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:29.356197  1718 raft_consensus.cc:2955] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.354926  7094 raft_consensus.cc:2955] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 8 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.359205  7360 raft_consensus.cc:515] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:29.413777  1718 raft_consensus.cc:1275] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:29.461269  1464 catalog_manager.cc:5697] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 15 to 16, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.462838  7383 raft_consensus.cc:1064] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: attempting to promote NON_VOTER c05ea12435084ad9b281ed3a0a2ecebe to VOTER
I20260709 12:59:29.470320  7383 consensus_queue.cc:237] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:29.472931  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb5c7faf24eb08b41f32ba12e1932" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7a04d0a2963b4860beb7cd14e0b4939a"
I20260709 12:59:29.473426  7360 leader_election.cc:290] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:29.473538  1647 raft_consensus.cc:3060] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:29.474526  7426 log.cc:927] Time spent T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:59:29.479264  2314 leader_election.cc:336] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:29.481683  1647 raft_consensus.cc:2468] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:29.482972  2312 leader_election.cc:304] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:29.486371  2347 raft_consensus.cc:2955] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.489976  7254 raft_consensus.cc:2804] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:29.490490  7254 raft_consensus.cc:697] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:29.491377  7254 consensus_queue.cc:237] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:29.431676  7388 consensus_queue.cc:1048] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
W20260709 12:59:29.508901  1612 consensus_peers.cc:597] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:29.509749  1612 consensus_peers.cc:597] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.513242  7430 raft_consensus.cc:2955] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:29.518468  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.530390  1720 raft_consensus.cc:2955] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.558507  1464 catalog_manager.cc:5697] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: config changed from index 8 to 9, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.569234  1464 catalog_manager.cc:5697] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 14 to 15, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 15 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.575786  1464 catalog_manager.cc:5697] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 16 to 17, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 17 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.591033  1645 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:59:29.599913  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.601172  7384 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:29.610543  1463 catalog_manager.cc:5697] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 14 to 15, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 15 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:29.616596  1612 consensus_peers.cc:597] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.623487  2347 raft_consensus.cc:1275] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEARNER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:29.636246  7407 consensus_queue.cc:1048] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:59:29.639430   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1593)
I20260709 12:59:29.668110  2347 raft_consensus.cc:2955] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.681165  1720 raft_consensus.cc:1275] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:29.682998  7430 consensus_queue.cc:1048] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:29.698012  7353 raft_consensus.cc:2955] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.707527  1715 raft_consensus.cc:1275] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:29.712523  7254 consensus_queue.cc:1048] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:29.731388  1647 raft_consensus.cc:2955] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.756824  1718 raft_consensus.cc:1275] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:59:29.760248  7356 consensus_queue.cc:1048] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:29.766130  1467 catalog_manager.cc:5697] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 10 to 11, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.821977  1647 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:29.852185  2347 raft_consensus.cc:2955] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.855806  2344 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:29.861626  7094 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:59:29.871644  1612 consensus_peers.cc:597] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.898532  1467 catalog_manager.cc:5697] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: config changed from index 9 to 10, c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.909027  1715 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:29.916817  7430 raft_consensus.cc:2955] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.918401  2344 raft_consensus.cc:2955] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:29.920696  1686 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:29.922535  1612 consensus_peers.cc:597] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.935868  1454 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26cba50eaa264fd889cd8a4587b03948 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:59:29.952399  2314 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.955335  1647 raft_consensus.cc:1275] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:29.956707  7416 consensus_queue.cc:1048] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:29.950115  1720 raft_consensus.cc:1275] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer 7a04d0a2963b4860beb7cd14e0b4939a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:29.965528  7408 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:29.976263  7358 consensus_queue.cc:1048] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:29.981848  1464 catalog_manager.cc:5697] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a reported cstate change: term changed from 12 to 13, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194). New cstate: current_term: 13 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.982488  1715 raft_consensus.cc:2955] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
I20260709 12:59:29.996913  7360 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.997417  7360 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:29.999334  7360 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:30.012980  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:30.013622  1718 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 12.
I20260709 12:59:30.017729  2314 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:30.021108  7360 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:30.021585  7360 raft_consensus.cc:493] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.021929  7360 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:30.028930  1612 consensus_peers.cc:597] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:30.037954  7360 raft_consensus.cc:515] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:30.068755  7360 leader_election.cc:290] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Requested vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:30.026093  1467 catalog_manager.cc:5697] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: config changed from index 9 to 10, VOTER 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) evicted. New cstate: current_term: 14 leader_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } } }
W20260709 12:59:30.045145  2314 leader_election.cc:336] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:30.057185  1646 raft_consensus.cc:1275] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:30.078161  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99331ae0325b4de6bd6d097c96af6d6c" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:30.078722  1720 raft_consensus.cc:3060] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:30.082720  7442 consensus_queue.cc:1048] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:30.091449  1720 raft_consensus.cc:2468] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 13.
W20260709 12:59:30.105654  2314 leader_election.cc:336] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:30.108587  1456 catalog_manager.cc:4755] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 26cba50eaa264fd889cd8a4587b03948: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:30.124066  2314 leader_election.cc:304] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:30.126428  7360 raft_consensus.cc:2804] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:30.126893  7360 raft_consensus.cc:697] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:30.127851  7360 consensus_queue.cc:237] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:30.200223  1467 catalog_manager.cc:5697] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 11 to 13, leader changed from 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 13 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:30.590344  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:30.607110  1720 raft_consensus.cc:1275] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:30.609095  7204 consensus_queue.cc:1048] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:59:30.629972  1686 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111) [suppressed 426 similar messages]
W20260709 12:59:30.639987   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1593)
W20260709 12:59:30.674176  1686 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.685092  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:30.686766  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.736006  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.745904  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.796754  1686 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.836375  1686 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.898130  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.920878  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.922711  1686 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.954464  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:30.957016  1686 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:30.991842  1686 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.001580  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.003508  1686 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.020844  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.021483  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.034075  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.171254  1686 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.214550  1612 consensus_peers.cc:597] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:31.218777  1612 consensus_peers.cc:597] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:31.241914  1612 consensus_peers.cc:597] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.244848  1686 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:31.270320  1612 consensus_peers.cc:597] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.292224  1686 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.295540  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.326876  1456 catalog_manager.cc:4755] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 26cba50eaa264fd889cd8a4587b03948: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:31.328768  1612 consensus_peers.cc:597] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:31.384388  1686 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.401706  1686 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.432898  1612 consensus_peers.cc:597] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.461815  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.553225  1686 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:31.557581  1612 consensus_peers.cc:597] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.558176  1612 consensus_peers.cc:597] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.590137  1612 consensus_peers.cc:597] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.747051  1612 consensus_peers.cc:597] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:31.906841  1612 consensus_peers.cc:597] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:31.938067  1686 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:31.996444   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:59:32.040133  1612 consensus_peers.cc:597] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:32.089989  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:32.110313  1612 consensus_peers.cc:597] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:32.185667  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:32.200304  1612 consensus_peers.cc:597] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:32.332947  1612 consensus_peers.cc:597] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:32.370160  2314 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:32.370858   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 12:59:32.404877  2312 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.407773  1684 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.427706  2312 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.438949  1684 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.442196  2312 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.452878  1456 catalog_manager.cc:4755] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 26cba50eaa264fd889cd8a4587b03948: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:32.459581  1686 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:32.509305  1684 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.524494  2312 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.545759  1684 consensus_peers.cc:597] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.556087  1684 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.591058   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:59:32.593946  1684 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.597316   431 tablet_replica.cc:333] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
W20260709 12:59:32.598217  1684 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.614562   431 raft_consensus.cc:2243] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.615989   431 raft_consensus.cc:2272] T 5a33c093dd1a4a51a63ade534efa70f8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.631304   431 tablet_replica.cc:333] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
W20260709 12:59:32.631862  2312 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.632304   431 raft_consensus.cc:2243] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.633463   431 raft_consensus.cc:2272] T 26cba50eaa264fd889cd8a4587b03948 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.636155   431 tablet_replica.cc:333] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.646155   431 raft_consensus.cc:2243] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:59:32.647111  1684 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.647375   431 raft_consensus.cc:2272] T 86e8c2c317414ecda8dce8d5284c74d1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.650420   431 tablet_replica.cc:333] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.651329   431 raft_consensus.cc:2243] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:59:32.653650  2312 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.654244   431 raft_consensus.cc:2272] T 523c299f124340818ee040d8a887dba6 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.665902   431 tablet_replica.cc:333] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.671437   431 raft_consensus.cc:2243] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:59:32.673182  1684 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.673731   431 raft_consensus.cc:2272] T 7b5c0052ddab4e69a58f0da887bba56e P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:32.673887  1684 consensus_peers.cc:597] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.677690  2312 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.679803   431 tablet_replica.cc:333] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.688191   431 raft_consensus.cc:2243] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.689428   431 raft_consensus.cc:2272] T 13d708096220406385b27d464c8725f2 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.692049   431 tablet_replica.cc:333] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.693012   431 raft_consensus.cc:2243] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.701646   431 raft_consensus.cc:2272] T a2aea8dafba3428dbb6d189666a9957b P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.705096   431 tablet_replica.cc:333] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.705993   431 raft_consensus.cc:2243] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.706619   431 raft_consensus.cc:2272] T a3d04144cd804a9b886ecfd1a986ec95 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.709530   431 tablet_replica.cc:333] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.712901   431 raft_consensus.cc:2243] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:59:32.713578  1684 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.717409   431 raft_consensus.cc:2272] T e271944afc3846f9b26d682a57b58ce8 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.720693   431 tablet_replica.cc:333] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.728040   431 raft_consensus.cc:2243] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.728705   431 raft_consensus.cc:2272] T 997bea07114b4964bbe0c9bc9185a7f4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:32.742427  1684 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.746342   431 tablet_replica.cc:333] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
W20260709 12:59:32.752777  1684 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.754061   431 raft_consensus.cc:2243] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.755205   431 raft_consensus.cc:2272] T c680cef608164c689f7de9b00b60e72d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.762285   431 tablet_replica.cc:333] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.765682   431 raft_consensus.cc:2243] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.766405   431 raft_consensus.cc:2272] T fe107547ec8e475786b8fa8f8c789648 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.769197   431 tablet_replica.cc:333] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.775278   431 raft_consensus.cc:2243] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.775929   431 raft_consensus.cc:2272] T 3df7e2e5458047a9a8b0d6a07577bbbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.778880   431 tablet_replica.cc:333] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.789510   431 raft_consensus.cc:2243] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.790647   431 raft_consensus.cc:2272] T d5a66d6152a24cf08a833d30477e5bbe P 7a04d0a2963b4860beb7cd14e0b4939a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.794093   431 tablet_replica.cc:333] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.795650   431 raft_consensus.cc:2243] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.803036   431 raft_consensus.cc:2272] T 598f1b27b4ab45cfac5cc13489b2e687 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.805739   431 tablet_replica.cc:333] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.806619   431 raft_consensus.cc:2243] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.807251   431 raft_consensus.cc:2272] T a598709808884384ad6ce3e99aa4345a P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.809870   431 tablet_replica.cc:333] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.818090   431 raft_consensus.cc:2243] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:59:32.824292  1684 consensus_peers.cc:597] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.826854  1684 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.828176   431 raft_consensus.cc:2272] T 35c533e32b324f8f80c12f5380f0c92d P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.831070   431 tablet_replica.cc:333] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.838344   431 raft_consensus.cc:2243] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.839903   431 raft_consensus.cc:2272] T 85c93ae6dea242bf9de5cf30087783be P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.855154   431 tablet_replica.cc:333] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
W20260709 12:59:32.860285  1684 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.862675   431 raft_consensus.cc:2243] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:59:32.866511  2312 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.867372   431 raft_consensus.cc:2272] T 4da9bedf7aba45139d86ca314258a105 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.870297   431 tablet_replica.cc:333] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.871243   431 raft_consensus.cc:2243] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.872336   431 raft_consensus.cc:2272] T 0d36382528fc4b5680388922224bdfa3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.875062   431 tablet_replica.cc:333] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.875916   431 raft_consensus.cc:2243] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.882511   431 raft_consensus.cc:2272] T 1b56889944b24c9cb46eb080b37a2d4b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.893388   431 tablet_replica.cc:333] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
W20260709 12:59:32.894553  1684 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.894876   431 raft_consensus.cc:2243] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.895933   431 raft_consensus.cc:2272] T af922e165f0c427eacd26ca4bc111d76 P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.898576   431 tablet_replica.cc:333] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.899381   431 raft_consensus.cc:2243] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.904238   431 raft_consensus.cc:2272] T 295d06aa958a45069eef5737c8adf1ff P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:32.905563  1684 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:32.907214  1612 consensus_peers.cc:597] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:32.907608  2312 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.910342   431 tablet_replica.cc:333] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.911231   431 raft_consensus.cc:2243] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.920861   431 raft_consensus.cc:2272] T fdd982fdd5b6440bbcf0eaf350f5124f P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.924249   431 tablet_replica.cc:333] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.925107   431 raft_consensus.cc:2243] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.925719   431 raft_consensus.cc:2272] T acc3fcdecc7546fe92075e15e904c331 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.928493   431 tablet_replica.cc:333] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.941437   431 raft_consensus.cc:2243] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.944481   431 raft_consensus.cc:2272] T 963d2113f061422e874d4718ed8d9538 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.947453   431 tablet_replica.cc:333] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.948364   431 raft_consensus.cc:2243] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.949106   431 raft_consensus.cc:2272] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.952349   431 tablet_replica.cc:333] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.953843   431 raft_consensus.cc:2243] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.960114   431 raft_consensus.cc:2272] T 88ae4cb056ac43519786f1fb62431bc4 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.962574   431 tablet_replica.cc:333] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.963366   431 raft_consensus.cc:2243] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.964444   431 raft_consensus.cc:2272] T a008f8fc81244052803539fc7317853b P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.971962   431 tablet_replica.cc:333] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.972898   431 raft_consensus.cc:2243] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.977907   431 raft_consensus.cc:2272] T 508332d25a2b4288bc6411b566044758 P 7a04d0a2963b4860beb7cd14e0b4939a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.980716   431 tablet_replica.cc:333] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.985239   431 raft_consensus.cc:2243] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.986354   431 raft_consensus.cc:2272] T 089ef23951ac45c3a80b53b6e8127c61 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.991029   431 tablet_replica.cc:333] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:32.993230   431 raft_consensus.cc:2243] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:59:32.995589   431 raft_consensus.cc:2272] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.999029   431 tablet_replica.cc:333] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.005231   431 raft_consensus.cc:2243] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:33.017867   431 raft_consensus.cc:2272] T a3e979717db64b77b569522980fab6af P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.020948   431 tablet_replica.cc:333] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.029642   431 raft_consensus.cc:2243] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.030450   431 raft_consensus.cc:2272] T c5064e0cc33a4a9383fca6c8ee736c18 P 7a04d0a2963b4860beb7cd14e0b4939a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.034962   431 tablet_replica.cc:333] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.045297   431 raft_consensus.cc:2243] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:59:33.047303   431 raft_consensus.cc:2272] T db00224dfea24cb2a0a2400d9b4a907f P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.050045   431 tablet_replica.cc:333] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.050863   431 raft_consensus.cc:2243] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.051507   431 raft_consensus.cc:2272] T d0aa36fcde2c4a1fa46a60cb9a82a16f P 7a04d0a2963b4860beb7cd14e0b4939a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.056725   431 tablet_replica.cc:333] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.057490   431 raft_consensus.cc:2243] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.061323   431 raft_consensus.cc:2272] T 45ae77627c4743fc864bb7da44bb00b3 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.063917   431 tablet_replica.cc:333] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
W20260709 12:59:33.067016  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.067900  1686 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:33.069401   431 raft_consensus.cc:2243] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.070361   431 raft_consensus.cc:2272] T 075b6c0f44a54d0cb3e8050968db2158 P 7a04d0a2963b4860beb7cd14e0b4939a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.077625   431 tablet_replica.cc:333] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.078578   431 raft_consensus.cc:2243] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.079329   431 raft_consensus.cc:2272] T 46fb86b9f3304b99a092fa35dffe1813 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.087270   431 tablet_replica.cc:333] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.088964   431 raft_consensus.cc:2243] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.089715   431 raft_consensus.cc:2272] T 87fb4f5285564d94ab4d48e9ec00f31b P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.101120   431 tablet_replica.cc:333] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.102084   431 raft_consensus.cc:2243] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.102880   431 raft_consensus.cc:2272] T 30729cf665ff46d199eb9632bd1f5ad1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.105849   431 tablet_replica.cc:333] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.106678   431 raft_consensus.cc:2243] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.109102   431 raft_consensus.cc:2272] T 52bc0b3e08ea4bd78b344b833b97faed P 7a04d0a2963b4860beb7cd14e0b4939a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.111802   431 tablet_replica.cc:333] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.125281   431 raft_consensus.cc:2243] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.126139   431 raft_consensus.cc:2272] T 27982349e557426eb54944f0699b5f79 P 7a04d0a2963b4860beb7cd14e0b4939a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.129438   431 tablet_replica.cc:333] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.137707   431 raft_consensus.cc:2243] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:33.139456   431 raft_consensus.cc:2272] T bdbdfb43cea249489bc1a1b1cc104254 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.143503   431 tablet_replica.cc:333] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.150174   431 raft_consensus.cc:2243] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:59:33.151207   431 raft_consensus.cc:2272] T 5ac8464a8a2c438c8cdaf74b18d51098 P 7a04d0a2963b4860beb7cd14e0b4939a [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:33.153784  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:33.167166   431 tablet_replica.cc:333] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.168015   431 raft_consensus.cc:2243] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.168615   431 raft_consensus.cc:2272] T 65bdb5c7faf24eb08b41f32ba12e1932 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:33.171880  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:33.171892   431 tablet_replica.cc:333] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.175594   431 raft_consensus.cc:2243] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:59:33.179601  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:33.196044   431 raft_consensus.cc:2272] T 9d74d4e4a65d434897c3095399228ce1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.198926   431 tablet_replica.cc:333] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.199671   431 raft_consensus.cc:2243] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.200706   431 raft_consensus.cc:2272] T 89071a75dff1449588d2f1f4d1b1fb15 P 7a04d0a2963b4860beb7cd14e0b4939a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:33.205262   431 tablet_replica.cc:333] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a: stopping tablet replica
I20260709 12:59:33.205931   431 raft_consensus.cc:2243] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:33.207206   431 raft_consensus.cc:2272] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 7a04d0a2963b4860beb7cd14e0b4939a [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:33.229959  1686 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.312767  1686 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.336762  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.347268  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.399859  1686 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.432725  1686 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.481604  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.559444  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.586891  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.716799  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.717612  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:33.747560  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.747983  1686 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.748040  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.748769  1686 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:33.756477  1686 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.756696  1456 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 61397.5us
I20260709 12:59:33.760270  7464 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:59:33.760556  1456 catalog_manager.cc:4755] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet af922e165f0c427eacd26ca4bc111d76: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:33.761796  7464 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:33.763458  7460 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.764493  7460 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:33.767481  7460 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:33.768460  7465 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.769290  7465 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:33.770581  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:33.772063  7465 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:33.777349  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:33.780352  7464 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
W20260709 12:59:33.781051  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.784061  1684 leader_election.cc:336] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:33.785949  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:33.786710  7464 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.787551  7464 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:33.789880  7464 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:33.792316  1684 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
W20260709 12:59:33.792718  2312 leader_election.cc:336] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:33.793148  2312 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:33.794081  7464 raft_consensus.cc:2749] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:33.794901  7460 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:33.794934  1684 leader_election.cc:336] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:33.796818  2312 leader_election.cc:336] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:33.797271  2312 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:33.798036  7460 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:33.800107  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:33.800743  2347 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:33.804963  1684 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:33.805723  7464 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:33.806121  7464 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.806594  7464 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:33.831704  7464 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:33.837709  1684 leader_election.cc:336] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:33.840253  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5c0052ddab4e69a58f0da887bba56e" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:33.840900  2347 raft_consensus.cc:3060] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:33.841951  7464 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:33.852896  2347 raft_consensus.cc:2468] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 16.
I20260709 12:59:33.854471  1684 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:33.856094  7417 raft_consensus.cc:2804] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:33.856637  7417 raft_consensus.cc:697] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:33.859129  7417 consensus_queue.cc:237] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:33.865622  7460 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.866451  7460 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:33.868903  7460 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:33.870508  7464 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.871227  7464 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:33.873337  7464 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:33.879390  2312 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:33.879731  1686 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:33.881134  2314 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:33.881594  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:33.885015  1684 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:33.885281  7460 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:33.885442  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:33.893237  1686 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:33.898710  7407 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:33.908418  7464 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.909171  7464 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:33.913834  7464 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:33.917239  1686 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:33.924113  1686 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:33.929800  1684 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:33.930341  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:33.931123  7464 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:33.933945  7464 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.935922  7464 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:33.938192  7464 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:33.941649  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:33.946305  7442 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.947108  7442 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:33.954849  1684 leader_election.cc:336] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:33.959287  1467 catalog_manager.cc:5697] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 15 to 16, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.959291  1684 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:33.963798  7417 raft_consensus.cc:2749] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:33.964133  2314 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:33.964687  7417 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:33.965920  7442 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:33.968362  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:33.969913  2314 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:33.970778  7442 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:33.971451  2312 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:33.965386  7417 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:33.974804  7417 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:33.980326  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:34.002594  7442 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.003422  7442 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.009251  7442 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:34.011325  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:34.012142  1718 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
W20260709 12:59:34.013310  2314 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:34.016429  1684 leader_election.cc:336] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:34.016176  2312 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.017212  2312 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.016957  1684 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:34.018530  7442 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:34.019222  7464 raft_consensus.cc:2749] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:34.031656  7442 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.031713  7460 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.032627  7442 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.032635  7460 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.035390  7442 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:34.036634  7460 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:34.039397  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:34.040089  1718 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 17.
I20260709 12:59:34.042837  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:34.043673  7442 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:34.044009  7442 raft_consensus.cc:493] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.044340  7442 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:59:34.044816  2314 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:34.046684  2312 leader_election.cc:336] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:34.047428  2312 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.047816  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.048571  7460 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:34.055347  7442 raft_consensus.cc:515] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:34.061650  2312 leader_election.cc:336] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.062738  7442 leader_election.cc:290] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:34.064021  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d36382528fc4b5680388922224bdfa3" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:34.069711  1718 raft_consensus.cc:3060] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:59:34.080116  1686 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:34.083987  1718 raft_consensus.cc:2468] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 18.
I20260709 12:59:34.086020  2314 leader_election.cc:304] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.087044  7442 raft_consensus.cc:2804] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:34.087165  7417 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.087579  7442 raft_consensus.cc:697] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:34.087852  7417 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.088814  7442 consensus_queue.cc:237] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.090126  7417 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:34.093560  7465 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.094245  7465 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.096549  7465 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:34.101111  2312 leader_election.cc:336] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.097867  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:34.105902  7465 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.106647  1718 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:59:34.106808  7465 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.107908  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.109500  7460 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:34.109851  7460 raft_consensus.cc:493] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.110235  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:34.110927  1720 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 14.
I20260709 12:59:34.110215  7460 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:34.113175  2314 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:34.117188  7458 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:34.117590  7458 raft_consensus.cc:493] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.117959  7458 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:34.125612  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:34.126225  2347 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 14.
W20260709 12:59:34.126761  1686 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:34.114135  7465 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:34.133426  1686 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:34.125735  2312 leader_election.cc:336] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.137735  7460 raft_consensus.cc:515] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.135978  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 
I20260709 12:59:34.144507  7460 leader_election.cc:290] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:34.145812  7417 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:34.146199  7417 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.146545  7417 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:34.150338  1684 leader_election.cc:336] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.155372  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33c093dd1a4a51a63ade534efa70f8" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:34.156002  1718 raft_consensus.cc:3060] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:34.157698  1468 catalog_manager.cc:5697] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 17 to 18, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 18 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:34.163267  2312 leader_election.cc:336] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.164935  7459 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.165457  7407 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.165654  7459 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:34.166095  7407 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:34.169137  7472 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.169500  7459 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:34.169836  7472 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.171833  7417 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.173015  7407 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:34.173806  7472 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:34.174521  7417 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:34.176805  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e8c2c317414ecda8dce8d5284c74d1" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe"
I20260709 12:59:34.177374  2347 raft_consensus.cc:3060] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:34.178676  7458 raft_consensus.cc:515] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.185308  7407 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:59:34.185650  2312 leader_election.cc:336] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:34.186244  2314 leader_election.cc:336] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:34.186695  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.188849  7472 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:59:34.189456  2312 leader_election.cc:336] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:34.187171  1684 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.185894  7407 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:34.191367  1684 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:34.192083  1684 leader_election.cc:336] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.194165  7407 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:34.195003  7458 leader_election.cc:290] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:34.195850  1686 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:34.196357  1686 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.196410  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cba50eaa264fd889cd8a4587b03948" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:34.199536  1720 raft_consensus.cc:3060] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:34.199585  7407 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:34.199880  1686 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:34.200426  1686 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.198863  2347 raft_consensus.cc:2468] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:34.165030  1718 raft_consensus.cc:2468] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:34.206784  2314 leader_election.cc:304] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.207629  7458 raft_consensus.cc:2804] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:34.208184  7458 raft_consensus.cc:697] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:34.209386  7458 consensus_queue.cc:237] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.209859  1720 raft_consensus.cc:2468] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:34.211203  7407 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:34.211151  2314 leader_election.cc:304] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.212212  7460 raft_consensus.cc:2804] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:34.212980  7460 raft_consensus.cc:697] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:34.214746  1684 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.214409  7460 consensus_queue.cc:237] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:34.216225  1686 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:34.217581  7407 raft_consensus.cc:2804] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:34.218102  7407 raft_consensus.cc:697] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Becoming Leader. State: Replica: 20c9ad12e0d0435f95be2eda5b653b39, State: Running, Role: LEADER
I20260709 12:59:34.219127  7407 consensus_queue.cc:237] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:34.224416  1684 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.224920  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.225740  7451 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:34.234863  7451 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.235399  7451 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:34.237787  7451 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:34.243943  1686 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:34.252321  1684 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.253595  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.260324  7451 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:34.285671  1467 catalog_manager.cc:5697] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 reported cstate change: term changed from 14 to 15, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "20c9ad12e0d0435f95be2eda5b653b39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.290584  7451 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.292225  7451 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:34.298774  1686 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:34.295141  7451 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:34.303614  7451 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.304263  7451 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:34.289855  1468 catalog_manager.cc:5697] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 14 to 15, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 15 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:34.315924  7451 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:34.311239  1468 catalog_manager.cc:5697] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 14 to 15, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 15 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:34.326117  1686 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:34.328084  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:34.328922  2347 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:34.343619  7451 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.344321  7451 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:34.346576  7451 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:34.352005  1686 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:34.352928  1684 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.353438  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:34.354533  1684 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.355455  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.354976  7451 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:34.356771  7451 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:34.370553  7451 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.371295  7451 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:34.373564  7451 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:34.379025  1686 leader_election.cc:336] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:34.383525  1684 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.384725  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.385522  7451 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:34.393101  1684 leader_election.cc:336] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.393628  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.394429  7451 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:34.399766  1684 consensus_peers.cc:597] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:34.403774  2347 raft_consensus.cc:1275] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:34.407718  7451 consensus_queue.cc:1048] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:59:34.427575  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:34.444834  7451 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.448450  7451 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:34.451264  7451 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:34.456090  1686 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:34.472779  1686 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:34.481315   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1668)
W20260709 12:59:34.483614  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 44930.4us
W20260709 12:59:34.491959  2312 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:34.510284  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:34.515491  7451 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.516297  7451 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.518878  7451 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:34.545125  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
W20260709 12:59:34.547786  1684 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.549624  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.551122  7451 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:34.591048  7458 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.591694  7458 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.598287  7407 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.598963  7407 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:34.605140  1684 leader_election.cc:336] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.605597  7407 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:34.610950  7458 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:34.625531  2312 leader_election.cc:336] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.612711  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:34.605612  1684 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 7a04d0a2963b4860beb7cd14e0b4939a, c05ea12435084ad9b281ed3a0a2ecebe
I20260709 12:59:34.628069  1720 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 19.
I20260709 12:59:34.629210  7407 raft_consensus.cc:2749] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:59:34.634321  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.636178  7460 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:34.636826  7460 raft_consensus.cc:493] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:34.637255  7460 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:59:34.627422  1686 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:34.666692  1684 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.670578  1684 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.675429  7417 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:34.677911  7460 raft_consensus.cc:515] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.682451  7460 leader_election.cc:290] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 20 election: Requested vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:34.692552  2312 leader_election.cc:336] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:34.712863  2347 raft_consensus.cc:1275] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Refusing update from remote peer 20c9ad12e0d0435f95be2eda5b653b39: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:34.713446  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac8464a8a2c438c8cdaf74b18d51098" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39"
I20260709 12:59:34.714092  1720 raft_consensus.cc:3060] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:34.722910  7407 consensus_queue.cc:1048] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:34.726048  1720 raft_consensus.cc:2468] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 20.
I20260709 12:59:34.743556  1718 raft_consensus.cc:1275] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:59:34.753222  1718 raft_consensus.cc:1275] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:59:34.757481  1720 raft_consensus.cc:1275] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:59:34.766232  2312 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:34.770035  2314 leader_election.cc:304] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:34.770305  7460 consensus_queue.cc:1048] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:59:34.774768  7460 raft_consensus.cc:2804] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:59:34.775359  7460 raft_consensus.cc:697] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 20 LEADER]: Becoming Leader. State: Replica: c05ea12435084ad9b281ed3a0a2ecebe, State: Running, Role: LEADER
I20260709 12:59:34.776824  7460 consensus_queue.cc:237] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:34.781491  7472 consensus_queue.cc:1048] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:34.781805  7458 consensus_queue.cc:1048] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:59:34.806644  1684 consensus_peers.cc:597] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:34.823279  1686 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:34.886910  1468 catalog_manager.cc:5697] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe reported cstate change: term changed from 19 to 20, leader changed from 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194) to c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196). New cstate: current_term: 20 leader_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:34.891294  2312 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:34.892053  2312 consensus_peers.cc:597] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:34.914309  2312 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:34.922838  2314 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:34.940471  1684 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:34.948787  1684 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:34.933501  2312 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:34.984139  1684 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.015383  1684 consensus_peers.cc:597] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.030813  2312 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.066289  1684 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.119086  2312 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.128813  1684 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.138288  1684 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.152302  1684 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.158603  1684 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.205708  1684 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.230692  1684 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.293053  1684 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.312484  1684 consensus_peers.cc:597] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.318707  1684 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.322566  2312 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:35.338459  1718 raft_consensus.cc:1275] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 20 FOLLOWER]: Refusing update from remote peer c05ea12435084ad9b281ed3a0a2ecebe: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:59:35.342819  7458 consensus_queue.cc:1048] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:59:35.363334  2312 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.363965  2312 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.375948  1684 consensus_peers.cc:597] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.385725  1684 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.396817  1684 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.403927  2312 consensus_peers.cc:597] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:35.458621  2312 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.481855   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1668)
W20260709 12:59:35.503000  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:35.527380  7417 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:35.528031  7417 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:35.530184  7417 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:35.538007  1686 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:35.538966  1684 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:35.539359  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:35.540985  7451 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:35.562513  1686 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:35.635119  1684 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111) [suppressed 633 similar messages]
W20260709 12:59:35.643224  1684 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:35.709120  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:35.735899  7490 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:35.736711  7490 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:35.739063  7490 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:35.743920  2314 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:35.749811  2312 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:35.753623  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:35.755123  7490 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:35.752735  1686 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:35.754187  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:35.780261  7417 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:35.781682  7417 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:35.783892  7417 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:35.789054  1686 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:35.792708  1684 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:35.794199  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:35.795547  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:35.805783  7417 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:35.841939  7417 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:35.842464  7417 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:35.844440  7417 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:35.852406  1686 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:35.854807  1684 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:35.861770  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:35.863806  7451 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:35.864254  7451 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:35.866071  7451 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:35.873714  7451 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:59:35.872560  1686 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:35.866779  7417 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:35.874194  7451 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:35.876047  7451 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:35.881827  1686 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:35.903609  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:35.908223  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 53437.6us
W20260709 12:59:35.910507  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:35.943147  1686 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:35.945245  1684 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:35.945865  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:35.946672  7496 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:35.951385  1684 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:35.951891  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:35.952736  7496 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:35.968379  7490 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:35.969017  7490 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:35.971180  7490 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:35.978621  2314 leader_election.cc:336] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:35.980427  2312 leader_election.cc:336] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:35.980882  2312 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:35.982098  7490 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:59:35.994181  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:36.024394  7496 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:36.025048  7496 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:36.036892  1684 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:36.038108  1686 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:36.038527  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:36.040223  7417 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:36.042092  7496 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:36.062254  1686 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:36.102025  7458 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:36.102677  7458 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:36.104094  1686 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:36.105093  7496 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:36.105114  7458 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:36.106125  7496 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:36.109064  2314 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:36.121223  2312 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:36.121734  2312 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:36.122514  7458 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:36.130681  1684 leader_election.cc:336] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:36.138252  7496 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:36.168874  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:36.177831  7458 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
W20260709 12:59:36.178725  1686 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:36.178408  7458 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:36.179240  1686 leader_election.cc:336] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:36.179656  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:36.181408  7458 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:36.188017  2312 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:36.192087  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:36.192790  1715 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 11.
W20260709 12:59:36.194298  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:36.194897  7497 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:36.223042  1686 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:36.234736  2314 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:36.241957  2314 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:36.247951  7490 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:36.274874  7458 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:36.275506  7458 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:36.278527  7458 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:36.283326  2312 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:36.284456  1686 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:36.297765  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:36.298458  1715 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
I20260709 12:59:36.305073  7497 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:36.305943  7497 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:36.308255  7497 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:36.322105  1686 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:36.343403  1684 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:36.344931  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:36.337087  2314 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:36.351756  2314 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:36.352609  7458 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:36.357419  7497 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:59:36.420630  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:36.422530  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:36.423962  1686 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:36.442694  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:36.443210  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:36.459833  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:36.482337   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1668)
I20260709 12:59:36.525835  7497 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:36.526618  7497 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:36.548784  7497 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:36.552167  1686 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:36.585230  1684 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:36.587553  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:36.592809  7451 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:36.606215  1686 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:36.629014  1686 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:36.675782  7497 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:36.676318  7497 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:36.678426  7497 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:36.707952  1686 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:36.716715  1686 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:36.718477  1684 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:36.723655  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:36.734710  7497 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:36.747097  1684 consensus_peers.cc:597] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:36.813042  1686 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:36.847129  1686 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:36.891139  7451 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:36.891661  7451 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:36.893671  7451 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:36.904911  1684 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:36.907696  1686 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:36.908131  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:36.913192  7451 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:36.978132  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:37.026172  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:37.146742  2312 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.176354  1684 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.216084  2312 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:37.243714  2314 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:37.286376  1684 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.344230  1686 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:37.350410  1684 consensus_peers.cc:597] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:37.403438  2312 consensus_peers.cc:597] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:37.424304  2312 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:37.440874  2312 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.482892   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1668)
W20260709 12:59:37.520207  1684 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:37.542274  7451 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:37.542783  7451 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:37.544638  7451 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:37.552455  1684 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:37.554471  2312 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.555188  1686 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:37.558080  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:37.567137  7451 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:37.569811  1684 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.596421  1684 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.609161  1684 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.639487  1684 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.669816  1684 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.711635  2312 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.721398  1684 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.730880  1684 consensus_peers.cc:597] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:37.732836  7451 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:37.733424  7451 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:37.735432  7451 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:37.744623  1686 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:37.793009  1684 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.810933  2312 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.821255  1684 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:37.824615  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:37.830260  7497 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:37.876443  7497 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:37.879046  7497 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:37.864549  2312 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.885517  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 64301.7us
W20260709 12:59:37.886775  1684 consensus_peers.cc:597] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:37.886142  7497 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:37.895129  2312 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.914261  1456 catalog_manager.cc:4755] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet af922e165f0c427eacd26ca4bc111d76: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:37.930543  1686 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:37.956599  2312 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.960090  1684 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:37.978931  1684 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:37.982187  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:37.983273  7497 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:38.014144  1684 consensus_peers.cc:597] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:38.037531  2312 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:38.064265  1684 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:38.068885  2312 consensus_peers.cc:597] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:38.122202  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:38.148236  7497 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:38.148964  7497 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:38.151319  7497 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:38.203719  1686 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:38.235282  1684 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:38.235950  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:38.238315  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.240944  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:38.243188  7451 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:38.248121  1684 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:38.248694  1686 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.264442  1686 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.266263  1686 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.290545  1684 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:38.326928  7497 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:38.327765  7497 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:38.330987  7497 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:38.346285  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:38.347694  2347 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
W20260709 12:59:38.377014  1686 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:38.376309  1684 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:38.410472  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:38.422098  1684 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:38.422757  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:38.424100  7497 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:38.477447  7497 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:38.478132  7497 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:38.480633  7497 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:38.483363   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1668)
W20260709 12:59:38.484853  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.485648  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.502807  1684 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:38.504688  1686 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:38.505412  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:38.506194  7497 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:38.545302  1686 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.579056  1686 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:38.582926  7506 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:38.583504  7506 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:38.585644  7506 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:38.594316  2314 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:38.598397  2312 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:38.598863  2312 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:38.599599  7500 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:38.611696  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.688381  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.689459  1686 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.733880  1686 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:38.735280  7507 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:38.735824  7507 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:38.738234  7507 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:38.766933  1686 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:38.771157  1684 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:38.775995  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:38.787482  7497 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:38.784987  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:38.814455  7497 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:38.818578  7497 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:38.821584  7497 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:38.844105  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.851642  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.847435  1686 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:38.855232  1686 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:38.875213  1684 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:38.875874  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:38.879345  7497 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:38.884128  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:38.896118  7506 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:38.896793  7506 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:38.898960  7506 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:38.904771  2312 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:38.925529  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:38.938947  7500 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:38.939519  7500 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:38.941987  7500 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:38.946740  2312 leader_election.cc:336] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:38.946755  1686 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:38.947772  2314 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:38.948319  2314 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:38.950572  7500 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:39.009684  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:39.010362  2314 leader_election.cc:336] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:39.013209  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:39.019981  7506 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:59:39.062355  1686 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:39.268728  1686 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:39.298460  1686 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:39.301998  1686 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:39.307964  7497 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:39.308530  7497 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:39.310534  7497 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:39.317618  1684 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:39.321115  1686 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:39.324432  7500 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:39.325069  7500 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:39.321762  1686 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:39.329532  7497 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:59:39.333719  2314 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:39.340157  2312 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:39.340611  2312 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:39.341683  7512 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:39.344753  7500 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:39.347790  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20c9ad12e0d0435f95be2eda5b653b39" is_pre_election: true
I20260709 12:59:39.348460  1718 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c05ea12435084ad9b281ed3a0a2ecebe in term 15.
W20260709 12:59:39.368866  1686 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:39.386854  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:39.449457  1684 consensus_peers.cc:597] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:39.483778   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1668)
I20260709 12:59:39.510278  7497 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:39.510872  7497 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:39.512905  7497 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:39.525777  1684 leader_election.cc:336] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:39.526690  1686 leader_election.cc:336] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:39.527141  1686 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:39.528302  7497 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:39.597533  2312 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:39.603935  2312 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:39.713940  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:39.749498  1684 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:39.765632  7513 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:39.766215  7513 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:39.768409  7513 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:39.774600  1686 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:39.779554  1684 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:39.780079  1684 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:39.785569  7513 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:39.793632  1686 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:39.805168  2312 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:39.831492  1684 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:39.924834  7513 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:39.925480  7513 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:39.931406  7513 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:39.935222  1686 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:39.939046  1684 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:39.939548  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:39.940299  7497 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:39.943724  1684 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:39.947566  7513 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:39.948256  7513 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:39.958349  1686 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:39.964754  7513 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:39.966755  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:39.971064  2347 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
W20260709 12:59:39.978097  1684 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:39.978981  2312 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:39.981671  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:39.982982  7513 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:40.026998  1684 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.050595  2314 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:40.063359  7497 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:40.063951  7497 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:40.065973  7497 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:40.070919  7513 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:40.071435  7513 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:40.072834  2312 consensus_peers.cc:597] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:59:40.073695  7513 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:40.076551  1686 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:40.079209  1686 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:40.083592  1684 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:40.084074  1684 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:40.084856  7513 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:40.090123  2312 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.099747  1684 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:40.102165  1684 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:40.104857  7513 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:40.117556  1684 consensus_peers.cc:597] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:40.159408  1684 consensus_peers.cc:597] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.216084  1684 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.236056  2312 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.238142  1684 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.241202  1684 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:40.261629  7513 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:40.262204  7513 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:40.277463  1686 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:40.282776  1684 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:40.264426  7513 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:40.287424  2312 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.293607  2312 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.302680  1686 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:40.341192  2312 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.419526  2312 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:59:40.475239  7506 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:40.475798  7506 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:40.478206  7506 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:40.483547  2314 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:40.484221  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:40.484251   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1668)
W20260709 12:59:40.496346  2312 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:40.496902  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:40.497627  7506 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:40.545971  2312 consensus_peers.cc:597] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:59:40.636710  2312 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:40.637466  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:40.638823  1686 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:40.660656  2314 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111) [suppressed 708 similar messages]
W20260709 12:59:40.671288  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:59:40.880779  7513 raft_consensus.cc:493] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:40.881400  7513 raft_consensus.cc:515] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:40.885972  7497 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:40.886482  7497 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:40.889465  7497 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:40.891613  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:40.892277  2347 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
W20260709 12:59:40.903399  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:40.901046  7513 leader_election.cc:290] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:40.909307  1686 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:40.918419  1686 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:40.919044  1686 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:40.943810  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:40.966300  1686 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.009137  1686 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.013917  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.020494  1686 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:41.080008  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:59:41.108129  7513 raft_consensus.cc:493] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:41.108794  7513 raft_consensus.cc:515] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:41.111055  7513 leader_election.cc:290] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:41.127467  1686 leader_election.cc:336] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:41.128372  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.136441  1686 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.179606  1686 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.217342  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.326138  1684 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:41.330029  1684 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:41.332751  7497 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:41.339246  1684 consensus_peers.cc:597] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:41.346596  1684 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:41.349915  1684 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:41.350497  1684 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:41.351296  1684 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:41.351940  1684 consensus_peers.cc:597] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:41.352401  1684 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:41.340677  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.363653  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.364248  1684 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:41.365061  1684 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:41.368746  1684 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:41.369901  1684 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:41.369307  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.370838  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:59:41.371596  7497 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:41.372834  1684 leader_election.cc:336] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:41.376520  1684 leader_election.cc:304] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:41.378674  7497 raft_consensus.cc:2749] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:41.379575  1684 leader_election.cc:336] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:41.381716  1684 leader_election.cc:304] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:41.382411  7513 raft_consensus.cc:2749] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:41.427665  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:41.473037  1686 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.484898   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1668)
W20260709 12:59:41.537770  1686 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.678300  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:41.750438  7497 raft_consensus.cc:493] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:41.750989  7497 raft_consensus.cc:515] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:41.760808  1686 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:41.762135  7497 leader_election.cc:290] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:41.773739  1684 leader_election.cc:336] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:41.774273  1684 leader_election.cc:304] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:41.775946  7513 raft_consensus.cc:2749] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:41.794216  1686 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:41.827363  1686 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:41.834687  1686 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:42.062304  1686 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:59:42.188153  7516 raft_consensus.cc:493] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:42.188874  7516 raft_consensus.cc:515] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:42.193255  7516 leader_election.cc:290] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:42.238035  2312 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:42.247637  1686 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:42.257383  1684 leader_election.cc:336] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:42.260456  1684 leader_election.cc:304] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:42.261600  7513 raft_consensus.cc:2749] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:59:42.269433  2312 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:42.280989  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:42.283634  2312 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:42.327577  1686 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:42.485344   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1668)
I20260709 12:59:42.498062  7516 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:42.498790  7516 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:42.505195  1686 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:42.512300  2312 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:42.516973  1684 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:42.517498  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:42.518534  7513 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.520042  7516 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:42.521733  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:42.522392  2347 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
W20260709 12:59:42.527782  2312 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:42.652487  1684 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:42.701138  2312 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:42.723841  1684 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:42.762691  1686 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:42.763732  2312 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:42.765585  1684 consensus_peers.cc:597] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:42.779603  2312 consensus_peers.cc:597] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:42.784155  2314 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:42.810221  2312 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:42.971264  1684 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.011849  2312 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.042825  1684 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.054266  2312 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:43.056972  7513 raft_consensus.cc:493] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:43.057763  7513 raft_consensus.cc:515] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:43.060058  7513 leader_election.cc:290] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:43.064399  1686 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:43.069583  1684 leader_election.cc:336] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:43.070022  1684 leader_election.cc:304] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:43.070716  7513 raft_consensus.cc:2749] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:43.111349  2312 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.143745  1501 debug-util.cc:398] Leaking SignalData structure 0x7b080037aa40 after lost signal to thread 434
W20260709 12:59:43.144948  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800214120 after lost signal to thread 1504
W20260709 12:59:43.146330  1501 debug-util.cc:398] Leaking SignalData structure 0x7b080036f500 after lost signal to thread 1745
W20260709 12:59:43.147569  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3d60 after lost signal to thread 2373
W20260709 12:59:43.169482  1684 consensus_peers.cc:597] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.193157  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.207538  1684 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:43.208673  7513 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:43.209146  7513 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:43.215875  1686 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:43.221181  7513 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:43.223615  2312 consensus_peers.cc:597] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:43.225668  1684 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:43.232421  1684 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:43.230756  1686 consensus_peers.cc:597] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:59:43.234562  7516 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:43.258355  1684 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:43.288013  7513 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:43.288980  7513 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:43.292306  7513 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:43.290021  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:43.296135  1686 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:43.308449  1686 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.326045  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.332366  1684 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.334193  1684 consensus_peers.cc:597] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:59:43.338580  1684 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.339095  1684 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:43.339534  1684 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:43.340298  7513 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:43.341378  1684 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.415458  1684 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:43.445565  7516 raft_consensus.cc:493] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:43.446249  7516 raft_consensus.cc:515] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:43.452114  7516 leader_election.cc:290] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:43.454515  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598f1b27b4ab45cfac5cc13489b2e687" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:43.455250  2347 raft_consensus.cc:2468] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 15.
I20260709 12:59:43.456303  7521 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:43.456881  7521 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:43.457595  1684 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:43.459177  7521 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:43.466584  2312 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:43.467636  2314 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:43.468058  2314 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:43.468830  7521 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:43.475618  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.485819   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1668)
W20260709 12:59:43.546867  1684 consensus_peers.cc:597] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.548043  1684 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.578850  1684 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.632551  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.663746  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.677505  1684 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.677704  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.697680  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.702351  1684 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.709278  1684 consensus_peers.cc:597] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:43.745930  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.760167  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.785459  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:59:43.859089  7519 raft_consensus.cc:493] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:43.860966  7519 raft_consensus.cc:515] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:43.867908  7519 leader_election.cc:290] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:43.877745  2312 leader_election.cc:336] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:43.941367  7513 raft_consensus.cc:493] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:43.943328  7513 raft_consensus.cc:515] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:43.946255  7513 leader_election.cc:290] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:43.972004  2314 leader_election.cc:336] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:43.984026  2314 leader_election.cc:304] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:43.987401  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:43.992482  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:43.990942  1684 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:43.993506  1684 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:59:43.988052  7519 raft_consensus.cc:2749] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:59:44.070950  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:59:44.126294  7519 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:44.127117  7519 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:44.135463  2314 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:44.141044  2312 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:44.141510  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:44.142473  7526 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:44.142572  7519 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
I20260709 12:59:44.392737  7513 raft_consensus.cc:493] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:44.393301  7513 raft_consensus.cc:515] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:44.395414  7513 leader_election.cc:290] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:44.401278  1684 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:44.484810  1686 leader_election.cc:336] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:44.486500   431 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1668)
I20260709 12:59:44.490355  1686 leader_election.cc:304] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:44.491437  7513 raft_consensus.cc:2749] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:44.493759  1686 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:44.494513  1686 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:44.495178  1686 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:44.496332  1686 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:44.497062  1686 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:44.499169  1686 leader_election.cc:336] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:44.499636  1686 leader_election.cc:304] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:44.500420  7513 raft_consensus.cc:2749] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:44.507531  1686 leader_election.cc:336] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:44.508155  1686 leader_election.cc:304] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:44.508950  7513 raft_consensus.cc:2749] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:44.536177  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:44.557799  1686 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:44.661844  2312 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:44.728276  1686 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:44.752660  2312 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:44.856199  1686 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:59:44.863572  7513 raft_consensus.cc:493] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:44.864341  7513 raft_consensus.cc:515] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:44.867583  7513 leader_election.cc:290] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:44.886929  1684 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:44.907236  1686 leader_election.cc:336] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:44.934731  1686 leader_election.cc:304] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:44.935561  2312 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:44.942552  7513 raft_consensus.cc:2749] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:44.943567  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 45892.3us
W20260709 12:59:44.961511  1686 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:44.970755  1686 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:44.974998  1686 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:45.077486  2312 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.081456  1684 consensus_peers.cc:597] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:45.104123  7527 raft_consensus.cc:493] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:45.104907  7527 raft_consensus.cc:515] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:45.108882  7527 leader_election.cc:290] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:45.117275  1684 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:45.118453  1686 leader_election.cc:336] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:45.118932  1686 leader_election.cc:304] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:45.119664  7527 raft_consensus.cc:2749] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:45.128999  1684 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.132813  2314 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:45.144819  1686 consensus_peers.cc:597] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:45.190392  2312 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.210091  1686 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:45.250982  2312 consensus_peers.cc:597] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:45.330706  2312 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.354108  2312 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.362870  2312 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.374431  1684 consensus_peers.cc:597] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:45.474131  1684 consensus_peers.cc:597] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.490199   431 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1668)
W20260709 12:59:45.623704  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:45.637452  2312 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.640196  1684 consensus_peers.cc:597] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.658282  1684 consensus_peers.cc:597] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.672299  2314 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111) [suppressed 642 similar messages]
W20260709 12:59:45.675293  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:45.703416  1684 consensus_peers.cc:597] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.705817  1684 consensus_peers.cc:597] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.755561  2312 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:45.769534  7527 raft_consensus.cc:493] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:45.770205  7527 raft_consensus.cc:515] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
W20260709 12:59:45.772112  1684 consensus_peers.cc:597] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.773219  1684 consensus_peers.cc:597] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:59:45.774260  7527 leader_election.cc:290] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:45.780256  1684 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:45.803203  2312 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.808393  2312 consensus_peers.cc:597] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:45.843063  1684 consensus_peers.cc:597] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.917913  1684 consensus_peers.cc:597] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:59:45.955570  1684 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.959596  1684 consensus_peers.cc:597] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:45.981307  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:46.079843  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.100539  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.130724  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.146337  1684 consensus_peers.cc:597] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:46.162056  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.162590  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.165942  1456 catalog_manager.cc:4755] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet af922e165f0c427eacd26ca4bc111d76: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:46.187646  1684 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:46.190083  1684 consensus_peers.cc:597] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:46.247786  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.218345  1684 consensus_peers.cc:597] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:46.251821  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.298934  2314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39997, user_credentials={real_user=slave}} blocked reactor thread for 47165.1us
W20260709 12:59:46.297169  1684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33881, user_credentials={real_user=slave}} blocked reactor thread for 78884.3us
W20260709 12:59:46.303265  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:59:46.304396  7531 raft_consensus.cc:493] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:46.305040  7531 raft_consensus.cc:515] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } }
I20260709 12:59:46.306741  7531 leader_election.cc:290] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:46.307518  1684 consensus_peers.cc:597] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:46.311658  1684 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:46.330880  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.505275  1686 consensus_peers.cc:597] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.506402  1686 leader_election.cc:336] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:46.506906  1686 leader_election.cc:304] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:46.507755  7531 raft_consensus.cc:2749] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:46.509096  1686 leader_election.cc:336] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:46.509546  1686 leader_election.cc:304] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:46.510289  7531 raft_consensus.cc:2749] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:46.512495  1684 consensus_peers.cc:597] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:46.568907  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:59:46.576565  7527 raft_consensus.cc:493] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:46.577217  7527 raft_consensus.cc:515] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } attrs { replace: true } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:46.579617  7527 leader_election.cc:290] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), c05ea12435084ad9b281ed3a0a2ecebe (127.0.107.196:43269)
I20260709 12:59:46.581938  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c93ae6dea242bf9de5cf30087783be" candidate_uuid: "20c9ad12e0d0435f95be2eda5b653b39" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" is_pre_election: true
I20260709 12:59:46.582813  2347 raft_consensus.cc:2468] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c9ad12e0d0435f95be2eda5b653b39 in term 11.
W20260709 12:59:46.584405  1686 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:46.587433  1684 leader_election.cc:336] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:46.587863  1684 leader_election.cc:304] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20c9ad12e0d0435f95be2eda5b653b39, c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:46.589098  7527 raft_consensus.cc:2749] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:46.606663   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 12:59:46.675608  1686 consensus_peers.cc:597] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:46.740237  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:59:46.769483   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 12:59:46.783862  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.835049   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:46.836086   431 tablet_replica.cc:333] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.837224   431 raft_consensus.cc:2243] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.837929   431 raft_consensus.cc:2272] T 5a33c093dd1a4a51a63ade534efa70f8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.840889   431 tablet_replica.cc:333] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.841624   431 raft_consensus.cc:2243] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.842811   431 raft_consensus.cc:2272] T 26cba50eaa264fd889cd8a4587b03948 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.844781   431 tablet_replica.cc:333] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.845389   431 raft_consensus.cc:2243] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.846659   431 raft_consensus.cc:2272] T 7b5c0052ddab4e69a58f0da887bba56e P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.848410   431 tablet_replica.cc:333] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.848978   431 raft_consensus.cc:2243] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.849656   431 raft_consensus.cc:2272] T a2aea8dafba3428dbb6d189666a9957b P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.851465   431 tablet_replica.cc:333] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.851986   431 raft_consensus.cc:2243] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.853088   431 raft_consensus.cc:2272] T e271944afc3846f9b26d682a57b58ce8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.854913   431 tablet_replica.cc:333] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.855499   431 raft_consensus.cc:2243] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.856343   431 raft_consensus.cc:2272] T 4da9bedf7aba45139d86ca314258a105 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.858129   431 tablet_replica.cc:333] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.858687   431 raft_consensus.cc:2243] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.859683   431 raft_consensus.cc:2272] T 86e8c2c317414ecda8dce8d5284c74d1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.861555   431 tablet_replica.cc:333] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.862092   431 raft_consensus.cc:2243] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.862973   431 raft_consensus.cc:2272] T 523c299f124340818ee040d8a887dba6 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.864748   431 tablet_replica.cc:333] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.865343   431 raft_consensus.cc:2243] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.866263   431 raft_consensus.cc:2272] T a3d04144cd804a9b886ecfd1a986ec95 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.868120   431 tablet_replica.cc:333] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.868680   431 raft_consensus.cc:2243] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.869711   431 raft_consensus.cc:2272] T 85c93ae6dea242bf9de5cf30087783be P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.871641   431 tablet_replica.cc:333] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.872145   431 raft_consensus.cc:2243] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.873594   431 raft_consensus.cc:2272] T 45ae77627c4743fc864bb7da44bb00b3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.875483   431 tablet_replica.cc:333] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.876013   431 raft_consensus.cc:2243] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.876961   431 raft_consensus.cc:2272] T 997bea07114b4964bbe0c9bc9185a7f4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.879241   431 tablet_replica.cc:333] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.879951   431 raft_consensus.cc:2243] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.880893   431 raft_consensus.cc:2272] T c680cef608164c689f7de9b00b60e72d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.883193   431 tablet_replica.cc:333] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.883683   431 raft_consensus.cc:2243] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.884538   431 raft_consensus.cc:2272] T fe107547ec8e475786b8fa8f8c789648 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.886443   431 tablet_replica.cc:333] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.886935   431 raft_consensus.cc:2243] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.887457   431 raft_consensus.cc:2272] T 57f5c2cabd34469aa65eff4ffae3e350 P 20c9ad12e0d0435f95be2eda5b653b39 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.889696   431 tablet_replica.cc:333] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.890448   431 raft_consensus.cc:2243] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.891469   431 raft_consensus.cc:2272] T b51b349fdba540c3a8c0e167720c3a7c P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.893474   431 tablet_replica.cc:333] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.893990   431 raft_consensus.cc:2243] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.895030   431 raft_consensus.cc:2272] T 598f1b27b4ab45cfac5cc13489b2e687 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.896828   431 tablet_replica.cc:333] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.897346   431 raft_consensus.cc:2243] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.898346   431 raft_consensus.cc:2272] T a598709808884384ad6ce3e99aa4345a P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.900224   431 tablet_replica.cc:333] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.900843   431 raft_consensus.cc:2243] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.901495   431 raft_consensus.cc:2272] T 35c533e32b324f8f80c12f5380f0c92d P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.903362   431 tablet_replica.cc:333] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.903873   431 raft_consensus.cc:2243] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.904850   431 raft_consensus.cc:2272] T 3df7e2e5458047a9a8b0d6a07577bbbe P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.906569   431 tablet_replica.cc:333] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.907214   431 raft_consensus.cc:2243] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.907706   431 raft_consensus.cc:2272] T 963d2113f061422e874d4718ed8d9538 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.909559   431 tablet_replica.cc:333] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.910073   431 raft_consensus.cc:2243] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.911257   431 raft_consensus.cc:2272] T af922e165f0c427eacd26ca4bc111d76 P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.913736   431 tablet_replica.cc:333] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
W20260709 12:59:46.914225  2314 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.914342   431 raft_consensus.cc:2243] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.915449   431 raft_consensus.cc:2272] T 295d06aa958a45069eef5737c8adf1ff P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.917619   431 tablet_replica.cc:333] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.918243   431 raft_consensus.cc:2243] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.918865   431 raft_consensus.cc:2272] T fdd982fdd5b6440bbcf0eaf350f5124f P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.921372   431 tablet_replica.cc:333] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.922149   431 raft_consensus.cc:2243] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.922740   431 raft_consensus.cc:2272] T 0d36382528fc4b5680388922224bdfa3 P 20c9ad12e0d0435f95be2eda5b653b39 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.924780   431 tablet_replica.cc:333] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.925244   431 raft_consensus.cc:2243] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.925737   431 raft_consensus.cc:2272] T 1b56889944b24c9cb46eb080b37a2d4b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.927377   431 tablet_replica.cc:333] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.927855   431 raft_consensus.cc:2243] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.928380   431 raft_consensus.cc:2272] T 6d01fa5de23643a7bc42ad00178a7f51 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.930848   431 tablet_replica.cc:333] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.931557   431 raft_consensus.cc:2243] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.932065   431 raft_consensus.cc:2272] T 5ac8464a8a2c438c8cdaf74b18d51098 P 20c9ad12e0d0435f95be2eda5b653b39 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:46.932217  2314 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.934243   431 tablet_replica.cc:333] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.934828   431 raft_consensus.cc:2243] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.935719   431 raft_consensus.cc:2272] T 508332d25a2b4288bc6411b566044758 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.937719   431 tablet_replica.cc:333] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.938295   431 raft_consensus.cc:2243] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.938791   431 raft_consensus.cc:2272] T 089ef23951ac45c3a80b53b6e8127c61 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.940948   431 tablet_replica.cc:333] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
W20260709 12:59:46.941381  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.941527   431 raft_consensus.cc:2243] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.942196   431 raft_consensus.cc:2272] T a008f8fc81244052803539fc7317853b P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.943910   431 tablet_replica.cc:333] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.944501   431 raft_consensus.cc:2243] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.945075   431 raft_consensus.cc:2272] T 1aaf4486c502440fb4b5bc1ef7cc7256 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.947721   431 tablet_replica.cc:333] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.948665   431 raft_consensus.cc:2243] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.949681   431 raft_consensus.cc:2272] T c5064e0cc33a4a9383fca6c8ee736c18 P 20c9ad12e0d0435f95be2eda5b653b39 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.951709   431 tablet_replica.cc:333] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.952203   431 raft_consensus.cc:2243] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.952852   431 raft_consensus.cc:2272] T db00224dfea24cb2a0a2400d9b4a907f P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.954702   431 tablet_replica.cc:333] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.955240   431 raft_consensus.cc:2243] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.955806   431 raft_consensus.cc:2272] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.957571   431 tablet_replica.cc:333] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.958056   431 raft_consensus.cc:2243] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.958575   431 raft_consensus.cc:2272] T 0ccb6bb6402c4cdf9f065c72d521dc44 P 20c9ad12e0d0435f95be2eda5b653b39 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.960371   431 tablet_replica.cc:333] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.960901   431 raft_consensus.cc:2243] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.961549   431 raft_consensus.cc:2272] T 061154c4edb1414ca27eef7f6a49a794 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.963254   431 tablet_replica.cc:333] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.963740   431 raft_consensus.cc:2243] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.964706   431 raft_consensus.cc:2272] T 88ae4cb056ac43519786f1fb62431bc4 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.966881   431 tablet_replica.cc:333] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.967588   431 raft_consensus.cc:2243] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.968995   431 raft_consensus.cc:2272] T 99331ae0325b4de6bd6d097c96af6d6c P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.970937   431 tablet_replica.cc:333] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.971448   431 raft_consensus.cc:2243] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.972316   431 raft_consensus.cc:2272] T 87fb4f5285564d94ab4d48e9ec00f31b P 20c9ad12e0d0435f95be2eda5b653b39 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.974388   431 tablet_replica.cc:333] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.974872   431 raft_consensus.cc:2243] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.975494   431 raft_consensus.cc:2272] T 218ace78ff9d4582bd0fa7fe82f9654f P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.977326   431 tablet_replica.cc:333] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.977803   431 raft_consensus.cc:2243] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.978643   431 raft_consensus.cc:2272] T 30729cf665ff46d199eb9632bd1f5ad1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.980470   431 tablet_replica.cc:333] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.980971   431 raft_consensus.cc:2243] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.981621   431 raft_consensus.cc:2272] T bdbdfb43cea249489bc1a1b1cc104254 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.983307   431 tablet_replica.cc:333] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.983930   431 raft_consensus.cc:2243] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.985249   431 raft_consensus.cc:2272] T 9d74d4e4a65d434897c3095399228ce1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.987534   431 tablet_replica.cc:333] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.988063   431 raft_consensus.cc:2243] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.989012   431 raft_consensus.cc:2272] T 89071a75dff1449588d2f1f4d1b1fb15 P 20c9ad12e0d0435f95be2eda5b653b39 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.990870   431 tablet_replica.cc:333] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.991357   431 raft_consensus.cc:2243] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:46.992208   431 raft_consensus.cc:2272] T 4ed697fc3d1e49f2ac09064ed3b8abc1 P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.993897   431 tablet_replica.cc:333] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.994359   431 raft_consensus.cc:2243] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.995117   431 raft_consensus.cc:2272] T b302e4f74a6c4ff2915495d3ac0982bc P 20c9ad12e0d0435f95be2eda5b653b39 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.997085   431 tablet_replica.cc:333] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:46.997589   431 raft_consensus.cc:2243] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:46.998138   431 raft_consensus.cc:2272] T 35dd8bcf618a48bb9d3dc5e16f488fcf P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:46.999840   431 tablet_replica.cc:333] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39: stopping tablet replica
I20260709 12:59:47.000252   431 raft_consensus.cc:2243] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:47.001204   431 raft_consensus.cc:2272] T 39b62689c0094341b01c7263292dd753 P 20c9ad12e0d0435f95be2eda5b653b39 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:47.026571  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.027352  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.039345  2314 consensus_peers.cc:597] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.065140  2314 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.065903  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.086381  2312 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:47.097424  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:47.112056  2314 consensus_peers.cc:597] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.112526  2314 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.133644  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.133947  2312 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:47.162267  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.183871  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.260994  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:47.343447  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08003639e0 after lost signal to thread 434
W20260709 12:59:47.344491  1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800392020 after lost signal to thread 1504
W20260709 12:59:47.345738  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080038f2a0 after lost signal to thread 1745
W20260709 12:59:47.346791  1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800362280 after lost signal to thread 2373
W20260709 12:59:47.511225  2312 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:47.525633  2312 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:47.561703  2312 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:59:47.698506  7541 raft_consensus.cc:493] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:47.699074  7541 raft_consensus.cc:515] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:47.701411  7541 leader_election.cc:290] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:47.705732  2314 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:47.706267  2312 leader_election.cc:336] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:47.706719  2312 leader_election.cc:304] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:47.707825  7541 raft_consensus.cc:2749] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:47.720885  2314 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:47.793711  2312 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:47.865741  2312 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:47.885097  2312 consensus_peers.cc:597] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:48.011689  2312 consensus_peers.cc:597] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:59:48.025527  7541 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:48.026253  7541 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:48.029439  7541 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:48.035003  2314 leader_election.cc:336] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111)
W20260709 12:59:48.037346  2312 leader_election.cc:336] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:48.037842  2312 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:48.038357  7541 raft_consensus.cc:493] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:48.038659  7537 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:48.039001  7541 raft_consensus.cc:515] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:48.041348  7541 leader_election.cc:290] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:48.047221  2314 leader_election.cc:336] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111)
W20260709 12:59:48.049336  2312 leader_election.cc:336] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:48.049769  2312 leader_election.cc:304] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:48.050522  7541 raft_consensus.cc:2749] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:48.065253  2312 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:48.100656   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1742)
I20260709 12:59:48.158574  7541 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:48.159242  7541 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:48.162068  7541 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:48.170109  7537 raft_consensus.cc:493] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
W20260709 12:59:48.170364  2314 leader_election.cc:336] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111)
I20260709 12:59:48.170722  7537 raft_consensus.cc:515] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
W20260709 12:59:48.171231  2314 leader_election.cc:336] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:48.171921  2314 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:48.173105  7537 leader_election.cc:290] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
I20260709 12:59:48.174415  7537 raft_consensus.cc:493] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:48.174939  7537 raft_consensus.cc:515] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:48.176065  7538 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:48.178821  7537 leader_election.cc:290] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:48.183059  2312 leader_election.cc:336] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:48.186590  2312 consensus_peers.cc:597] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:59:48.187150  2312 leader_election.cc:336] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:48.191426  2314 leader_election.cc:336] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:48.192711  2314 leader_election.cc:336] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111)
I20260709 12:59:48.193120  2314 leader_election.cc:304] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 2af567a273d44ca89d2b3b0f7c815bd1
I20260709 12:59:48.193866  7543 raft_consensus.cc:2749] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:59:48.194010  2314 leader_election.cc:336] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111)
I20260709 12:59:48.194526  2314 leader_election.cc:304] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:48.195236  7543 raft_consensus.cc:2749] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:48.232420  7543 raft_consensus.cc:493] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:48.233067  7543 raft_consensus.cc:515] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:48.235558  7543 leader_election.cc:290] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:48.239822  2312 leader_election.cc:336] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:48.241737  2314 leader_election.cc:336] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111)
I20260709 12:59:48.242242  2314 leader_election.cc:304] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:48.243021  7543 raft_consensus.cc:2749] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:48.264016  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:59:48.292276  7543 raft_consensus.cc:493] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:48.292884  7543 raft_consensus.cc:515] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:48.295109  7543 leader_election.cc:290] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:48.302292  2312 leader_election.cc:336] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:48.304443  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:48.306030  2314 leader_election.cc:336] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111)
I20260709 12:59:48.306478  2314 leader_election.cc:304] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
W20260709 12:59:48.306746  2312 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:59:48.307227  7543 raft_consensus.cc:2749] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:59:48.320235  2312 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:48.357640  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:59:48.502607  2314 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:48.503064  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:48.553355  2314 consensus_peers.cc:597] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:48.588546  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:48.597172  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:48.665501  2314 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:59:48.790872  7544 raft_consensus.cc:493] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7a04d0a2963b4860beb7cd14e0b4939a)
I20260709 12:59:48.791424  7544 raft_consensus.cc:515] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:48.793687  7544 leader_election.cc:290] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881)
W20260709 12:59:48.799736  2314 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
W20260709 12:59:48.800315  2312 leader_election.cc:336] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
I20260709 12:59:48.800863  2312 leader_election.cc:304] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:48.802024  7544 raft_consensus.cc:2749] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:48.805418  2314 consensus_peers.cc:597] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:48.825541  2314 consensus_peers.cc:597] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:48.901234  2314 consensus_peers.cc:597] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:48.999971  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:59:49.101243   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1742)
W20260709 12:59:49.170555  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:49.328148  2314 consensus_peers.cc:597] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.386107  2314 consensus_peers.cc:597] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.442641  2314 consensus_peers.cc:597] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.453233  2314 consensus_peers.cc:597] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.468688  2314 consensus_peers.cc:597] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.483132  2314 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.497664  2314 consensus_peers.cc:597] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.498104  2314 consensus_peers.cc:597] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.540459  2314 consensus_peers.cc:597] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.553146  2314 consensus_peers.cc:597] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.577992  2314 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.592186  2312 consensus_peers.cc:597] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:59:49.596138  7544 raft_consensus.cc:493] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:49.596777  7544 raft_consensus.cc:515] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:49.599135  7544 leader_election.cc:290] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:49.602602  2312 leader_election.cc:336] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:49.603710  2314 leader_election.cc:336] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111)
I20260709 12:59:49.604095  2314 leader_election.cc:304] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 20c9ad12e0d0435f95be2eda5b653b39, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:49.604802  7544 raft_consensus.cc:2749] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:49.644933  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.654470  2314 consensus_peers.cc:597] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:59:49.685767  2312 consensus_peers.cc:597] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:59:49.746389  2314 consensus_peers.cc:597] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Couldn't send request to peer 2af567a273d44ca89d2b3b0f7c815bd1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:59:49.775549  2314 consensus_peers.cc:597] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:49.807693   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 12:59:49.842123  2312 consensus_peers.cc:597] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:59:49.867599  7543 raft_consensus.cc:493] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20c9ad12e0d0435f95be2eda5b653b39)
I20260709 12:59:49.868343  7543 raft_consensus.cc:515] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2af567a273d44ca89d2b3b0f7c815bd1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39997 } } peers { permanent_uuid: "7a04d0a2963b4860beb7cd14e0b4939a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33881 } attrs { replace: true } } peers { permanent_uuid: "20c9ad12e0d0435f95be2eda5b653b39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36649 } } peers { permanent_uuid: "c05ea12435084ad9b281ed3a0a2ecebe" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 43269 } attrs { promote: false } }
I20260709 12:59:49.873536  7543 leader_election.cc:290] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997), 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881), 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649)
W20260709 12:59:49.880053  2312 leader_election.cc:336] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111)
W20260709 12:59:49.882786  2314 leader_election.cc:336] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 12:59:49.883288  2314 leader_election.cc:304] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c05ea12435084ad9b281ed3a0a2ecebe; no voters: 2af567a273d44ca89d2b3b0f7c815bd1, 7a04d0a2963b4860beb7cd14e0b4939a
I20260709 12:59:49.884164  7543 raft_consensus.cc:2749] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:49.886274  2314 leader_election.cc:336] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111)
W20260709 12:59:49.887189  2314 consensus_peers.cc:597] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 20c9ad12e0d0435f95be2eda5b653b39 (127.0.107.195:36649): Couldn't send request to peer 20c9ad12e0d0435f95be2eda5b653b39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36649: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:59:49.925715   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 12:59:49.976599   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:49.977607   431 tablet_replica.cc:333] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:49.978861   431 raft_consensus.cc:2243] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:49.979698   431 raft_consensus.cc:2272] T 45ae77627c4743fc864bb7da44bb00b3 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:49.982802   431 tablet_replica.cc:333] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:49.983819   431 raft_consensus.cc:2243] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:49.984555   431 raft_consensus.cc:2272] T 85c93ae6dea242bf9de5cf30087783be P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:49.986964   431 tablet_replica.cc:333] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:49.987583   431 raft_consensus.cc:2243] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:49.988252   431 raft_consensus.cc:2272] T af922e165f0c427eacd26ca4bc111d76 P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:49.990407   431 tablet_replica.cc:333] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:49.991003   431 raft_consensus.cc:2243] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:49.991974   431 raft_consensus.cc:2272] T 218ace78ff9d4582bd0fa7fe82f9654f P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:49.994375   431 tablet_replica.cc:333] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:49.994977   431 raft_consensus.cc:2243] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:49.995774   431 raft_consensus.cc:2272] T 598f1b27b4ab45cfac5cc13489b2e687 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:49.998461   431 tablet_replica.cc:333] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:49.999166   431 raft_consensus.cc:2243] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:49.999841   431 raft_consensus.cc:2272] T 997bea07114b4964bbe0c9bc9185a7f4 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.002458   431 tablet_replica.cc:333] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.003338   431 raft_consensus.cc:2243] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.004251   431 raft_consensus.cc:2272] T 6d01fa5de23643a7bc42ad00178a7f51 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.007156   431 tablet_replica.cc:333] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.007975   431 raft_consensus.cc:2243] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.009104   431 raft_consensus.cc:2272] T 39b62689c0094341b01c7263292dd753 P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:50.010185  2312 consensus_peers.cc:597] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe -> Peer 7a04d0a2963b4860beb7cd14e0b4939a (127.0.107.194:33881): Couldn't send request to peer 7a04d0a2963b4860beb7cd14e0b4939a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33881: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:59:50.011773   431 tablet_replica.cc:333] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.012579   431 raft_consensus.cc:2243] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.013545   431 raft_consensus.cc:2272] T 6fbeca1b8e9f46c5843a82bafe73b5a8 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.016151   431 tablet_replica.cc:333] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.016842   431 raft_consensus.cc:2243] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.018325   431 raft_consensus.cc:2272] T 65bdb5c7faf24eb08b41f32ba12e1932 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.021011   431 tablet_replica.cc:333] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.021575   431 raft_consensus.cc:2243] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.022498   431 raft_consensus.cc:2272] T 0d36382528fc4b5680388922224bdfa3 P c05ea12435084ad9b281ed3a0a2ecebe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.024597   431 tablet_replica.cc:333] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.025329   431 raft_consensus.cc:2243] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.026319   431 raft_consensus.cc:2272] T b302e4f74a6c4ff2915495d3ac0982bc P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.028928   431 tablet_replica.cc:333] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.029693   431 raft_consensus.cc:2243] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.030725   431 raft_consensus.cc:2272] T acc3fcdecc7546fe92075e15e904c331 P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.032917   431 tablet_replica.cc:333] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.033430   431 raft_consensus.cc:2243] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:50.034008   431 raft_consensus.cc:2272] T 86e8c2c317414ecda8dce8d5284c74d1 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.036209   431 tablet_replica.cc:333] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.036816   431 raft_consensus.cc:2243] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.037611   431 raft_consensus.cc:2272] T 061154c4edb1414ca27eef7f6a49a794 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.039511   431 tablet_replica.cc:333] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.040033   431 raft_consensus.cc:2243] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.041013   431 raft_consensus.cc:2272] T 0ccb6bb6402c4cdf9f065c72d521dc44 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.042974   431 tablet_replica.cc:333] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.043514   431 raft_consensus.cc:2243] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:50.043978   431 raft_consensus.cc:2272] T b51b349fdba540c3a8c0e167720c3a7c P c05ea12435084ad9b281ed3a0a2ecebe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.046311   431 tablet_replica.cc:333] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.047001   431 raft_consensus.cc:2243] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:50.047547   431 raft_consensus.cc:2272] T d5a66d6152a24cf08a833d30477e5bbe P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.049986   431 tablet_replica.cc:333] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.050518   431 raft_consensus.cc:2243] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.051637   431 raft_consensus.cc:2272] T 26cba50eaa264fd889cd8a4587b03948 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.054221   431 tablet_replica.cc:333] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.054736   431 raft_consensus.cc:2243] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:50.055203   431 raft_consensus.cc:2272] T fe107547ec8e475786b8fa8f8c789648 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.057315   431 tablet_replica.cc:333] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.057878   431 raft_consensus.cc:2243] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:50.058583   431 raft_consensus.cc:2272] T 7b5c0052ddab4e69a58f0da887bba56e P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.060910   431 tablet_replica.cc:333] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.061439   431 raft_consensus.cc:2243] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.062273   431 raft_consensus.cc:2272] T e271944afc3846f9b26d682a57b58ce8 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.064050   431 tablet_replica.cc:333] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.064592   431 raft_consensus.cc:2243] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.065516   431 raft_consensus.cc:2272] T 57f5c2cabd34469aa65eff4ffae3e350 P c05ea12435084ad9b281ed3a0a2ecebe [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.067445   431 tablet_replica.cc:333] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.067953   431 raft_consensus.cc:2243] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.068831   431 raft_consensus.cc:2272] T 075b6c0f44a54d0cb3e8050968db2158 P c05ea12435084ad9b281ed3a0a2ecebe [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.070739   431 tablet_replica.cc:333] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.071283   431 raft_consensus.cc:2243] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:50.071743   431 raft_consensus.cc:2272] T a3e979717db64b77b569522980fab6af P c05ea12435084ad9b281ed3a0a2ecebe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.073851   431 tablet_replica.cc:333] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.074366   431 raft_consensus.cc:2243] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.075161   431 raft_consensus.cc:2272] T 35dd8bcf618a48bb9d3dc5e16f488fcf P c05ea12435084ad9b281ed3a0a2ecebe [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.077273   431 tablet_replica.cc:333] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.077802   431 raft_consensus.cc:2243] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.078599   431 raft_consensus.cc:2272] T d0aa36fcde2c4a1fa46a60cb9a82a16f P c05ea12435084ad9b281ed3a0a2ecebe [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.080708   431 tablet_replica.cc:333] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.081215   431 raft_consensus.cc:2243] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.082074   431 raft_consensus.cc:2272] T 46fb86b9f3304b99a092fa35dffe1813 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.083911   431 tablet_replica.cc:333] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.084417   431 raft_consensus.cc:2243] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.085353   431 raft_consensus.cc:2272] T 52bc0b3e08ea4bd78b344b833b97faed P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.087672   431 tablet_replica.cc:333] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.088356   431 raft_consensus.cc:2243] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.089211   431 raft_consensus.cc:2272] T 27982349e557426eb54944f0699b5f79 P c05ea12435084ad9b281ed3a0a2ecebe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.091759   431 tablet_replica.cc:333] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.092252   431 raft_consensus.cc:2243] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.093171   431 raft_consensus.cc:2272] T 5ac8464a8a2c438c8cdaf74b18d51098 P c05ea12435084ad9b281ed3a0a2ecebe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.095022   431 tablet_replica.cc:333] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.095475   431 raft_consensus.cc:2243] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:50.095922   431 raft_consensus.cc:2272] T 13d708096220406385b27d464c8725f2 P c05ea12435084ad9b281ed3a0a2ecebe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.097859   431 tablet_replica.cc:333] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.098353   431 raft_consensus.cc:2243] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.099496   431 raft_consensus.cc:2272] T 99331ae0325b4de6bd6d097c96af6d6c P c05ea12435084ad9b281ed3a0a2ecebe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.101881   431 tablet_replica.cc:333] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe: stopping tablet replica
I20260709 12:59:50.102339   431 raft_consensus.cc:2243] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:59:50.103119   431 raft_consensus.cc:2272] T 5a33c093dd1a4a51a63ade534efa70f8 P c05ea12435084ad9b281ed3a0a2ecebe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.469339   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 12:59:50.532433   431 master.cc:562] Master@127.0.107.254:43765 shutting down...
W20260709 12:59:50.572116  1518 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:59:50.572399  1518 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:59:50.572613  1518 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:00:02.555150  1456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111) [suppressed 459 similar messages]
W20260709 13:00:02.558911  1456 catalog_manager.cc:4755] TS 2af567a273d44ca89d2b3b0f7c815bd1 (127.0.107.193:39997): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet af922e165f0c427eacd26ca4bc111d76: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39997: connect: Connection refused (error 111)
I20260709 13:00:04.189378   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:04.190691   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:04.191195   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P ab5bd50f45be44c4afe02e363e8322ae: stopping tablet replica
I20260709 13:00:04.352747   431 master.cc:584] Master@127.0.107.254:43765 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (211638 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:00:04.469353   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43053
I20260709 13:00:04.470513   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:04.476438  7553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:04.477416  7556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:04.477490  7554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:04.479213   431 server_base.cc:1061] running on GCE node
I20260709 13:00:04.481998   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:04.482185   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:04.482296   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602004482285 us; error 0 us; skew 500 ppm
I20260709 13:00:04.482749   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:04.485311   431 webserver.cc:533] Webserver started at http://127.0.107.254:33077/ using document root <none> and password file <none>
I20260709 13:00:04.485754   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:04.485905   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:04.486119   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:04.487326   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/master-0-root/instance:
uuid: "a0da72817da647b58428e2c39868f6ba"
format_stamp: "Formatted at 2026-07-09 13:00:04 on dist-test-slave-73vh"
I20260709 13:00:04.491917   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:00:04.495172  7561 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:04.495900   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:04.496202   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/master-0-root
uuid: "a0da72817da647b58428e2c39868f6ba"
format_stamp: "Formatted at 2026-07-09 13:00:04 on dist-test-slave-73vh"
I20260709 13:00:04.496512   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:04.511600   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:04.513024   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:04.553752   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43053
I20260709 13:00:04.553850  7612 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43053 every 8 connection(s)
I20260709 13:00:04.557973  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:04.569078  7613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba: Bootstrap starting.
I20260709 13:00:04.573982  7613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:04.578303  7613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba: No bootstrap required, opened a new log
I20260709 13:00:04.580494  7613 raft_consensus.cc:359] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da72817da647b58428e2c39868f6ba" member_type: VOTER }
I20260709 13:00:04.580996  7613 raft_consensus.cc:385] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:04.581182  7613 raft_consensus.cc:740] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0da72817da647b58428e2c39868f6ba, State: Initialized, Role: FOLLOWER
I20260709 13:00:04.581688  7613 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da72817da647b58428e2c39868f6ba" member_type: VOTER }
I20260709 13:00:04.582134  7613 raft_consensus.cc:399] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:04.582327  7613 raft_consensus.cc:493] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:04.582536  7613 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:04.587097  7613 raft_consensus.cc:515] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da72817da647b58428e2c39868f6ba" member_type: VOTER }
I20260709 13:00:04.587543  7613 leader_election.cc:304] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0da72817da647b58428e2c39868f6ba; no voters: 
I20260709 13:00:04.588728  7613 leader_election.cc:290] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:04.589219  7616 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:04.590626  7616 raft_consensus.cc:697] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 1 LEADER]: Becoming Leader. State: Replica: a0da72817da647b58428e2c39868f6ba, State: Running, Role: LEADER
I20260709 13:00:04.591367  7616 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da72817da647b58428e2c39868f6ba" member_type: VOTER }
I20260709 13:00:04.591759  7613 sys_catalog.cc:565] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:04.598119  7618 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0da72817da647b58428e2c39868f6ba. Latest consensus state: current_term: 1 leader_uuid: "a0da72817da647b58428e2c39868f6ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da72817da647b58428e2c39868f6ba" member_type: VOTER } }
I20260709 13:00:04.598735  7618 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:04.601197  7617 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0da72817da647b58428e2c39868f6ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da72817da647b58428e2c39868f6ba" member_type: VOTER } }
I20260709 13:00:04.601856  7617 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:04.604357  7625 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:04.609570  7625 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:04.610613   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:04.618600  7625 catalog_manager.cc:1383] Generated new cluster ID: e5053944797e48968c158e0620c8ee16
I20260709 13:00:04.618893  7625 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:04.642094  7625 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:04.643461  7625 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:04.655156  7625 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba: Generated new TSK 0
I20260709 13:00:04.655758  7625 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:04.678303   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:04.685004  7634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:04.686226  7635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:04.687951  7637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:04.688982   431 server_base.cc:1061] running on GCE node
I20260709 13:00:04.691021   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:04.691246   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:04.691413   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602004691391 us; error 0 us; skew 500 ppm
I20260709 13:00:04.691987   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:04.694342   431 webserver.cc:533] Webserver started at http://127.0.107.193:37139/ using document root <none> and password file <none>
I20260709 13:00:04.694815   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:04.695030   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:04.695288   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:04.696568   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-0-root/instance:
uuid: "f91d8d830a474ea7a101fc5b6f920544"
format_stamp: "Formatted at 2026-07-09 13:00:04 on dist-test-slave-73vh"
I20260709 13:00:04.701316   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:04.704847  7642 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:04.705734   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:04.706089   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "f91d8d830a474ea7a101fc5b6f920544"
format_stamp: "Formatted at 2026-07-09 13:00:04 on dist-test-slave-73vh"
I20260709 13:00:04.706358   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:04.724633   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:04.726679   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:04.728340   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:04.730837   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:04.731071   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:04.731330   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:04.731520   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:04.775079   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43363
I20260709 13:00:04.775203  7704 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43363 every 8 connection(s)
I20260709 13:00:04.780522   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:04.789170  7709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:04.790827  7710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:04.792944  7712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:04.794145   431 server_base.cc:1061] running on GCE node
I20260709 13:00:04.796280   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:04.796583   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:04.796841   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602004796810 us; error 0 us; skew 500 ppm
I20260709 13:00:04.797468   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:04.800048  7705 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43053
I20260709 13:00:04.800437  7705 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:04.800628   431 webserver.cc:533] Webserver started at http://127.0.107.194:35989/ using document root <none> and password file <none>
I20260709 13:00:04.801198   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:04.801403   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:04.801368  7705 heartbeater.cc:507] Master 127.0.107.254:43053 requested a full tablet report, sending...
I20260709 13:00:04.801882   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:04.803359   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-1-root/instance:
uuid: "99e4e009f2884c8d9f7239b5375ab730"
format_stamp: "Formatted at 2026-07-09 13:00:04 on dist-test-slave-73vh"
I20260709 13:00:04.804102  7578 ts_manager.cc:194] Registered new tserver with Master: f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:04.806754  7578 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60420
I20260709 13:00:04.809649   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:00:04.813200  7717 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:04.813959   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:04.814247   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-1-root
uuid: "99e4e009f2884c8d9f7239b5375ab730"
format_stamp: "Formatted at 2026-07-09 13:00:04 on dist-test-slave-73vh"
I20260709 13:00:04.814560   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:04.845043   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:04.846318   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:04.847780   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:04.849964   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:04.850193   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:04.850436   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:04.850610   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:04.894253   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:35833
I20260709 13:00:04.894372  7779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:35833 every 8 connection(s)
I20260709 13:00:04.899509   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:04.907773  7783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:04.908921  7784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:04.912302  7787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:04.912802   431 server_base.cc:1061] running on GCE node
I20260709 13:00:04.913627  7780 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43053
I20260709 13:00:04.913889   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:04.914011  7780 heartbeater.cc:461] Registering TS with master...
W20260709 13:00:04.914186   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:04.914474   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602004914456 us; error 0 us; skew 500 ppm
I20260709 13:00:04.914933  7780 heartbeater.cc:507] Master 127.0.107.254:43053 requested a full tablet report, sending...
I20260709 13:00:04.915064   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:04.917270  7578 ts_manager.cc:194] Registered new tserver with Master: 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:04.918673  7578 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60432
I20260709 13:00:04.919791   431 webserver.cc:533] Webserver started at http://127.0.107.195:35959/ using document root <none> and password file <none>
I20260709 13:00:04.920348   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:04.920547   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:04.920846   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:04.922029   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-2-root/instance:
uuid: "cbfd6094b47e463383f6b206c98e52ff"
format_stamp: "Formatted at 2026-07-09 13:00:04 on dist-test-slave-73vh"
I20260709 13:00:04.926355   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:04.929679  7791 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:04.930437   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:04.930725   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-2-root
uuid: "cbfd6094b47e463383f6b206c98e52ff"
format_stamp: "Formatted at 2026-07-09 13:00:04 on dist-test-slave-73vh"
I20260709 13:00:04.931001   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:04.952310   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:04.953620   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:04.955142   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:04.957486   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:04.957717   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:04.957954   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:04.958130   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:05.001720   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38101
I20260709 13:00:05.001883  7853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38101 every 8 connection(s)
I20260709 13:00:05.006806   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:05.014599  7857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:05.015277  7858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:05.019794  7860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:05.020692   431 server_base.cc:1061] running on GCE node
I20260709 13:00:05.021843   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:05.022370   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:05.022516  7854 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43053
I20260709 13:00:05.022681   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602005022662 us; error 0 us; skew 500 ppm
I20260709 13:00:05.023154  7854 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:05.023586   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:05.024149  7854 heartbeater.cc:507] Master 127.0.107.254:43053 requested a full tablet report, sending...
I20260709 13:00:05.026470  7578 ts_manager.cc:194] Registered new tserver with Master: cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:05.026765   431 webserver.cc:533] Webserver started at http://127.0.107.196:43447/ using document root <none> and password file <none>
I20260709 13:00:05.027343   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:05.027568   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:05.027846   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:05.028126  7578 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60436
I20260709 13:00:05.029290   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-3-root/instance:
uuid: "98b07c9e416d4e32a62431b41b1fefa7"
format_stamp: "Formatted at 2026-07-09 13:00:05 on dist-test-slave-73vh"
I20260709 13:00:05.033967   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:05.037452  7865 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:05.038138   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:00:05.038455   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-3-root
uuid: "98b07c9e416d4e32a62431b41b1fefa7"
format_stamp: "Formatted at 2026-07-09 13:00:05 on dist-test-slave-73vh"
I20260709 13:00:05.038757   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:05.069285   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:05.070641   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:05.072222   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:05.074556   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:05.074806   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:05.075069   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:05.075254   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:05.125164   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:38843
I20260709 13:00:05.125262  7927 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:38843 every 8 connection(s)
I20260709 13:00:05.139202  7928 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43053
I20260709 13:00:05.139608  7928 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:05.140519  7928 heartbeater.cc:507] Master 127.0.107.254:43053 requested a full tablet report, sending...
I20260709 13:00:05.142547  7578 ts_manager.cc:194] Registered new tserver with Master: 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:05.143414   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015016152s
I20260709 13:00:05.144126  7578 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60438
I20260709 13:00:05.171017  7578 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60452:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:00:05.453547  7893 tablet_service.cc:1511] Processing CreateTablet for tablet f4c0ccc08b9c4764be5e221aa04d31ef (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:05.454409  7892 tablet_service.cc:1511] Processing CreateTablet for tablet 4a24936f9a894fadb0be3deef42997e1 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:05.455080  7893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c0ccc08b9c4764be5e221aa04d31ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.456017  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a24936f9a894fadb0be3deef42997e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.458035  7891 tablet_service.cc:1511] Processing CreateTablet for tablet aafc690b8cda48dbaa3b21cfe522712b (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:05.459439  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafc690b8cda48dbaa3b21cfe522712b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.465214  7889 tablet_service.cc:1511] Processing CreateTablet for tablet 73e52f0728d04896bff6d3356508b794 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:05.465812  7890 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa4c60ae43f4aa6b7c0fcc69c763999 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:05.466675  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e52f0728d04896bff6d3356508b794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.467886  7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa4c60ae43f4aa6b7c0fcc69c763999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.475499  7670 tablet_service.cc:1511] Processing CreateTablet for tablet f4c0ccc08b9c4764be5e221aa04d31ef (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:05.477035  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c0ccc08b9c4764be5e221aa04d31ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.482007  7669 tablet_service.cc:1511] Processing CreateTablet for tablet ce0d5877ad7a44398c02291a8cbf65d7 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:05.483480  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0d5877ad7a44398c02291a8cbf65d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.485939  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 4a24936f9a894fadb0be3deef42997e1 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:05.487344  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a24936f9a894fadb0be3deef42997e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.490010  7667 tablet_service.cc:1511] Processing CreateTablet for tablet 804a5720142a4f2685b079160048e38f (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:05.490164  7745 tablet_service.cc:1511] Processing CreateTablet for tablet ce0d5877ad7a44398c02291a8cbf65d7 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:05.491619  7745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0d5877ad7a44398c02291a8cbf65d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.491616  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804a5720142a4f2685b079160048e38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.493091  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa4c60ae43f4aa6b7c0fcc69c763999 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:05.494526  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa4c60ae43f4aa6b7c0fcc69c763999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.498149  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 73e52f0728d04896bff6d3356508b794 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:05.499631  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e52f0728d04896bff6d3356508b794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.504623  7819 tablet_service.cc:1511] Processing CreateTablet for tablet f4c0ccc08b9c4764be5e221aa04d31ef (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:05.506107  7819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c0ccc08b9c4764be5e221aa04d31ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.506685  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 804a5720142a4f2685b079160048e38f (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:05.508133  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804a5720142a4f2685b079160048e38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.509895  7818 tablet_service.cc:1511] Processing CreateTablet for tablet ce0d5877ad7a44398c02291a8cbf65d7 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:05.512145  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0d5877ad7a44398c02291a8cbf65d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.513814  7814 tablet_service.cc:1511] Processing CreateTablet for tablet c5baec15a5574f308ac368ed350280d5 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:05.515215  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5baec15a5574f308ac368ed350280d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.509897  7815 tablet_service.cc:1511] Processing CreateTablet for tablet 73e52f0728d04896bff6d3356508b794 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:05.522940  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e52f0728d04896bff6d3356508b794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.512423  7817 tablet_service.cc:1511] Processing CreateTablet for tablet aafc690b8cda48dbaa3b21cfe522712b (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:05.530366  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafc690b8cda48dbaa3b21cfe522712b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.530697  7892 tablet_service.cc:1511] Processing CreateTablet for tablet c5baec15a5574f308ac368ed350280d5 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:05.532032  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5baec15a5574f308ac368ed350280d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.563230  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 4a24936f9a894fadb0be3deef42997e1 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:05.565891  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a24936f9a894fadb0be3deef42997e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.565919  7742 tablet_service.cc:1511] Processing CreateTablet for tablet 804a5720142a4f2685b079160048e38f (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:05.565919  7743 tablet_service.cc:1511] Processing CreateTablet for tablet aafc690b8cda48dbaa3b21cfe522712b (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:05.572199  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804a5720142a4f2685b079160048e38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.575552  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafc690b8cda48dbaa3b21cfe522712b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.575785  7741 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa4c60ae43f4aa6b7c0fcc69c763999 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:05.576297  7740 tablet_service.cc:1511] Processing CreateTablet for tablet c5baec15a5574f308ac368ed350280d5 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:05.577327  7741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa4c60ae43f4aa6b7c0fcc69c763999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.577957  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5baec15a5574f308ac368ed350280d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.591619  7664 tablet_service.cc:1511] Processing CreateTablet for tablet 595e433cb28c45c1891f471d7d5e3493 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:05.593613  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595e433cb28c45c1891f471d7d5e3493. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:05.605159  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:05.605552  7739 tablet_service.cc:1511] Processing CreateTablet for tablet 595e433cb28c45c1891f471d7d5e3493 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:05.607503  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595e433cb28c45c1891f471d7d5e3493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.613533  7949 tablet_bootstrap.cc:492] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:05.622987  7948 tablet_bootstrap.cc:492] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:05.645525  7950 tablet_bootstrap.cc:492] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:05.647022  7948 tablet_bootstrap.cc:654] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:05.652370  7950 tablet_bootstrap.cc:654] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:05.659695  7949 tablet_bootstrap.cc:654] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:05.666836  7892 tablet_service.cc:1511] Processing CreateTablet for tablet 92c33f71c6ae44e09fc992b5197545c5 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:05.669112  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c33f71c6ae44e09fc992b5197545c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.669164  7818 tablet_service.cc:1511] Processing CreateTablet for tablet 595e433cb28c45c1891f471d7d5e3493 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:05.670720  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595e433cb28c45c1891f471d7d5e3493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.671181  7742 tablet_service.cc:1511] Processing CreateTablet for tablet 92c33f71c6ae44e09fc992b5197545c5 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:05.672557  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c33f71c6ae44e09fc992b5197545c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.674373  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 92c33f71c6ae44e09fc992b5197545c5 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:05.678120  7817 tablet_service.cc:1511] Processing CreateTablet for tablet 090001da1c8d4285a0a8beaeaf3e76c6 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:05.679443  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090001da1c8d4285a0a8beaeaf3e76c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.689116  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c33f71c6ae44e09fc992b5197545c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.699391  7952 tablet_bootstrap.cc:492] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:05.702739  7889 tablet_service.cc:1511] Processing CreateTablet for tablet 090001da1c8d4285a0a8beaeaf3e76c6 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:05.704427  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090001da1c8d4285a0a8beaeaf3e76c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.709792  7667 tablet_service.cc:1511] Processing CreateTablet for tablet 090001da1c8d4285a0a8beaeaf3e76c6 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:05.711488  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090001da1c8d4285a0a8beaeaf3e76c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.713950  7952 tablet_bootstrap.cc:654] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:05.726336  7948 tablet_bootstrap.cc:492] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:05.727069  7948 ts_tablet_manager.cc:1403] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.110s	user 0.017s	sys 0.004s
I20260709 13:00:05.731043  7948 raft_consensus.cc:359] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:05.740947  7743 tablet_service.cc:1511] Processing CreateTablet for tablet 0915d2c188d14ddabd92c69242f68829 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:05.742666  7818 tablet_service.cc:1511] Processing CreateTablet for tablet 0915d2c188d14ddabd92c69242f68829 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:05.743804  7948 raft_consensus.cc:385] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:05.745301  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0915d2c188d14ddabd92c69242f68829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.746112  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0915d2c188d14ddabd92c69242f68829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.747066  7948 raft_consensus.cc:740] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:05.748129  7948 consensus_queue.cc:260] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:05.753127  7892 tablet_service.cc:1511] Processing CreateTablet for tablet 0915d2c188d14ddabd92c69242f68829 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:05.754714  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 98f368c04a174168bd99e224010f9d92 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:05.755748  7950 tablet_bootstrap.cc:492] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:05.756055  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f368c04a174168bd99e224010f9d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.756285  7950 ts_tablet_manager.cc:1403] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.015s
I20260709 13:00:05.756861  7952 tablet_bootstrap.cc:492] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:05.757433  7952 ts_tablet_manager.cc:1403] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.006s
I20260709 13:00:05.759536  7950 raft_consensus.cc:359] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:05.760315  7950 raft_consensus.cc:385] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:05.760622  7950 raft_consensus.cc:740] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:05.764532  7742 tablet_service.cc:1511] Processing CreateTablet for tablet 98f368c04a174168bd99e224010f9d92 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:05.770968  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f368c04a174168bd99e224010f9d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.756073  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0915d2c188d14ddabd92c69242f68829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.774777  7815 tablet_service.cc:1511] Processing CreateTablet for tablet 98f368c04a174168bd99e224010f9d92 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:05.776127  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f368c04a174168bd99e224010f9d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.766665  7949 tablet_bootstrap.cc:492] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:05.777297  7949 ts_tablet_manager.cc:1403] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.164s	user 0.016s	sys 0.024s
I20260709 13:00:05.777119  7891 tablet_service.cc:1511] Processing CreateTablet for tablet 9708521c863f4f02b5ea46f35013e91c (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:05.778409  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9708521c863f4f02b5ea46f35013e91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.780946  7949 raft_consensus.cc:359] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:05.781854  7949 raft_consensus.cc:385] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:05.782496  7949 raft_consensus.cc:740] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:05.783476  7949 consensus_queue.cc:260] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:05.760928  7952 raft_consensus.cc:359] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:05.769455  7950 consensus_queue.cc:260] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:05.791426  7952 raft_consensus.cc:385] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:05.793108  7928 heartbeater.cc:499] Master 127.0.107.254:43053 was elected leader, sending a full tablet report...
I20260709 13:00:05.791852  7952 raft_consensus.cc:740] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:05.795100  7952 consensus_queue.cc:260] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:05.799506  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 9708521c863f4f02b5ea46f35013e91c (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:05.801254  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9708521c863f4f02b5ea46f35013e91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.803388  7819 tablet_service.cc:1511] Processing CreateTablet for tablet feda7e24f274421e9a91a2b5331aba65 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:05.805578  7819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feda7e24f274421e9a91a2b5331aba65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.807049  7948 ts_tablet_manager.cc:1434] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.080s	user 0.013s	sys 0.005s
I20260709 13:00:05.808218  7948 tablet_bootstrap.cc:492] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:05.810225  7705 heartbeater.cc:499] Master 127.0.107.254:43053 was elected leader, sending a full tablet report...
I20260709 13:00:05.813874  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 9708521c863f4f02b5ea46f35013e91c (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:05.815557  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9708521c863f4f02b5ea46f35013e91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.820775  7889 tablet_service.cc:1511] Processing CreateTablet for tablet feda7e24f274421e9a91a2b5331aba65 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:05.822320  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feda7e24f274421e9a91a2b5331aba65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.832552  7949 ts_tablet_manager.cc:1434] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.055s	user 0.000s	sys 0.015s
I20260709 13:00:05.832877  7854 heartbeater.cc:499] Master 127.0.107.254:43053 was elected leader, sending a full tablet report...
I20260709 13:00:05.834193  7667 tablet_service.cc:1511] Processing CreateTablet for tablet feda7e24f274421e9a91a2b5331aba65 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:05.846517  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feda7e24f274421e9a91a2b5331aba65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.838673  7948 tablet_bootstrap.cc:654] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:05.839219  7741 tablet_service.cc:1511] Processing CreateTablet for tablet b26cd919cc164a29a97c54622f534945 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:05.848881  7741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b26cd919cc164a29a97c54622f534945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.850286  7949 tablet_bootstrap.cc:492] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:05.860778  7952 ts_tablet_manager.cc:1434] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.103s	user 0.010s	sys 0.007s
I20260709 13:00:05.862092  7950 ts_tablet_manager.cc:1434] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.105s	user 0.010s	sys 0.009s
I20260709 13:00:05.862921  7780 heartbeater.cc:499] Master 127.0.107.254:43053 was elected leader, sending a full tablet report...
I20260709 13:00:05.869303  7952 tablet_bootstrap.cc:492] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:05.870528  7956 raft_consensus.cc:493] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.871044  7956 raft_consensus.cc:515] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:05.873718  7818 tablet_service.cc:1511] Processing CreateTablet for tablet b26cd919cc164a29a97c54622f534945 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:05.875178  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b26cd919cc164a29a97c54622f534945. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:05.879613  7929 tablet.cc:2406] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:05.879796  7952 tablet_bootstrap.cc:654] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:05.883668  7956 leader_election.cc:290] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:05.897720  7949 tablet_bootstrap.cc:654] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:05.898213  7891 tablet_service.cc:1511] Processing CreateTablet for tablet b26cd919cc164a29a97c54622f534945 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:05.900914  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b26cd919cc164a29a97c54622f534945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.907492  7950 tablet_bootstrap.cc:492] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:05.912138  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 97f866326dd042c1811e3d405f50634b (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:05.913692  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f866326dd042c1811e3d405f50634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.927060  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 97f866326dd042c1811e3d405f50634b (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:05.928563  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f866326dd042c1811e3d405f50634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.929795  7948 tablet_bootstrap.cc:492] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:05.930377  7948 ts_tablet_manager.cc:1403] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.122s	user 0.008s	sys 0.008s
I20260709 13:00:05.937722  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:05.939610  7948 raft_consensus.cc:359] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
W20260709 13:00:05.946944  7866 leader_election.cc:343] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:05.940357  7948 raft_consensus.cc:385] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:05.952389  7948 raft_consensus.cc:740] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:05.957865  7948 consensus_queue.cc:260] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:05.958081  7819 tablet_service.cc:1511] Processing CreateTablet for tablet 97f866326dd042c1811e3d405f50634b (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:05.959444  7819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f866326dd042c1811e3d405f50634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.960073  7948 ts_tablet_manager.cc:1434] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:00:05.967607  7892 tablet_service.cc:1511] Processing CreateTablet for tablet 541510a88d1f44cdb6156324aa747e96 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:05.968902  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541510a88d1f44cdb6156324aa747e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.970783  7667 tablet_service.cc:1511] Processing CreateTablet for tablet 541510a88d1f44cdb6156324aa747e96 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:05.972116  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541510a88d1f44cdb6156324aa747e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.975096  7743 tablet_service.cc:1511] Processing CreateTablet for tablet 541510a88d1f44cdb6156324aa747e96 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:05.976513  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541510a88d1f44cdb6156324aa747e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.988006  7815 tablet_service.cc:1511] Processing CreateTablet for tablet 76db30f9818e4e4cb3825f84ad8e9223 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:05.991212  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:05.992888  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76db30f9818e4e4cb3825f84ad8e9223. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:05.992825  7867 leader_election.cc:343] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:05.993115  7949 tablet_bootstrap.cc:492] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:05.993402  7867 leader_election.cc:304] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:05.993834  7949 ts_tablet_manager.cc:1403] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.027s
I20260709 13:00:05.994238  7956 raft_consensus.cc:2749] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:05.993848  7664 tablet_service.cc:1511] Processing CreateTablet for tablet 76db30f9818e4e4cb3825f84ad8e9223 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:05.995723  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76db30f9818e4e4cb3825f84ad8e9223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:05.997190  7949 raft_consensus.cc:359] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:05.997968  7952 tablet_bootstrap.cc:492] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:05.998001  7949 raft_consensus.cc:385] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:05.998751  7952 ts_tablet_manager.cc:1403] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.009s
I20260709 13:00:05.998582  7949 raft_consensus.cc:740] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:05.999351  7891 tablet_service.cc:1511] Processing CreateTablet for tablet 76db30f9818e4e4cb3825f84ad8e9223 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:06.000027  7949 consensus_queue.cc:260] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.000811  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76db30f9818e4e4cb3825f84ad8e9223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.006335  7950 tablet_bootstrap.cc:654] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:05.990824  7948 tablet_bootstrap.cc:492] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:06.012259  7817 tablet_service.cc:1511] Processing CreateTablet for tablet 74faeec2e32f4c079635c385977c8ebf (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:06.013773  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74faeec2e32f4c079635c385977c8ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.016384  7949 ts_tablet_manager.cc:1434] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:00:06.012334  7741 tablet_service.cc:1511] Processing CreateTablet for tablet 74faeec2e32f4c079635c385977c8ebf (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:06.018226  7741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74faeec2e32f4c079635c385977c8ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.019582  7949 tablet_bootstrap.cc:492] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:06.023689  7948 tablet_bootstrap.cc:654] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.027056  7949 tablet_bootstrap.cc:654] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.033493  7889 tablet_service.cc:1511] Processing CreateTablet for tablet 74faeec2e32f4c079635c385977c8ebf (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:06.034933  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74faeec2e32f4c079635c385977c8ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.002502  7952 raft_consensus.cc:359] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.040553  7666 tablet_service.cc:1511] Processing CreateTablet for tablet cfcc74c073a446fdb54d5af775d46abc (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:06.041067  7952 raft_consensus.cc:385] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.041131  7742 tablet_service.cc:1511] Processing CreateTablet for tablet cfcc74c073a446fdb54d5af775d46abc (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:06.041647  7952 raft_consensus.cc:740] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.041968  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfcc74c073a446fdb54d5af775d46abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.043450  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfcc74c073a446fdb54d5af775d46abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.047801  7814 tablet_service.cc:1511] Processing CreateTablet for tablet cfcc74c073a446fdb54d5af775d46abc (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:06.050806  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfcc74c073a446fdb54d5af775d46abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.054322  7950 tablet_bootstrap.cc:492] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:06.054962  7950 ts_tablet_manager.cc:1403] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.001s
I20260709 13:00:06.058125  7950 raft_consensus.cc:359] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.044075  7952 consensus_queue.cc:260] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.066895  7893 tablet_service.cc:1511] Processing CreateTablet for tablet 8acef6aca57b4db8a13916f345d24f12 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:06.089586  7893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acef6aca57b4db8a13916f345d24f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.090415  7952 ts_tablet_manager.cc:1434] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.001s
I20260709 13:00:06.091519  7952 tablet_bootstrap.cc:492] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:06.069923  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 8acef6aca57b4db8a13916f345d24f12 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:06.070489  7745 tablet_service.cc:1511] Processing CreateTablet for tablet 8acef6aca57b4db8a13916f345d24f12 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:06.074616  7816 tablet_service.cc:1511] Processing CreateTablet for tablet c00647e852184fb281c21a8e4739e9e4 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:06.095510  7745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acef6aca57b4db8a13916f345d24f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.096006  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00647e852184fb281c21a8e4739e9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.076778  7890 tablet_service.cc:1511] Processing CreateTablet for tablet c00647e852184fb281c21a8e4739e9e4 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:06.101107  7957 raft_consensus.cc:493] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.101462  7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00647e852184fb281c21a8e4739e9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.101631  7957 raft_consensus.cc:515] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.094125  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acef6aca57b4db8a13916f345d24f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.108577  7957 leader_election.cc:290] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:06.092828  7950 raft_consensus.cc:385] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.119935  7958 raft_consensus.cc:493] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.120553  7958 raft_consensus.cc:515] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.133113  7958 leader_election.cc:290] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:06.114771  7950 raft_consensus.cc:740] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.133669  7949 tablet_bootstrap.cc:492] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:06.134231  7949 ts_tablet_manager.cc:1403] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.115s	user 0.048s	sys 0.028s
I20260709 13:00:06.134285  7950 consensus_queue.cc:260] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.143092  7668 tablet_service.cc:1511] Processing CreateTablet for tablet c00647e852184fb281c21a8e4739e9e4 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:06.144434  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00647e852184fb281c21a8e4739e9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.138403  7950 ts_tablet_manager.cc:1434] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.000s
I20260709 13:00:06.155184  7739 tablet_service.cc:1511] Processing CreateTablet for tablet ccf003a44a8d49479fbe48301e5681b5 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:06.157020  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf003a44a8d49479fbe48301e5681b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.166260  7818 tablet_service.cc:1511] Processing CreateTablet for tablet ccf003a44a8d49479fbe48301e5681b5 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:06.167629  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf003a44a8d49479fbe48301e5681b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.167685  7950 tablet_bootstrap.cc:492] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:06.170617  7891 tablet_service.cc:1511] Processing CreateTablet for tablet ccf003a44a8d49479fbe48301e5681b5 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:06.171480  7670 tablet_service.cc:1511] Processing CreateTablet for tablet 434f38d50a1543e8b5e019baf56d4876 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:06.172077  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf003a44a8d49479fbe48301e5681b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.175366  7952 tablet_bootstrap.cc:654] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.179512  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 434f38d50a1543e8b5e019baf56d4876 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:06.181380  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 434f38d50a1543e8b5e019baf56d4876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.184310  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 434f38d50a1543e8b5e019baf56d4876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.204679  7817 tablet_service.cc:1511] Processing CreateTablet for tablet 434f38d50a1543e8b5e019baf56d4876 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:06.206086  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 434f38d50a1543e8b5e019baf56d4876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.212896  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
W20260709 13:00:06.214475  7793 leader_election.cc:343] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.223423  7948 tablet_bootstrap.cc:492] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:06.224112  7948 ts_tablet_manager.cc:1403] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.241s	user 0.016s	sys 0.027s
I20260709 13:00:06.227893  7949 raft_consensus.cc:359] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.228832  7949 raft_consensus.cc:385] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.229190  7949 raft_consensus.cc:740] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.233253  7949 consensus_queue.cc:260] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.241555  7949 ts_tablet_manager.cc:1434] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.002s
I20260709 13:00:06.228466  7950 tablet_bootstrap.cc:654] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.242913  7742 tablet_service.cc:1511] Processing CreateTablet for tablet ea3aa569bb2f4c58bc92f779a43caad0 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:06.231107  7889 tablet_service.cc:1511] Processing CreateTablet for tablet ea3aa569bb2f4c58bc92f779a43caad0 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:06.250988  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea3aa569bb2f4c58bc92f779a43caad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.253417  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:06.255240  7643 leader_election.cc:343] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.260128  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea3aa569bb2f4c58bc92f779a43caad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.261152  7958 raft_consensus.cc:493] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.261583  7666 tablet_service.cc:1511] Processing CreateTablet for tablet ea3aa569bb2f4c58bc92f779a43caad0 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:06.261710  7958 raft_consensus.cc:515] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.262954  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea3aa569bb2f4c58bc92f779a43caad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.264278  7958 leader_election.cc:290] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:06.267849  7956 raft_consensus.cc:493] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.268338  7948 raft_consensus.cc:359] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.269315  7948 raft_consensus.cc:385] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.269635  7948 raft_consensus.cc:740] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.268405  7956 raft_consensus.cc:515] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:06.271476  7814 tablet_service.cc:1511] Processing CreateTablet for tablet 9fade69c67ff4012b5e46a32966edb24 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:06.272850  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fade69c67ff4012b5e46a32966edb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.273427  7956 leader_election.cc:290] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:06.282276  7959 raft_consensus.cc:493] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.282770  7959 raft_consensus.cc:515] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.279130  7957 raft_consensus.cc:493] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.287307  7957 raft_consensus.cc:515] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:06.287664  7959 leader_election.cc:290] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:06.277992  7949 tablet_bootstrap.cc:492] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:06.294055  7957 leader_election.cc:290] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:06.301673  7952 tablet_bootstrap.cc:492] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:06.270426  7948 consensus_queue.cc:260] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.311421  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa4c60ae43f4aa6b7c0fcc69c763999" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:06.312286  7680 raft_consensus.cc:2468] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:06.326452  7948 ts_tablet_manager.cc:1434] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.102s	user 0.000s	sys 0.007s
I20260709 13:00:06.327544  7948 tablet_bootstrap.cc:492] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:06.330521  7867 leader_election.cc:304] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:06.330780  7890 tablet_service.cc:1511] Processing CreateTablet for tablet 9fade69c67ff4012b5e46a32966edb24 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:06.332091  7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fade69c67ff4012b5e46a32966edb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.332288  7952 ts_tablet_manager.cc:1403] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.241s	user 0.009s	sys 0.010s
I20260709 13:00:06.332227  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:06.333185  7670 tablet_service.cc:1511] Processing CreateTablet for tablet 9fade69c67ff4012b5e46a32966edb24 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 13:00:06.334106  7794 leader_election.cc:343] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.334654  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fade69c67ff4012b5e46a32966edb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.335886  7952 raft_consensus.cc:359] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.336817  7956 raft_consensus.cc:2804] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:06.337250  7956 raft_consensus.cc:493] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.337600  7956 raft_consensus.cc:3060] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.339200  7818 tablet_service.cc:1511] Processing CreateTablet for tablet 445db6ed81c14979a6b26e0045cf7c13 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:06.340574  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445db6ed81c14979a6b26e0045cf7c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.341739  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 445db6ed81c14979a6b26e0045cf7c13 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:06.344118  7891 tablet_service.cc:1511] Processing CreateTablet for tablet 445db6ed81c14979a6b26e0045cf7c13 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:06.345099  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa4c60ae43f4aa6b7c0fcc69c763999" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:06.345484  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445db6ed81c14979a6b26e0045cf7c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.345548  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445db6ed81c14979a6b26e0045cf7c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.347177  7667 tablet_service.cc:1511] Processing CreateTablet for tablet b50b91b1378a4f62a5d2fe31fb381a7d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 13:00:06.350114  7869 leader_election.cc:343] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.352555  7950 tablet_bootstrap.cc:492] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:06.353098  7950 ts_tablet_manager.cc:1403] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.186s	user 0.016s	sys 0.002s
I20260709 13:00:06.357084  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50b91b1378a4f62a5d2fe31fb381a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.348708  7952 raft_consensus.cc:385] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.365531  7952 raft_consensus.cc:740] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.366464  7952 consensus_queue.cc:260] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.356382  7950 raft_consensus.cc:359] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.381013  7950 raft_consensus.cc:385] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.381407  7950 raft_consensus.cc:740] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.382164  7950 consensus_queue.cc:260] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.383948  7950 ts_tablet_manager.cc:1434] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.001s
I20260709 13:00:06.386559  7949 tablet_bootstrap.cc:654] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.391673  7948 tablet_bootstrap.cc:654] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.389669  7952 ts_tablet_manager.cc:1434] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:00:06.396016  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa4c60ae43f4aa6b7c0fcc69c763999" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:06.400283  7950 tablet_bootstrap.cc:492] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:06.395112  7956 raft_consensus.cc:515] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:06.401338  7952 tablet_bootstrap.cc:492] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:06.401718  7903 raft_consensus.cc:2393] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f91d8d830a474ea7a101fc5b6f920544 in current term 1: Already voted for candidate 98b07c9e416d4e32a62431b41b1fefa7 in this term.
I20260709 13:00:06.406957  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa4c60ae43f4aa6b7c0fcc69c763999" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:06.407450  7956 leader_election.cc:290] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:06.407557  7817 tablet_service.cc:1511] Processing CreateTablet for tablet b50b91b1378a4f62a5d2fe31fb381a7d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:06.409934  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa4c60ae43f4aa6b7c0fcc69c763999" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:06.410245  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50b91b1378a4f62a5d2fe31fb381a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.411010  7959 raft_consensus.cc:493] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.411507  7959 raft_consensus.cc:515] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.407586  7680 raft_consensus.cc:3060] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:06.415045  7869 leader_election.cc:343] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.417943  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:06.418640  7755 raft_consensus.cc:2468] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:06.418759  7959 leader_election.cc:290] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:06.419277  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:06.419935  7752 raft_consensus.cc:2468] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:06.421195  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:06.418172  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa4c60ae43f4aa6b7c0fcc69c763999" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:06.422260  7646 leader_election.cc:304] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:06.426671  7795 leader_election.cc:304] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7
I20260709 13:00:06.427276  7957 raft_consensus.cc:2804] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:06.427788  7958 raft_consensus.cc:2804] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:06.428210  7958 raft_consensus.cc:493] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.428515  7958 raft_consensus.cc:3060] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:06.431149  7795 leader_election.cc:343] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.431770  7795 leader_election.cc:304] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:06.427731  7957 raft_consensus.cc:493] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:06.432730  7646 leader_election.cc:343] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.432947  7957 raft_consensus.cc:3060] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.433245  7646 leader_election.cc:304] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:06.438964  7742 tablet_service.cc:1511] Processing CreateTablet for tablet b50b91b1378a4f62a5d2fe31fb381a7d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:06.440794  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50b91b1378a4f62a5d2fe31fb381a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.450212  7889 tablet_service.cc:1511] Processing CreateTablet for tablet 095f1c671ae348299e6195bec053dc9b (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:06.451948  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095f1c671ae348299e6195bec053dc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.454875  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 095f1c671ae348299e6195bec053dc9b (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:06.456243  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095f1c671ae348299e6195bec053dc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.457365  7818 tablet_service.cc:1511] Processing CreateTablet for tablet d33aed1bca5e4615a453a14181ce357d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:06.458714  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33aed1bca5e4615a453a14181ce357d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.459707  7680 raft_consensus.cc:2468] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:06.493592  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 1955a60137904c4f90cee6f71b4fbcf2 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:06.488350  7817 tablet_service.cc:1511] Processing CreateTablet for tablet 7f64552f3c8f4af381c7ea6596d7f3ff (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:06.464066  7890 tablet_service.cc:1511] Processing CreateTablet for tablet d33aed1bca5e4615a453a14181ce357d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:06.495182  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1955a60137904c4f90cee6f71b4fbcf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.495574  7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33aed1bca5e4615a453a14181ce357d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.495260  7983 raft_consensus.cc:2749] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:06.466610  7670 tablet_service.cc:1511] Processing CreateTablet for tablet d33aed1bca5e4615a453a14181ce357d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:06.497820  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33aed1bca5e4615a453a14181ce357d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.470278  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:06.471414  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:06.478253  7957 raft_consensus.cc:515] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.494288  7867 leader_election.cc:304] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:06.462975  7950 tablet_bootstrap.cc:654] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.452420  7958 raft_consensus.cc:515] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.519266  7745 tablet_service.cc:1511] Processing CreateTablet for tablet 7f64552f3c8f4af381c7ea6596d7f3ff (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:06.520442  7745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f64552f3c8f4af381c7ea6596d7f3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.514286  7956 raft_consensus.cc:493] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.521309  7956 raft_consensus.cc:515] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.524158  7956 leader_election.cc:290] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:06.524875  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:06.525381  7739 tablet_service.cc:1511] Processing CreateTablet for tablet 1955a60137904c4f90cee6f71b4fbcf2 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:00:06.529623  7869 leader_election.cc:343] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.535393  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 095f1c671ae348299e6195bec053dc9b (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:06.533205  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1955a60137904c4f90cee6f71b4fbcf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.538250  7828 raft_consensus.cc:2393] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99e4e009f2884c8d9f7239b5375ab730 in current term 1: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:06.530526  7956 raft_consensus.cc:2804] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:06.541275  7956 raft_consensus.cc:697] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
W20260709 13:00:06.542577  7718 leader_election.cc:343] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.542325  7956 consensus_queue.cc:237] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:06.543303  7889 tablet_service.cc:1511] Processing CreateTablet for tablet 7f64552f3c8f4af381c7ea6596d7f3ff (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:06.544142  7814 tablet_service.cc:1511] Processing CreateTablet for tablet 1955a60137904c4f90cee6f71b4fbcf2 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:06.558296  7958 leader_election.cc:290] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:06.558990  7958 raft_consensus.cc:2749] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:06.559577  7958 raft_consensus.cc:493] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:06.554734  7795 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35833, user_credentials={real_user=slave}} blocked reactor thread for 123626us
I20260709 13:00:06.560850  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095f1c671ae348299e6195bec053dc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.561470  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:06.562081  7754 raft_consensus.cc:3060] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.569773  7754 raft_consensus.cc:2468] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:06.570989  7795 leader_election.cc:304] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:06.573133  7952 tablet_bootstrap.cc:700] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Time spent opening tablet: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:00:06.573918  7952 tablet_bootstrap.cc:654] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.575178  7891 tablet_service.cc:1511] Processing CreateTablet for tablet 52fe505815234b019c30d15aac38e187 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:06.560166  7958 raft_consensus.cc:515] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.577399  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f64552f3c8f4af381c7ea6596d7f3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.584983  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f64552f3c8f4af381c7ea6596d7f3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.593053  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:06.594074  7680 raft_consensus.cc:2393] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99e4e009f2884c8d9f7239b5375ab730 in current term 1: Already voted for candidate f91d8d830a474ea7a101fc5b6f920544 in this term.
I20260709 13:00:06.592295  7982 raft_consensus.cc:2804] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:06.595082  7982 raft_consensus.cc:697] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:06.595484  7948 tablet_bootstrap.cc:492] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:06.595675  7719 leader_election.cc:304] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:06.596213  7948 ts_tablet_manager.cc:1403] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.269s	user 0.016s	sys 0.024s
I20260709 13:00:06.595999  7982 consensus_queue.cc:237] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.597148  7959 raft_consensus.cc:3060] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.598939  7958 leader_election.cc:290] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:06.598551  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
W20260709 13:00:06.600407  7643 leader_election.cc:343] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.597410  7957 leader_election.cc:290] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:06.601285  7948 raft_consensus.cc:359] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.602133  7948 raft_consensus.cc:385] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.602207  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:06.602782  7948 raft_consensus.cc:740] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.604960  7950 tablet_bootstrap.cc:492] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:06.605557  7950 ts_tablet_manager.cc:1403] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.221s	user 0.003s	sys 0.017s
I20260709 13:00:06.602396  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fe505815234b019c30d15aac38e187. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:06.607861  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:06.607916  7948 consensus_queue.cc:260] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.610283  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c0ccc08b9c4764be5e221aa04d31ef" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:06.612581  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1955a60137904c4f90cee6f71b4fbcf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.602053  7949 tablet_bootstrap.cc:492] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
W20260709 13:00:06.588343  7867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 94142.4us
I20260709 13:00:06.616755  7949 ts_tablet_manager.cc:1403] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.352s	user 0.025s	sys 0.028s
I20260709 13:00:06.622089  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:06.622673  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c0ccc08b9c4764be5e221aa04d31ef" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:06.623395  7902 raft_consensus.cc:2468] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:06.623708  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:06.622108  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:06.625392  7952 tablet_bootstrap.cc:492] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:06.625535  7794 leader_election.cc:304] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:06.625974  7952 ts_tablet_manager.cc:1403] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.225s	user 0.009s	sys 0.011s
I20260709 13:00:06.626638  7958 raft_consensus.cc:2804] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:06.627075  7958 raft_consensus.cc:493] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.627472  7958 raft_consensus.cc:3060] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.629645  7667 tablet_service.cc:1511] Processing CreateTablet for tablet 52fe505815234b019c30d15aac38e187 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:00:06.630985  7720 leader_election.cc:343] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.631052  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fe505815234b019c30d15aac38e187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.632345  7720 leader_election.cc:304] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
W20260709 13:00:06.636546  7793 leader_election.cc:343] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:06.636725  7794 leader_election.cc:343] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.638165  7959 raft_consensus.cc:2749] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:06.639276  7959 raft_consensus.cc:2749] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:06.640571  7893 tablet_service.cc:1511] Processing CreateTablet for tablet 4953a51e627b477992fa1569ba01e121 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:06.641902  7893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4953a51e627b477992fa1569ba01e121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.641635  7949 raft_consensus.cc:359] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.642419  7949 raft_consensus.cc:385] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.642735  7949 raft_consensus.cc:740] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.643487  7949 consensus_queue.cc:260] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.645725  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 4953a51e627b477992fa1569ba01e121 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:06.647423  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4953a51e627b477992fa1569ba01e121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.652215  7754 raft_consensus.cc:2468] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:06.653664  7818 tablet_service.cc:1511] Processing CreateTablet for tablet 4953a51e627b477992fa1569ba01e121 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:06.654201  7646 leader_election.cc:304] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:06.655128  7818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4953a51e627b477992fa1569ba01e121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.655436  7957 raft_consensus.cc:2804] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:06.655974  7957 raft_consensus.cc:697] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
W20260709 13:00:06.638969  7867 leader_election.cc:343] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.656824  7867 leader_election.cc:304] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:06.657802  7987 raft_consensus.cc:2749] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:06.657704  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 728e396427a94afb9ff27339bbec3235 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:06.656841  7957 consensus_queue.cc:237] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.659163  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728e396427a94afb9ff27339bbec3235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.666353  7948 ts_tablet_manager.cc:1434] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.003s
I20260709 13:00:06.666255  7892 tablet_service.cc:1511] Processing CreateTablet for tablet 728e396427a94afb9ff27339bbec3235 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:06.667691  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728e396427a94afb9ff27339bbec3235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.671252  7952 raft_consensus.cc:359] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.672298  7952 raft_consensus.cc:385] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.679621  7952 raft_consensus.cc:740] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.684551  7952 consensus_queue.cc:260] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.686177  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5de0dffe634306bdeb7131e6d0d43c (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:06.687651  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5de0dffe634306bdeb7131e6d0d43c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.627497  7950 raft_consensus.cc:359] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.696920  7950 raft_consensus.cc:385] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.667713  7948 tablet_bootstrap.cc:492] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:06.706140  7575 catalog_manager.cc:5697] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.713550  7952 ts_tablet_manager.cc:1434] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.000s
I20260709 13:00:06.714804  7952 tablet_bootstrap.cc:492] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:06.698354  7950 raft_consensus.cc:740] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.716046  7819 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5de0dffe634306bdeb7131e6d0d43c (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:06.716398  7950 consensus_queue.cc:260] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.717481  7819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5de0dffe634306bdeb7131e6d0d43c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.724251  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 687dfedf0b514fb4bc4a0e696a32c285 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:06.725679  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687dfedf0b514fb4bc4a0e696a32c285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.695497  7958 raft_consensus.cc:515] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.695253  7576 catalog_manager.cc:5697] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.675004  7949 ts_tablet_manager.cc:1434] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:00:06.734828  7958 leader_election.cc:290] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:06.734984  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c0ccc08b9c4764be5e221aa04d31ef" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:06.735643  7949 tablet_bootstrap.cc:492] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:06.735762  7950 ts_tablet_manager.cc:1434] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.130s	user 0.005s	sys 0.008s
I20260709 13:00:06.736090  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c0ccc08b9c4764be5e221aa04d31ef" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:06.736672  7903 raft_consensus.cc:3060] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.736948  7950 tablet_bootstrap.cc:492] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
W20260709 13:00:06.736685  7793 leader_election.cc:343] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:06.742332  7720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 111504us
I20260709 13:00:06.746460  7742 tablet_service.cc:1511] Processing CreateTablet for tablet 52fe505815234b019c30d15aac38e187 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:06.747781  7742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fe505815234b019c30d15aac38e187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.748168  7903 raft_consensus.cc:2468] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:06.749289  7794 leader_election.cc:304] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:06.750599  7949 tablet_bootstrap.cc:654] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.755003  7815 tablet_service.cc:1511] Processing CreateTablet for tablet a1600216f6ee426ab10349caff0a0d4d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:06.756331  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1600216f6ee426ab10349caff0a0d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.757292  7891 tablet_service.cc:1511] Processing CreateTablet for tablet a1600216f6ee426ab10349caff0a0d4d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:06.758635  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1600216f6ee426ab10349caff0a0d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.759750  7952 tablet_bootstrap.cc:654] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.761701  7890 tablet_service.cc:1511] Processing CreateTablet for tablet 687dfedf0b514fb4bc4a0e696a32c285 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:06.762285  7958 raft_consensus.cc:2804] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:06.763031  7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687dfedf0b514fb4bc4a0e696a32c285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.762792  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5de0dffe634306bdeb7131e6d0d43c (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:06.763772  7957 raft_consensus.cc:493] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.764129  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5de0dffe634306bdeb7131e6d0d43c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.764297  7957 raft_consensus.cc:515] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.767225  7739 tablet_service.cc:1511] Processing CreateTablet for tablet 728e396427a94afb9ff27339bbec3235 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:06.767970  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:06.768095  7983 raft_consensus.cc:493] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.768772  7754 raft_consensus.cc:2468] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:06.768743  7983 raft_consensus.cc:515] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.770228  7646 leader_election.cc:304] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:06.768764  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728e396427a94afb9ff27339bbec3235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.774968  7957 leader_election.cc:290] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:06.775538  7957 raft_consensus.cc:2804] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:06.775985  7957 raft_consensus.cc:493] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.776314  7957 raft_consensus.cc:3060] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.776571  7948 tablet_bootstrap.cc:654] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.777097  7745 tablet_service.cc:1511] Processing CreateTablet for tablet 687dfedf0b514fb4bc4a0e696a32c285 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:06.778560  7745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687dfedf0b514fb4bc4a0e696a32c285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.781303  7983 leader_election.cc:290] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:06.771166  7958 raft_consensus.cc:697] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:06.790582  7958 consensus_queue.cc:237] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.792773  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:06.793576  7828 raft_consensus.cc:2468] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:06.794965  7643 leader_election.cc:304] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:06.795939  7983 raft_consensus.cc:2804] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:06.796288  7983 raft_consensus.cc:493] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.796692  7983 raft_consensus.cc:3060] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.797636  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:06.798448  7829 raft_consensus.cc:2468] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:06.799841  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:06.800616  7903 raft_consensus.cc:2468] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:06.809180  7990 raft_consensus.cc:493] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.809861  7990 raft_consensus.cc:515] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.814378  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:06.814459  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:06.815852  7990 leader_election.cc:290] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
W20260709 13:00:06.824429  7719 leader_election.cc:343] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:06.824085  7646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35833, user_credentials={real_user=slave}} blocked reactor thread for 53952.8us
W20260709 13:00:06.835584  7718 leader_election.cc:343] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.837249  7744 tablet_service.cc:1511] Processing CreateTablet for tablet 694bf015fc134546a01f1750539a8cf8 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:06.837894  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 694bf015fc134546a01f1750539a8cf8 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:06.838639  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694bf015fc134546a01f1750539a8cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.839211  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694bf015fc134546a01f1750539a8cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.847208  7983 raft_consensus.cc:515] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.862144  7718 leader_election.cc:304] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:06.863507  7990 raft_consensus.cc:2749] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:06.850649  7577 catalog_manager.cc:5697] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.862280  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:06.858999  7950 tablet_bootstrap.cc:654] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:06.870996  7903 raft_consensus.cc:3060] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.875039  7957 raft_consensus.cc:515] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.872984  7667 tablet_service.cc:1511] Processing CreateTablet for tablet f5511f1a9fff49799b1a7d65756ffe56 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:06.876516  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5511f1a9fff49799b1a7d65756ffe56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.876914  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:06.877540  7829 raft_consensus.cc:3060] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.874490  7893 tablet_service.cc:1511] Processing CreateTablet for tablet 694bf015fc134546a01f1750539a8cf8 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:06.881932  7893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694bf015fc134546a01f1750539a8cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.870082  7983 leader_election.cc:290] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:06.897646  7743 tablet_service.cc:1511] Processing CreateTablet for tablet f5511f1a9fff49799b1a7d65756ffe56 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:06.899071  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5511f1a9fff49799b1a7d65756ffe56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.900871  7670 tablet_service.cc:1511] Processing CreateTablet for tablet a1600216f6ee426ab10349caff0a0d4d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:06.902732  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1600216f6ee426ab10349caff0a0d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.906181  7948 tablet_bootstrap.cc:492] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:06.906741  7948 ts_tablet_manager.cc:1403] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.239s	user 0.010s	sys 0.006s
I20260709 13:00:06.911244  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:06.911876  7754 raft_consensus.cc:3060] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.912390  7957 leader_election.cc:290] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:06.916831  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:06.917212  7949 tablet_bootstrap.cc:492] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:06.917459  7828 raft_consensus.cc:3060] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:06.917721  7949 ts_tablet_manager.cc:1403] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.182s	user 0.009s	sys 0.008s
I20260709 13:00:06.930330  7817 tablet_service.cc:1511] Processing CreateTablet for tablet f5511f1a9fff49799b1a7d65756ffe56 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:06.931674  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5511f1a9fff49799b1a7d65756ffe56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.928467  7665 tablet_service.cc:1511] Processing CreateTablet for tablet dbaecfc17e784f2eb1bced30c22e86f8 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:06.935530  7829 raft_consensus.cc:2468] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:06.937034  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaecfc17e784f2eb1bced30c22e86f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.936898  7643 leader_election.cc:304] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:06.937876  7957 raft_consensus.cc:2804] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:06.938591  7957 raft_consensus.cc:697] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:06.939496  7957 consensus_queue.cc:237] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:06.885025  7903 raft_consensus.cc:2468] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:06.941901  7949 raft_consensus.cc:359] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.948216  7949 raft_consensus.cc:385] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.949851  7949 raft_consensus.cc:740] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.950762  7948 raft_consensus.cc:359] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:06.951152  7814 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5044700a374657af7e31d32683ba45 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:06.947571  7740 tablet_service.cc:1511] Processing CreateTablet for tablet dbaecfc17e784f2eb1bced30c22e86f8 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:06.952442  7950 tablet_bootstrap.cc:492] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:06.952931  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaecfc17e784f2eb1bced30c22e86f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.953034  7950 ts_tablet_manager.cc:1403] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.216s	user 0.016s	sys 0.002s
I20260709 13:00:06.957208  7828 raft_consensus.cc:2468] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:06.958412  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5044700a374657af7e31d32683ba45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.958640  7643 leader_election.cc:304] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:06.959579  7983 raft_consensus.cc:2804] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:06.960098  7983 raft_consensus.cc:697] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:06.960942  7983 consensus_queue.cc:237] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:06.941670  7754 raft_consensus.cc:2468] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:06.964197  7890 tablet_service.cc:1511] Processing CreateTablet for tablet dbaecfc17e784f2eb1bced30c22e86f8 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:06.951546  7948 raft_consensus.cc:385] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.967171  7891 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5044700a374657af7e31d32683ba45 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:06.956254  7950 raft_consensus.cc:359] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:06.968446  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5044700a374657af7e31d32683ba45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.971436  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5044700a374657af7e31d32683ba45 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:06.984155  7952 tablet_bootstrap.cc:492] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:06.969743  7950 raft_consensus.cc:385] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:06.989065  7950 raft_consensus.cc:740] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.990135  7950 consensus_queue.cc:260] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:06.967861  7948 raft_consensus.cc:740] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:06.999704  7948 consensus_queue.cc:260] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.002205  7948 ts_tablet_manager.cc:1434] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.003s
I20260709 13:00:07.003114  7952 ts_tablet_manager.cc:1403] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.289s	user 0.015s	sys 0.013s
I20260709 13:00:07.008351  7956 raft_consensus.cc:493] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.007468  7814 tablet_service.cc:1511] Processing CreateTablet for tablet 41ba344081ac4a8fabd3c2ab0d9e71a6 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:07.019419  7948 tablet_bootstrap.cc:492] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:07.019986  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ba344081ac4a8fabd3c2ab0d9e71a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.026240  7987 consensus_queue.cc:1048] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:07.026387  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 9076d349f7904683af049c46eb2c99e9 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:07.027726  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9076d349f7904683af049c46eb2c99e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.028470  7952 raft_consensus.cc:359] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.029274  7952 raft_consensus.cc:385] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.029583  7952 raft_consensus.cc:740] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.008895  7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaecfc17e784f2eb1bced30c22e86f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.008374  7892 tablet_service.cc:1511] Processing CreateTablet for tablet 41ba344081ac4a8fabd3c2ab0d9e71a6 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:07.010385  7745 tablet_service.cc:1511] Processing CreateTablet for tablet 9076d349f7904683af049c46eb2c99e9 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:07.031116  7745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9076d349f7904683af049c46eb2c99e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.031437  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ba344081ac4a8fabd3c2ab0d9e71a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.033746  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 41ba344081ac4a8fabd3c2ab0d9e71a6 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:06.972806  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5044700a374657af7e31d32683ba45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.017710  7956 raft_consensus.cc:515] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.046020  7956 leader_election.cc:290] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:07.046166  7950 ts_tablet_manager.cc:1434] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:00:07.047331  7950 tablet_bootstrap.cc:492] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
W20260709 13:00:07.047752  7794 consensus_peers.cc:597] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff -> Peer 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843): Couldn't send request to peer 98b07c9e416d4e32a62431b41b1fefa7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.048903  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafc690b8cda48dbaa3b21cfe522712b" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:07.049476  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafc690b8cda48dbaa3b21cfe522712b" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:07.050957  7866 leader_election.cc:343] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:06.997130  7949 consensus_queue.cc:260] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:07.052302  7869 leader_election.cc:343] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:07.052990  7869 leader_election.cc:304] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:07.055382  7987 raft_consensus.cc:2749] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:07.037160  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 9076d349f7904683af049c46eb2c99e9 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:07.053459  7949 ts_tablet_manager.cc:1434] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.135s	user 0.002s	sys 0.007s
I20260709 13:00:07.068259  7952 consensus_queue.cc:260] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.070168  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 36e8786bbce6485a8f5293b40587c372 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:07.070124  7889 tablet_service.cc:1511] Processing CreateTablet for tablet 36e8786bbce6485a8f5293b40587c372 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:07.072203  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e8786bbce6485a8f5293b40587c372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.072333  7949 tablet_bootstrap.cc:492] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:07.080272  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e8786bbce6485a8f5293b40587c372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.081130  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ba344081ac4a8fabd3c2ab0d9e71a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.081703  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9076d349f7904683af049c46eb2c99e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.075649  7948 tablet_bootstrap.cc:654] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.095072  7950 tablet_bootstrap.cc:654] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.076934  7983 raft_consensus.cc:493] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.098495  7983 raft_consensus.cc:515] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.072543  7952 ts_tablet_manager.cc:1434] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:00:07.100368  7952 tablet_bootstrap.cc:492] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:07.101750  7754 raft_consensus.cc:3060] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.103874  7743 tablet_service.cc:1511] Processing CreateTablet for tablet 36e8786bbce6485a8f5293b40587c372 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:07.105305  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e8786bbce6485a8f5293b40587c372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.113973  7949 tablet_bootstrap.cc:654] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.120178  7956 consensus_queue.cc:1048] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:07.122786  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8e6791febb41058f3dd1950131a939 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:07.124141  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8e6791febb41058f3dd1950131a939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.125761  7670 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8e6791febb41058f3dd1950131a939 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:07.127660  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8e6791febb41058f3dd1950131a939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.124145  7893 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8e6791febb41058f3dd1950131a939 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:07.130652  7893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8e6791febb41058f3dd1950131a939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.156054  7952 tablet_bootstrap.cc:654] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.170369  7957 consensus_queue.cc:1048] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:07.170517  7892 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2d428ca5f74d97b4fc1fa713b19994 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:07.171857  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2d428ca5f74d97b4fc1fa713b19994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.177320  7819 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2d428ca5f74d97b4fc1fa713b19994 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:07.178689  7819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2d428ca5f74d97b4fc1fa713b19994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.178226  7575 catalog_manager.cc:5697] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.184767  7668 tablet_service.cc:1511] Processing CreateTablet for tablet def02c9a73c348d1a63a3b334f54f400 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:07.185489  7739 tablet_service.cc:1511] Processing CreateTablet for tablet def02c9a73c348d1a63a3b334f54f400 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:07.186785  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def02c9a73c348d1a63a3b334f54f400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.188278  7948 tablet_bootstrap.cc:492] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:07.188827  7948 ts_tablet_manager.cc:1403] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.007s
I20260709 13:00:07.189029  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c0ccc08b9c4764be5e221aa04d31ef" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:07.191780  7679 raft_consensus.cc:3060] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.197801  7828 raft_consensus.cc:3060] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.198357  7950 tablet_bootstrap.cc:492] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:07.198865  7950 ts_tablet_manager.cc:1403] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.002s
I20260709 13:00:07.201695  7958 consensus_queue.cc:1048] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:07.202337  7983 leader_election.cc:290] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:07.203517  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c0ccc08b9c4764be5e221aa04d31ef" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:07.204319  7903 raft_consensus.cc:2393] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f91d8d830a474ea7a101fc5b6f920544 in current term 1: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:07.205701  7645 leader_election.cc:304] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:07.206142  7950 raft_consensus.cc:359] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:07.206894  7950 raft_consensus.cc:385] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.207204  7950 raft_consensus.cc:740] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.207129  7574 catalog_manager.cc:5697] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.209626  7574 catalog_manager.cc:5697] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.216782  7817 tablet_service.cc:1511] Processing CreateTablet for tablet def02c9a73c348d1a63a3b334f54f400 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:07.219391  7889 tablet_service.cc:1511] Processing CreateTablet for tablet a2e478963dd04f1f8913edd2870132d1 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:07.223047  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e478963dd04f1f8913edd2870132d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.208081  7950 consensus_queue.cc:260] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:07.197845  7745 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2d428ca5f74d97b4fc1fa713b19994 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:07.226073  7667 tablet_service.cc:1511] Processing CreateTablet for tablet a2e478963dd04f1f8913edd2870132d1 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:07.228320  7958 consensus_queue.cc:1048] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:07.228953  7983 raft_consensus.cc:2749] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:07.237722  7745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2d428ca5f74d97b4fc1fa713b19994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.254927  7743 tablet_service.cc:1511] Processing CreateTablet for tablet a2e478963dd04f1f8913edd2870132d1 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:07.256345  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e478963dd04f1f8913edd2870132d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.258734  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def02c9a73c348d1a63a3b334f54f400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.273455  7958 consensus_queue.cc:1048] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:07.273877  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def02c9a73c348d1a63a3b334f54f400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.282796  7950 ts_tablet_manager.cc:1434] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.002s
I20260709 13:00:07.286316  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e478963dd04f1f8913edd2870132d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.286962  7983 consensus_queue.cc:1048] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:00:07.301497  7892 tablet_service.cc:1511] Processing CreateTablet for tablet a838c80f5aa84e38ae70747f05808e0d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:07.302435  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a838c80f5aa84e38ae70747f05808e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.313052  7666 tablet_service.cc:1511] Processing CreateTablet for tablet a838c80f5aa84e38ae70747f05808e0d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:07.314685  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a838c80f5aa84e38ae70747f05808e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.320427  7990 raft_consensus.cc:493] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.321018  7990 raft_consensus.cc:515] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:07.321301  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 87ada82aa0d64b199d3b12025f296339 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:07.322643  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ada82aa0d64b199d3b12025f296339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.325294  7950 tablet_bootstrap.cc:492] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:07.326186  7948 raft_consensus.cc:359] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.327001  7948 raft_consensus.cc:385] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.327114  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:07.327399  7948 raft_consensus.cc:740] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.323334  7990 leader_election.cc:290] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:07.324035  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:07.328369  7948 consensus_queue.cc:260] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
W20260709 13:00:07.328917  7719 leader_election.cc:343] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:07.329149  7901 raft_consensus.cc:2468] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:07.299852  7816 tablet_service.cc:1511] Processing CreateTablet for tablet a838c80f5aa84e38ae70747f05808e0d (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:07.330472  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a838c80f5aa84e38ae70747f05808e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.330538  7720 leader_election.cc:304] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:07.332598  7990 raft_consensus.cc:2804] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:07.333012  7990 raft_consensus.cc:493] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.333387  7990 raft_consensus.cc:3060] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.341828  7983 consensus_queue.cc:1048] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:07.374965  7819 tablet_service.cc:1511] Processing CreateTablet for tablet 87ada82aa0d64b199d3b12025f296339 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:07.375756  7952 tablet_bootstrap.cc:492] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:07.376391  7952 ts_tablet_manager.cc:1403] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.276s	user 0.011s	sys 0.015s
I20260709 13:00:07.377418  7983 consensus_queue.cc:1048] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:07.378360  7948 ts_tablet_manager.cc:1434] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.189s	user 0.007s	sys 0.000s
I20260709 13:00:07.379894  7948 tablet_bootstrap.cc:492] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:07.379565  7952 raft_consensus.cc:359] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:07.380406  7952 raft_consensus.cc:385] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.384934  7952 raft_consensus.cc:740] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.392688  7893 tablet_service.cc:1511] Processing CreateTablet for tablet 87ada82aa0d64b199d3b12025f296339 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:07.394879  7950 tablet_bootstrap.cc:654] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.405216  7893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ada82aa0d64b199d3b12025f296339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.398031  7819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ada82aa0d64b199d3b12025f296339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.416394  7952 consensus_queue.cc:260] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:07.418191  7949 tablet_bootstrap.cc:492] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:07.418733  7952 ts_tablet_manager.cc:1434] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.004s
I20260709 13:00:07.418923  7949 ts_tablet_manager.cc:1403] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.347s	user 0.015s	sys 0.020s
W20260709 13:00:07.403347  7793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 45176.8us
I20260709 13:00:07.425143  7666 tablet_service.cc:1511] Processing CreateTablet for tablet b1104646f70f4ff4bae122a61937a61c (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:07.426326  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1104646f70f4ff4bae122a61937a61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.430228  7990 raft_consensus.cc:515] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:07.499954  7952 tablet_bootstrap.cc:492] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:07.505330  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:07.506256  7901 raft_consensus.cc:3060] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.509652  8027 consensus_queue.cc:1048] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:07.517627  8017 raft_consensus.cc:493] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.519629  8017 raft_consensus.cc:515] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.535925  7995 consensus_queue.cc:1048] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:07.537104  7739 tablet_service.cc:1511] Processing CreateTablet for tablet b1104646f70f4ff4bae122a61937a61c (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:07.538462  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:07.539439  7679 raft_consensus.cc:3060] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.539892  7739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1104646f70f4ff4bae122a61937a61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.544559  7817 tablet_service.cc:1511] Processing CreateTablet for tablet b1104646f70f4ff4bae122a61937a61c (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:07.546062  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1104646f70f4ff4bae122a61937a61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.524106  7990 leader_election.cc:290] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:07.592121  8017 leader_election.cc:290] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:07.604247  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:07.605013  7814 tablet_service.cc:1511] Processing CreateTablet for tablet be2165e65cf64b5daf805ec2f2fe5002 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:07.606492  7903 raft_consensus.cc:3060] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.608621  7892 tablet_service.cc:1511] Processing CreateTablet for tablet 9411be3e9dce40b3bb27db670ad0ac4f (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:07.609794  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9411be3e9dce40b3bb27db670ad0ac4f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:07.583874  7563 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 59683us
I20260709 13:00:07.614965  7950 tablet_bootstrap.cc:492] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:07.615566  7950 ts_tablet_manager.cc:1403] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.291s	user 0.020s	sys 0.025s
I20260709 13:00:07.620131  7948 tablet_bootstrap.cc:654] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.622279  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 9411be3e9dce40b3bb27db670ad0ac4f (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:07.623582  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9411be3e9dce40b3bb27db670ad0ac4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.626616  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:07.627156  7740 tablet_service.cc:1511] Processing CreateTablet for tablet 9411be3e9dce40b3bb27db670ad0ac4f (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:07.628257  7740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9411be3e9dce40b3bb27db670ad0ac4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.629999  7866 leader_election.cc:304] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:07.606556  7814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be2165e65cf64b5daf805ec2f2fe5002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.635430  7890 tablet_service.cc:1511] Processing CreateTablet for tablet be2165e65cf64b5daf805ec2f2fe5002 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:07.640800  7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be2165e65cf64b5daf805ec2f2fe5002. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:07.641950  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:07.645787  7901 raft_consensus.cc:2468] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:07.647686  7720 leader_election.cc:304] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:07.650085  7745 tablet_service.cc:1511] Processing CreateTablet for tablet b97f988382674008a12a0b6392cf7197 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:07.650246  7815 tablet_service.cc:1511] Processing CreateTablet for tablet b97f988382674008a12a0b6392cf7197 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:07.651512  7745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97f988382674008a12a0b6392cf7197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.651549  7815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97f988382674008a12a0b6392cf7197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.651881  7679 raft_consensus.cc:2468] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:07.653757  8025 raft_consensus.cc:2804] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:07.654310  8025 raft_consensus.cc:697] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:07.655198  8025 consensus_queue.cc:237] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:07.653569  7889 tablet_service.cc:1511] Processing CreateTablet for tablet b97f988382674008a12a0b6392cf7197 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:07.659415  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97f988382674008a12a0b6392cf7197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.662870  7950 raft_consensus.cc:359] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:07.663596  7950 raft_consensus.cc:385] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.663890  7950 raft_consensus.cc:740] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.665041  7952 tablet_bootstrap.cc:654] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.670748  7670 tablet_service.cc:1511] Processing CreateTablet for tablet be2165e65cf64b5daf805ec2f2fe5002 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:07.672454  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be2165e65cf64b5daf805ec2f2fe5002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.682219  7666 tablet_service.cc:1511] Processing CreateTablet for tablet b437ec0fc3684ebaacd5c0eb28c4adc2 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:07.683897  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b437ec0fc3684ebaacd5c0eb28c4adc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.705897  7950 consensus_queue.cc:260] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
W20260709 13:00:07.710611  7795 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35833, user_credentials={real_user=slave}} blocked reactor thread for 110097us
I20260709 13:00:07.717155  7743 tablet_service.cc:1511] Processing CreateTablet for tablet b437ec0fc3684ebaacd5c0eb28c4adc2 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:07.718554  7743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b437ec0fc3684ebaacd5c0eb28c4adc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.724440  7817 tablet_service.cc:1511] Processing CreateTablet for tablet b437ec0fc3684ebaacd5c0eb28c4adc2 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:07.725725  7817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b437ec0fc3684ebaacd5c0eb28c4adc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.725838  7893 tablet_service.cc:1511] Processing CreateTablet for tablet d50b5a78809f4611b59010e0e3e9fcc7 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:07.727073  7893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50b5a78809f4611b59010e0e3e9fcc7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:07.728760  7793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 135536us
I20260709 13:00:07.732829  7667 tablet_service.cc:1511] Processing CreateTablet for tablet d50b5a78809f4611b59010e0e3e9fcc7 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:07.734098  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50b5a78809f4611b59010e0e3e9fcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.740286  7744 tablet_service.cc:1511] Processing CreateTablet for tablet d50b5a78809f4611b59010e0e3e9fcc7 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:07.741811  7744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50b5a78809f4611b59010e0e3e9fcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.743147  7816 tablet_service.cc:1511] Processing CreateTablet for tablet 95450b5e9cc54eb6a0799a88a3e01b37 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:07.744563  7816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95450b5e9cc54eb6a0799a88a3e01b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.746212  7891 tablet_service.cc:1511] Processing CreateTablet for tablet 95450b5e9cc54eb6a0799a88a3e01b37 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:07.747344  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95450b5e9cc54eb6a0799a88a3e01b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.749199  7950 ts_tablet_manager.cc:1434] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.133s	user 0.010s	sys 0.000s
I20260709 13:00:07.750329  7950 tablet_bootstrap.cc:492] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:07.799799  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 95450b5e9cc54eb6a0799a88a3e01b37 (DEFAULT_TABLE table=test-workload [id=34156758fe924d178ba0a0216a7a89ba]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:07.801262  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95450b5e9cc54eb6a0799a88a3e01b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.768486  7949 raft_consensus.cc:359] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.805171  7949 raft_consensus.cc:385] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.805524  7949 raft_consensus.cc:740] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.808084  7949 consensus_queue.cc:260] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.814683  7952 tablet_bootstrap.cc:492] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:07.815342  7952 ts_tablet_manager.cc:1403] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.330s	user 0.017s	sys 0.007s
I20260709 13:00:07.817572  7949 ts_tablet_manager.cc:1434] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.398s	user 0.017s	sys 0.006s
I20260709 13:00:07.818711  7949 tablet_bootstrap.cc:492] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:07.826731  7948 tablet_bootstrap.cc:492] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:07.827286  7948 ts_tablet_manager.cc:1403] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.448s	user 0.010s	sys 0.031s
I20260709 13:00:07.826592  7952 raft_consensus.cc:359] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.838431  8017 raft_consensus.cc:2749] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:07.838855  7952 raft_consensus.cc:385] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.839380  7952 raft_consensus.cc:740] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.840531  7952 consensus_queue.cc:260] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.846168  7949 tablet_bootstrap.cc:654] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.846858  7952 ts_tablet_manager.cc:1434] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:00:07.847987  7952 tablet_bootstrap.cc:492] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:07.842828  7950 tablet_bootstrap.cc:654] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.842175  7948 raft_consensus.cc:359] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:07.848821  7948 raft_consensus.cc:385] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.849150  7948 raft_consensus.cc:740] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.849915  7948 consensus_queue.cc:260] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:07.850445  7578 catalog_manager.cc:5697] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.854836  7952 tablet_bootstrap.cc:654] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.858675  7957 raft_consensus.cc:493] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.859193  7957 raft_consensus.cc:515] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.861449  7957 leader_election.cc:290] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:07.868218  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:07.871594  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
W20260709 13:00:07.872890  7643 leader_election.cc:343] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:07.873517  7755 raft_consensus.cc:2468] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:07.874995  7646 leader_election.cc:304] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:07.876369  7957 raft_consensus.cc:2804] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:07.876695  7948 ts_tablet_manager.cc:1434] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:00:07.876787  7957 raft_consensus.cc:493] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.877260  7957 raft_consensus.cc:3060] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.877836  7948 tablet_bootstrap.cc:492] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:07.884462  7957 raft_consensus.cc:515] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.887419  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:07.888002  7755 raft_consensus.cc:3060] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.891476  7950 tablet_bootstrap.cc:492] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:07.891986  7950 ts_tablet_manager.cc:1403] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.142s	user 0.007s	sys 0.003s
I20260709 13:00:07.893577  8025 raft_consensus.cc:493] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.894088  8025 raft_consensus.cc:515] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:07.894887  7950 raft_consensus.cc:359] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.895571  7950 raft_consensus.cc:385] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.895848  7950 raft_consensus.cc:740] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.897042  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c33f71c6ae44e09fc992b5197545c5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:07.897989  7903 raft_consensus.cc:2468] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:07.898336  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c33f71c6ae44e09fc992b5197545c5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:07.899739  7720 leader_election.cc:304] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:07.900524  7948 tablet_bootstrap.cc:654] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.900939  7990 raft_consensus.cc:2804] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:07.901489  7990 raft_consensus.cc:493] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.901923  7990 raft_consensus.cc:3060] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.903221  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:07.903851  7950 consensus_queue.cc:260] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
W20260709 13:00:07.904785  7643 leader_election.cc:343] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:07.904879  7719 leader_election.cc:343] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:07.906046  7957 leader_election.cc:290] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:07.906572  7950 ts_tablet_manager.cc:1434] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:00:07.907711  7950 tablet_bootstrap.cc:492] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:07.910127  7755 raft_consensus.cc:2468] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:07.911269  7646 leader_election.cc:304] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:07.912582  7957 raft_consensus.cc:2804] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:07.913544  7957 raft_consensus.cc:697] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:07.913807  7950 tablet_bootstrap.cc:654] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.914474  7957 consensus_queue.cc:237] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.900033  8025 leader_election.cc:290] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:07.916908  7990 raft_consensus.cc:515] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:07.928753  7952 tablet_bootstrap.cc:492] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:07.929317  7952 ts_tablet_manager.cc:1403] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.004s
I20260709 13:00:07.933391  7952 raft_consensus.cc:359] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.933645  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c33f71c6ae44e09fc992b5197545c5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:07.934108  7952 raft_consensus.cc:385] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.934438  7952 raft_consensus.cc:740] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.934531  7903 raft_consensus.cc:3060] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:07.942365  7952 consensus_queue.cc:260] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.948589  7952 ts_tablet_manager.cc:1434] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:00:07.949833  7952 tablet_bootstrap.cc:492] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:07.954761  7990 leader_election.cc:290] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:07.954996  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c33f71c6ae44e09fc992b5197545c5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:07.955266  7948 tablet_bootstrap.cc:492] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:07.955935  7948 ts_tablet_manager.cc:1403] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.006s
I20260709 13:00:07.956966  7903 raft_consensus.cc:2468] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
W20260709 13:00:07.957199  7719 leader_election.cc:343] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:07.959044  7720 leader_election.cc:304] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:07.960302  7990 raft_consensus.cc:2804] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:07.961066  7990 raft_consensus.cc:697] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:07.960917  7948 raft_consensus.cc:359] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.961634  7948 raft_consensus.cc:385] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.961753  7949 tablet_bootstrap.cc:492] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:07.961962  7948 raft_consensus.cc:740] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.962016  7990 consensus_queue.cc:237] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:07.962877  7948 consensus_queue.cc:260] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:07.965164  7949 ts_tablet_manager.cc:1403] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.147s	user 0.038s	sys 0.038s
I20260709 13:00:07.965337  7948 ts_tablet_manager.cc:1434] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:00:07.966609  7948 tablet_bootstrap.cc:492] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:07.972240  7950 tablet_bootstrap.cc:492] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:07.972728  7950 ts_tablet_manager.cc:1403] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.025s
I20260709 13:00:07.968581  7949 raft_consensus.cc:359] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.976110  7950 raft_consensus.cc:359] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.976771  7949 raft_consensus.cc:385] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.977587  7952 tablet_bootstrap.cc:654] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.979094  7950 raft_consensus.cc:385] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:07.980546  7949 raft_consensus.cc:740] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.981491  7949 consensus_queue.cc:260] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.979444  7950 raft_consensus.cc:740] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:07.983529  7950 consensus_queue.cc:260] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:07.986975  7949 ts_tablet_manager.cc:1434] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:00:07.987277  7948 tablet_bootstrap.cc:654] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:07.988118  7949 tablet_bootstrap.cc:492] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:07.986975  7950 ts_tablet_manager.cc:1434] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:00:07.994071  7950 tablet_bootstrap.cc:492] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:08.001327  7957 raft_consensus.cc:493] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.996507  7949 tablet_bootstrap.cc:654] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.002105  7957 raft_consensus.cc:515] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.002848  7950 tablet_bootstrap.cc:654] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.005924  7957 leader_election.cc:290] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:08.006390  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f368c04a174168bd99e224010f9d92" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:08.009478  7643 leader_election.cc:343] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.010056  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f368c04a174168bd99e224010f9d92" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:08.011005  7755 raft_consensus.cc:2468] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:08.020396  7646 leader_election.cc:304] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:08.021436  7957 raft_consensus.cc:2804] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:08.021847  7957 raft_consensus.cc:493] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.022219  7957 raft_consensus.cc:3060] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.030124  7957 raft_consensus.cc:515] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.032999  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f368c04a174168bd99e224010f9d92" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:08.033598  7755 raft_consensus.cc:3060] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.034441  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f368c04a174168bd99e224010f9d92" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
W20260709 13:00:08.035993  7643 leader_election.cc:343] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.036613  7957 leader_election.cc:290] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:08.061874  8023 raft_consensus.cc:493] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.062681  8023 raft_consensus.cc:515] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.066439  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafc690b8cda48dbaa3b21cfe522712b" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:08.066634  8023 leader_election.cc:290] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:08.067165  7752 raft_consensus.cc:2468] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:08.068225  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafc690b8cda48dbaa3b21cfe522712b" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:08.068944  7903 raft_consensus.cc:2468] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:08.070528  7795 leader_election.cc:304] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:08.071352  8023 raft_consensus.cc:2804] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:08.071718  8023 raft_consensus.cc:493] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.072075  8023 raft_consensus.cc:3060] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.093463  7576 catalog_manager.cc:5697] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.117482  7948 tablet_bootstrap.cc:492] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:08.118139  7948 ts_tablet_manager.cc:1403] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.152s	user 0.019s	sys 0.044s
I20260709 13:00:08.119381  7949 tablet_bootstrap.cc:492] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:08.119882  7949 ts_tablet_manager.cc:1403] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.132s	user 0.021s	sys 0.033s
I20260709 13:00:08.121254  7948 raft_consensus.cc:359] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.122035  7948 raft_consensus.cc:385] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.122402  7948 raft_consensus.cc:740] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.123323  7948 consensus_queue.cc:260] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.123157  7578 catalog_manager.cc:5697] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.123980  7949 raft_consensus.cc:359] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.124660  7949 raft_consensus.cc:385] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.124936  7949 raft_consensus.cc:740] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.125566  7949 consensus_queue.cc:260] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.126112  7948 ts_tablet_manager.cc:1434] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:00:08.123247  7990 consensus_queue.cc:1048] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:08.127300  7948 tablet_bootstrap.cc:492] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:08.117069  7755 raft_consensus.cc:2468] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:08.131959  7952 tablet_bootstrap.cc:492] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:08.132458  7952 ts_tablet_manager.cc:1403] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.183s	user 0.024s	sys 0.054s
I20260709 13:00:08.134449  7949 ts_tablet_manager.cc:1434] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:00:08.135423  7952 raft_consensus.cc:359] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.136142  7952 raft_consensus.cc:385] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.136402  7952 raft_consensus.cc:740] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.132261  7646 leader_election.cc:304] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:08.137470  7957 raft_consensus.cc:2804] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:08.137817  7950 tablet_bootstrap.cc:492] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:08.138345  7950 ts_tablet_manager.cc:1403] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.145s	user 0.030s	sys 0.041s
I20260709 13:00:08.141122  7949 tablet_bootstrap.cc:492] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:08.140163  8023 raft_consensus.cc:515] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.157281  7990 consensus_queue.cc:1048] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:08.158344  7950 raft_consensus.cc:359] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.159127  7950 raft_consensus.cc:385] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.159431  7950 raft_consensus.cc:740] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.160221  7950 consensus_queue.cc:260] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.161196  7949 tablet_bootstrap.cc:654] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.137987  7957 raft_consensus.cc:697] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:08.162429  7957 consensus_queue.cc:237] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.164886  7950 ts_tablet_manager.cc:1434] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:00:08.166966  7950 tablet_bootstrap.cc:492] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:08.144731  7952 consensus_queue.cc:260] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.169317  7952 ts_tablet_manager.cc:1434] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:00:08.171547  7952 tablet_bootstrap.cc:492] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:08.171650  7948 tablet_bootstrap.cc:654] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.178380  8021 raft_consensus.cc:493] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.174793  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafc690b8cda48dbaa3b21cfe522712b" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:08.178918  8021 raft_consensus.cc:515] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.179323  7755 raft_consensus.cc:3060] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.181247  8021 leader_election.cc:290] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:08.183316  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090001da1c8d4285a0a8beaeaf3e76c6" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:08.186147  8023 leader_election.cc:290] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
W20260709 13:00:08.188774  7793 leader_election.cc:343] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.189560  7950 tablet_bootstrap.cc:654] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.190845  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafc690b8cda48dbaa3b21cfe522712b" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:08.191448  7901 raft_consensus.cc:3060] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.191807  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090001da1c8d4285a0a8beaeaf3e76c6" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:08.192440  7903 raft_consensus.cc:2468] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:08.193712  7794 leader_election.cc:304] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:08.194988  8023 raft_consensus.cc:2804] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:08.195405  8023 raft_consensus.cc:493] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.195811  8023 raft_consensus.cc:3060] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.205228  7577 catalog_manager.cc:5697] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.214146  8023 raft_consensus.cc:515] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.217998  8023 leader_election.cc:290] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:08.220867  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090001da1c8d4285a0a8beaeaf3e76c6" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:08.227473  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090001da1c8d4285a0a8beaeaf3e76c6" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:08.227029  7902 raft_consensus.cc:3060] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.231912  7949 tablet_bootstrap.cc:492] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:08.232326  7949 ts_tablet_manager.cc:1403] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.007s
W20260709 13:00:08.236248  7793 leader_election.cc:343] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.240793  7949 raft_consensus.cc:359] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.243693  7949 raft_consensus.cc:385] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.244000  7949 raft_consensus.cc:740] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.245352  7949 consensus_queue.cc:260] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.247364  7949 ts_tablet_manager.cc:1434] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:00:08.250211  7949 tablet_bootstrap.cc:492] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:08.256121  7948 tablet_bootstrap.cc:492] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:08.259830  7948 ts_tablet_manager.cc:1403] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.007s
I20260709 13:00:08.259737  8023 raft_consensus.cc:493] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.260699  8023 raft_consensus.cc:515] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.268213  8023 leader_election.cc:290] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:08.263015  7948 raft_consensus.cc:359] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.268841  7948 raft_consensus.cc:385] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.269140  7948 raft_consensus.cc:740] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.264328  7902 raft_consensus.cc:2468] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:08.227802  7901 raft_consensus.cc:2468] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:08.270341  7948 consensus_queue.cc:260] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.271225  7949 tablet_bootstrap.cc:654] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.271476  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:08.272341  7752 raft_consensus.cc:2393] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate f91d8d830a474ea7a101fc5b6f920544 in this term.
I20260709 13:00:08.272466  7948 ts_tablet_manager.cc:1434] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:00:08.273412  7948 tablet_bootstrap.cc:492] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:08.273204  7794 leader_election.cc:304] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:08.258405  7755 raft_consensus.cc:2468] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:08.261873  7952 tablet_bootstrap.cc:654] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.274451  7794 leader_election.cc:304] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:08.278266  8021 raft_consensus.cc:2804] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:08.278780  8021 raft_consensus.cc:697] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:08.279527  8018 raft_consensus.cc:2804] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:08.279687  8021 consensus_queue.cc:237] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.291661  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:08.292099  7950 tablet_bootstrap.cc:492] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:08.293654  7950 ts_tablet_manager.cc:1403] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.006s
I20260709 13:00:08.294605  7793 leader_election.cc:304] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:08.295866  8021 raft_consensus.cc:3060] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.296861  7949 tablet_bootstrap.cc:492] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:08.296552  7950 raft_consensus.cc:359] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.297410  7950 raft_consensus.cc:385] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.297741  7950 raft_consensus.cc:740] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.299013  7948 tablet_bootstrap.cc:654] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.298594  7950 consensus_queue.cc:260] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.301100  7950 ts_tablet_manager.cc:1434] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:00:08.302904  7950 tablet_bootstrap.cc:492] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:08.309311  8018 raft_consensus.cc:697] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:08.310653  8018 consensus_queue.cc:237] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.311846  7952 tablet_bootstrap.cc:492] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:08.312563  7952 ts_tablet_manager.cc:1403] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.000s
I20260709 13:00:08.301659  7949 ts_tablet_manager.cc:1403] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.006s
I20260709 13:00:08.315934  7952 raft_consensus.cc:359] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.316373  7949 raft_consensus.cc:359] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.317391  7952 raft_consensus.cc:385] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.307262  8021 raft_consensus.cc:2749] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:08.317425  7949 raft_consensus.cc:385] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.318583  7949 raft_consensus.cc:740] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.319792  7948 tablet_bootstrap.cc:492] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:08.319464  7949 consensus_queue.cc:260] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.320325  7948 ts_tablet_manager.cc:1403] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.010s
I20260709 13:00:08.321759  7949 ts_tablet_manager.cc:1434] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:08.322788  7949 tablet_bootstrap.cc:492] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:08.323302  7948 raft_consensus.cc:359] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.323818  7948 raft_consensus.cc:385] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.324040  7948 raft_consensus.cc:740] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.324692  7948 consensus_queue.cc:260] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.318017  7952 raft_consensus.cc:740] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.326164  7952 consensus_queue.cc:260] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.327046  7948 ts_tablet_manager.cc:1434] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:08.328418  7952 ts_tablet_manager.cc:1434] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:00:08.328554  7948 tablet_bootstrap.cc:492] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:08.329059  7950 tablet_bootstrap.cc:654] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.333483  7952 tablet_bootstrap.cc:492] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:08.336036  7574 catalog_manager.cc:5697] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.337952  7574 catalog_manager.cc:5697] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.339489  7952 tablet_bootstrap.cc:654] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.346000  7949 tablet_bootstrap.cc:654] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.346880  7948 tablet_bootstrap.cc:654] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.346988  8017 raft_consensus.cc:493] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.347470  8017 raft_consensus.cc:515] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.349687  8017 leader_election.cc:290] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:08.350646  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0915d2c188d14ddabd92c69242f68829" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:08.351280  7829 raft_consensus.cc:2468] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:08.351585  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0915d2c188d14ddabd92c69242f68829" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:08.352492  7752 raft_consensus.cc:2468] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:08.352725  7866 leader_election.cc:304] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:08.358534  7950 tablet_bootstrap.cc:492] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:08.359050  7950 ts_tablet_manager.cc:1403] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.002s
I20260709 13:00:08.364676  7983 consensus_queue.cc:1048] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:08.362370  7950 raft_consensus.cc:359] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.366549  7950 raft_consensus.cc:385] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.366853  7950 raft_consensus.cc:740] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.367563  7950 consensus_queue.cc:260] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.372918  7950 ts_tablet_manager.cc:1434] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:00:08.373318  8018 raft_consensus.cc:493] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.374096  7950 tablet_bootstrap.cc:492] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:08.373870  8018 raft_consensus.cc:515] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.375599  8022 consensus_queue.cc:1048] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:08.376618  8018 leader_election.cc:290] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:08.381807  7952 tablet_bootstrap.cc:492] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:08.382324  7952 ts_tablet_manager.cc:1403] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.004s
I20260709 13:00:08.383853  7950 tablet_bootstrap.cc:654] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.384462  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f368c04a174168bd99e224010f9d92" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:08.385533  7755 raft_consensus.cc:2393] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate f91d8d830a474ea7a101fc5b6f920544 in this term.
I20260709 13:00:08.389725  7952 raft_consensus.cc:359] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.391538  7952 raft_consensus.cc:385] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.391835  7952 raft_consensus.cc:740] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.385627  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f368c04a174168bd99e224010f9d92" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:08.391224  8017 raft_consensus.cc:2804] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:08.394018  8017 raft_consensus.cc:493] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.394516  8017 raft_consensus.cc:3060] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.397047  7793 leader_election.cc:304] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:08.398524  8018 raft_consensus.cc:3060] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.392556  7952 consensus_queue.cc:260] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.400213  7952 ts_tablet_manager.cc:1434] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:00:08.407658  8018 raft_consensus.cc:2749] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:08.410316  7952 tablet_bootstrap.cc:492] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:08.421185  7983 consensus_queue.cc:1048] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:08.423708  7952 tablet_bootstrap.cc:654] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.438328  8075 raft_consensus.cc:493] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.485001  7950 tablet_bootstrap.cc:492] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:08.485613  7950 ts_tablet_manager.cc:1403] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.000s
I20260709 13:00:08.475680  8075 raft_consensus.cc:515] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.489104  7950 raft_consensus.cc:359] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.492148  7950 raft_consensus.cc:385] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.492537  7950 raft_consensus.cc:740] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.494217  7950 consensus_queue.cc:260] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.498581  7950 ts_tablet_manager.cc:1434] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:00:08.499358  7950 tablet_bootstrap.cc:492] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:08.495007  8017 raft_consensus.cc:515] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.502199  7948 tablet_bootstrap.cc:492] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:08.502732  7948 ts_tablet_manager.cc:1403] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.174s	user 0.035s	sys 0.035s
I20260709 13:00:08.503350  7952 tablet_bootstrap.cc:492] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:08.505343  7952 ts_tablet_manager.cc:1403] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.007s
I20260709 13:00:08.508098  7948 raft_consensus.cc:359] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.509997  7948 raft_consensus.cc:385] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.510696  7948 raft_consensus.cc:740] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.504838  8075 leader_election.cc:290] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:08.512729  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9708521c863f4f02b5ea46f35013e91c" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:08.513193  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9708521c863f4f02b5ea46f35013e91c" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:08.515602  7752 raft_consensus.cc:2468] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:08.511477  7948 consensus_queue.cc:260] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.510738  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0915d2c188d14ddabd92c69242f68829" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:08.516463  7755 raft_consensus.cc:3060] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.522924  8017 leader_election.cc:290] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:08.523795  7869 leader_election.cc:304] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:08.523228  7950 tablet_bootstrap.cc:654] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.526042  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0915d2c188d14ddabd92c69242f68829" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:08.521735  7952 raft_consensus.cc:359] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.529074  7952 raft_consensus.cc:385] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.529826  8017 raft_consensus.cc:2804] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:08.529632  7949 tablet_bootstrap.cc:492] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:08.537271  7949 ts_tablet_manager.cc:1403] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.215s	user 0.021s	sys 0.032s
I20260709 13:00:08.529956  7952 raft_consensus.cc:740] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.540594  7952 consensus_queue.cc:260] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.543206  7952 ts_tablet_manager.cc:1434] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:00:08.544142  7952 tablet_bootstrap.cc:492] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:08.544325  7950 tablet_bootstrap.cc:492] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:08.529670  7755 raft_consensus.cc:2468] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:08.544801  7950 ts_tablet_manager.cc:1403] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.003s
I20260709 13:00:08.545665  7680 raft_consensus.cc:2468] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:08.526721  7827 raft_consensus.cc:3060] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.530979  7679 raft_consensus.cc:3060] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.552801  8017 raft_consensus.cc:493] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.553408  8017 raft_consensus.cc:3060] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.532334  7948 ts_tablet_manager.cc:1434] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:00:08.557168  7869 leader_election.cc:304] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:08.557821  7948 tablet_bootstrap.cc:492] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:08.558175  8075 raft_consensus.cc:2804] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:08.558678  8075 raft_consensus.cc:697] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:08.559580  8075 consensus_queue.cc:237] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.562352  8022 raft_consensus.cc:493] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.562868  8022 raft_consensus.cc:515] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.565528  8022 leader_election.cc:290] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:08.567780  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cd919cc164a29a97c54622f534945" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:08.569222  7718 leader_election.cc:343] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.576246  8022 consensus_queue.cc:1048] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:08.578986  7949 raft_consensus.cc:359] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.579787  7949 raft_consensus.cc:385] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.580065  7949 raft_consensus.cc:740] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.581815  7950 raft_consensus.cc:359] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.582593  7950 raft_consensus.cc:385] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.582906  7950 raft_consensus.cc:740] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.583593  7950 consensus_queue.cc:260] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.585614  7952 tablet_bootstrap.cc:654] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.588140  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cd919cc164a29a97c54622f534945" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:08.588929  7901 raft_consensus.cc:2468] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:08.590968  7720 leader_election.cc:304] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:08.592891  8022 raft_consensus.cc:2804] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:08.593330  8022 raft_consensus.cc:493] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.593155  7949 consensus_queue.cc:260] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.593698  8022 raft_consensus.cc:3060] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.596906  7949 ts_tablet_manager.cc:1434] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.059s	user 0.013s	sys 0.008s
I20260709 13:00:08.600893  8017 raft_consensus.cc:515] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.603842  7827 raft_consensus.cc:2468] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:08.604439  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9708521c863f4f02b5ea46f35013e91c" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:08.605080  7678 raft_consensus.cc:3060] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.605225  7949 tablet_bootstrap.cc:492] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:08.608243  7950 ts_tablet_manager.cc:1434] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:00:08.609508  7950 tablet_bootstrap.cc:492] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:08.611335  7948 tablet_bootstrap.cc:654] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.617450  8017 leader_election.cc:290] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:08.630743  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9708521c863f4f02b5ea46f35013e91c" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:08.624500  8025 raft_consensus.cc:493] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.634809  8027 raft_consensus.cc:493] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.633746  7755 raft_consensus.cc:3060] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.637564  8027 raft_consensus.cc:515] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.635288  8025 raft_consensus.cc:515] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.643749  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:08.644850  8025 leader_election.cc:290] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:08.617976  7957 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.646201  7719 leader_election.cc:343] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.645622  7957 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.651037  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:08.651373  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:08.654714  7826 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:08.656060  7643 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:08.656960  7983 raft_consensus.cc:2804] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:08.657173  7950 tablet_bootstrap.cc:654] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.657367  7983 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.657778  7983 raft_consensus.cc:3060] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:08.659940  8084 log.cc:927] Time spent T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:00:08.661087  7718 leader_election.cc:343] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.661654  7718 leader_election.cc:304] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:08.662694  8025 raft_consensus.cc:2749] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:08.647400  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090001da1c8d4285a0a8beaeaf3e76c6" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:08.664417  7901 raft_consensus.cc:2393] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f91d8d830a474ea7a101fc5b6f920544 in current term 1: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:08.651813  8027 leader_election.cc:290] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:08.664860  7578 catalog_manager.cc:5697] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.661003  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090001da1c8d4285a0a8beaeaf3e76c6" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:08.687122  7643 leader_election.cc:304] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:08.694144  8027 raft_consensus.cc:3060] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.696696  7957 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:08.697114  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:08.697803  7902 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:08.709425  7678 raft_consensus.cc:2468] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:08.710677  8022 raft_consensus.cc:515] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.714202  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cd919cc164a29a97c54622f534945" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
W20260709 13:00:08.717037  7718 leader_election.cc:343] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.719230  7948 tablet_bootstrap.cc:492] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:08.719852  7948 ts_tablet_manager.cc:1403] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.009s
I20260709 13:00:08.718758  7867 leader_election.cc:304] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:08.720911  7952 tablet_bootstrap.cc:492] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:08.721405  7952 ts_tablet_manager.cc:1403] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.177s	user 0.016s	sys 0.012s
I20260709 13:00:08.722863  8017 raft_consensus.cc:2804] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:08.722339  7948 raft_consensus.cc:359] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.723510  8017 raft_consensus.cc:697] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:08.723692  7948 raft_consensus.cc:385] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.717052  7983 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.724485  8017 consensus_queue.cc:237] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.724028  7948 raft_consensus.cc:740] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.725970  7948 consensus_queue.cc:260] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.727298  7983 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:08.728052  7948 ts_tablet_manager.cc:1434] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:00:08.730154  7948 tablet_bootstrap.cc:492] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:08.730371  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:08.728847  7949 tablet_bootstrap.cc:654] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.731034  7902 raft_consensus.cc:3060] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.730796  8018 consensus_queue.cc:1048] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:08.733865  7983 consensus_queue.cc:1048] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:08.724162  7952 raft_consensus.cc:359] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.737891  7952 raft_consensus.cc:385] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.738356  7952 raft_consensus.cc:740] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.739283  7952 consensus_queue.cc:260] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.742022  7755 raft_consensus.cc:2468] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:08.742386  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cd919cc164a29a97c54622f534945" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:08.743009  7903 raft_consensus.cc:3060] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.741448  8022 leader_election.cc:290] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:08.754477  7952 ts_tablet_manager.cc:1434] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:00:08.755326  7952 tablet_bootstrap.cc:492] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:08.759168  7950 tablet_bootstrap.cc:492] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:08.759734  7950 ts_tablet_manager.cc:1403] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.151s	user 0.032s	sys 0.017s
I20260709 13:00:08.760891  7902 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:08.762248  7645 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:08.763262  8088 raft_consensus.cc:2804] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:08.762945  7950 raft_consensus.cc:359] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.763808  8088 raft_consensus.cc:697] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:08.763862  7950 raft_consensus.cc:385] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.764816  8088 consensus_queue.cc:237] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.769312  7948 tablet_bootstrap.cc:654] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.764375  7950 raft_consensus.cc:740] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.771250  7950 consensus_queue.cc:260] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
W20260709 13:00:08.777632  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:08.778537  7903 raft_consensus.cc:2468] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:08.779870  7720 leader_election.cc:304] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:08.780742  8022 raft_consensus.cc:2804] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:08.781965  8022 raft_consensus.cc:697] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:08.783073  8022 consensus_queue.cc:237] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.783000  7574 catalog_manager.cc:5697] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.784842  8027 raft_consensus.cc:2749] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:08.787276  7950 ts_tablet_manager.cc:1434] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:00:08.788018  7950 tablet_bootstrap.cc:492] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
W20260709 13:00:08.772291  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 92392.9us
I20260709 13:00:08.791870  8025 raft_consensus.cc:493] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.796692  8018 consensus_queue.cc:1048] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:08.799068  7950 tablet_bootstrap.cc:654] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.792408  8025 raft_consensus.cc:515] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.803694  8025 leader_election.cc:290] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:08.805859  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74faeec2e32f4c079635c385977c8ebf" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:08.807283  7718 leader_election.cc:343] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.803910  7578 catalog_manager.cc:5697] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.815948  7952 tablet_bootstrap.cc:654] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.817361  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74faeec2e32f4c079635c385977c8ebf" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:08.835114  7949 tablet_bootstrap.cc:492] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:08.835770  7949 ts_tablet_manager.cc:1403] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.231s	user 0.016s	sys 0.007s
I20260709 13:00:08.842101  7949 raft_consensus.cc:359] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.842669  7949 raft_consensus.cc:385] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.842906  7949 raft_consensus.cc:740] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
W20260709 13:00:08.824792  7720 leader_election.cc:343] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.843550  7949 consensus_queue.cc:260] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.844218  7720 leader_election.cc:304] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:08.846133  8025 raft_consensus.cc:2749] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:08.850003  7949 ts_tablet_manager.cc:1434] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:00:08.851080  7949 tablet_bootstrap.cc:492] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:08.856676  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:08.857165  7949 tablet_bootstrap.cc:654] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.857333  7827 raft_consensus.cc:3060] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.861457  8025 raft_consensus.cc:493] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.861987  8025 raft_consensus.cc:515] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.867957  8027 consensus_queue.cc:1048] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:08.872982  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:08.873682  7680 raft_consensus.cc:2468] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:08.875640  7719 leader_election.cc:304] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:08.876948  7990 raft_consensus.cc:2804] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:08.877351  7990 raft_consensus.cc:493] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.877687  7990 raft_consensus.cc:3060] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:08.881117  8090 log.cc:927] Time spent T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:08.884872  8025 leader_election.cc:290] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:08.887979  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:08.903038  7718 leader_election.cc:343] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.904513  7827 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:08.921840  7990 raft_consensus.cc:515] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:08.926402  7949 tablet_bootstrap.cc:492] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:08.926921  7949 ts_tablet_manager.cc:1403] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.016s
I20260709 13:00:08.926924  8018 consensus_queue.cc:1048] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:08.930609  7949 raft_consensus.cc:359] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.931183  7949 raft_consensus.cc:385] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.931470  7949 raft_consensus.cc:740] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.932081  7949 consensus_queue.cc:260] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:08.940441  7950 tablet_bootstrap.cc:492] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:08.940996  7950 ts_tablet_manager.cc:1403] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.153s	user 0.033s	sys 0.044s
I20260709 13:00:08.947243  7990 leader_election.cc:290] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:08.948627  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:08.948333  7576 catalog_manager.cc:5697] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.956758  7678 raft_consensus.cc:3060] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:08.958271  7952 tablet_bootstrap.cc:492] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:08.950975  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:08.958779  7952 ts_tablet_manager.cc:1403] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.204s	user 0.019s	sys 0.005s
I20260709 13:00:08.951609  7949 ts_tablet_manager.cc:1434] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.005s
I20260709 13:00:08.961834  7949 tablet_bootstrap.cc:492] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:08.952482  8021 consensus_queue.cc:1048] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:08.964493  7718 leader_election.cc:343] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:08.961702  7952 raft_consensus.cc:359] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.968411  7952 raft_consensus.cc:385] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.968766  7952 raft_consensus.cc:740] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.969635  7952 consensus_queue.cc:260] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.971108  7948 tablet_bootstrap.cc:492] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:08.971670  7948 ts_tablet_manager.cc:1403] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.242s	user 0.010s	sys 0.006s
I20260709 13:00:08.970770  7950 raft_consensus.cc:359] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.972144  7950 raft_consensus.cc:385] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.972479  7950 raft_consensus.cc:740] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.973974  7952 ts_tablet_manager.cc:1434] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:00:08.974855  7948 raft_consensus.cc:359] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.975711  7948 raft_consensus.cc:385] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:08.976163  7948 raft_consensus.cc:740] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:08.977276  7948 consensus_queue.cc:260] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:08.975710  7950 consensus_queue.cc:260] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:08.979286  7949 tablet_bootstrap.cc:654] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:08.981252  7950 ts_tablet_manager.cc:1434] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:00:08.982661  7950 tablet_bootstrap.cc:492] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:08.984608  7952 tablet_bootstrap.cc:492] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:08.990989  7948 ts_tablet_manager.cc:1434] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:00:08.991972  7948 tablet_bootstrap.cc:492] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:09.004467  7948 tablet_bootstrap.cc:654] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.009048  7952 tablet_bootstrap.cc:654] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.006392  7950 tablet_bootstrap.cc:654] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.007567  7678 raft_consensus.cc:2468] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:09.023998  7719 leader_election.cc:304] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:09.025875  7990 raft_consensus.cc:2804] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.026409  7990 raft_consensus.cc:697] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:09.027275  7990 consensus_queue.cc:237] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.062824  7952 tablet_bootstrap.cc:492] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:09.063468  7952 ts_tablet_manager.cc:1403] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.019s
I20260709 13:00:09.066691  7952 raft_consensus.cc:359] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.067425  7952 raft_consensus.cc:385] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.067719  7952 raft_consensus.cc:740] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.068588  8017 consensus_queue.cc:1048] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:09.069428  7948 tablet_bootstrap.cc:492] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:09.069948  7948 ts_tablet_manager.cc:1403] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.005s
I20260709 13:00:09.073007  7948 raft_consensus.cc:359] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.073740  7948 raft_consensus.cc:385] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.074038  7948 raft_consensus.cc:740] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.074947  7952 consensus_queue.cc:260] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.077447  7952 ts_tablet_manager.cc:1434] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:00:09.078027  7948 consensus_queue.cc:260] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.080461  7952 tablet_bootstrap.cc:492] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:09.081557  7948 ts_tablet_manager.cc:1434] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:00:09.082650  7948 tablet_bootstrap.cc:492] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:09.089062  7948 tablet_bootstrap.cc:654] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.098557  7952 tablet_bootstrap.cc:654] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.117477  7950 tablet_bootstrap.cc:492] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:09.118153  7950 ts_tablet_manager.cc:1403] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.003s
I20260709 13:00:09.125329  8021 raft_consensus.cc:493] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.128734  7949 tablet_bootstrap.cc:492] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:09.129264  7949 ts_tablet_manager.cc:1403] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.168s	user 0.011s	sys 0.014s
I20260709 13:00:09.127475  8021 raft_consensus.cc:515] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.132050  7949 raft_consensus.cc:359] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.134613  8021 leader_election.cc:290] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:09.135375  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cd919cc164a29a97c54622f534945" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.136966  7949 raft_consensus.cc:385] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.137854  7948 tablet_bootstrap.cc:492] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:09.137333  7949 raft_consensus.cc:740] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.138396  7948 ts_tablet_manager.cc:1403] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.020s
I20260709 13:00:09.139096  7949 consensus_queue.cc:260] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.141217  7949 ts_tablet_manager.cc:1434] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:00:09.142158  7949 tablet_bootstrap.cc:492] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:09.141913  7948 raft_consensus.cc:359] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.142699  7948 raft_consensus.cc:385] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.143043  7948 raft_consensus.cc:740] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.143875  7948 consensus_queue.cc:260] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.146302  7948 ts_tablet_manager.cc:1434] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:09.146696  7952 tablet_bootstrap.cc:492] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:09.147197  7952 ts_tablet_manager.cc:1403] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.001s
I20260709 13:00:09.147271  7948 tablet_bootstrap.cc:492] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:09.148761  7949 tablet_bootstrap.cc:654] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.150547  7952 raft_consensus.cc:359] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.151440  7952 raft_consensus.cc:385] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.151777  7952 raft_consensus.cc:740] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.153792  7983 raft_consensus.cc:493] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.154363  7983 raft_consensus.cc:515] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.157555  8075 consensus_queue.cc:1048] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:09.142889  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26cd919cc164a29a97c54622f534945" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:09.158988  7901 raft_consensus.cc:2393] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate 99e4e009f2884c8d9f7239b5375ab730 in this term.
I20260709 13:00:09.159621  7983 leader_election.cc:290] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:09.154104  7948 tablet_bootstrap.cc:654] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.160470  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76db30f9818e4e4cb3825f84ad8e9223" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:09.161144  7827 raft_consensus.cc:2468] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:09.161342  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76db30f9818e4e4cb3825f84ad8e9223" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:09.162034  7901 raft_consensus.cc:2468] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:09.162576  7643 leader_election.cc:304] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:09.164402  7574 catalog_manager.cc:5697] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:09.166968  7983 raft_consensus.cc:2804] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.168138  7983 raft_consensus.cc:493] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.165946  7794 leader_election.cc:304] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:09.169612  8021 raft_consensus.cc:3060] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.169865  7948 tablet_bootstrap.cc:492] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:09.169534  7950 raft_consensus.cc:359] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.170356  7950 raft_consensus.cc:385] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.170469  7948 ts_tablet_manager.cc:1403] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.003s
I20260709 13:00:09.170660  7950 raft_consensus.cc:740] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.171451  7950 consensus_queue.cc:260] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.173590  7948 raft_consensus.cc:359] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.174350  7948 raft_consensus.cc:385] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.174636  7948 raft_consensus.cc:740] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.154682  7952 consensus_queue.cc:260] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.175606  7948 consensus_queue.cc:260] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.178030  7952 ts_tablet_manager.cc:1434] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 13:00:09.178462  7983 raft_consensus.cc:3060] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.179085  7952 tablet_bootstrap.cc:492] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:09.182981  7948 ts_tablet_manager.cc:1434] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:00:09.183895  8021 raft_consensus.cc:2749] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.184103  7948 tablet_bootstrap.cc:492] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:09.192623  7950 ts_tablet_manager.cc:1434] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.002s
I20260709 13:00:09.193514  8088 consensus_queue.cc:1048] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:09.199556  7950 tablet_bootstrap.cc:492] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:09.206424  7950 tablet_bootstrap.cc:654] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.209913  8114 raft_consensus.cc:493] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.210551  8114 raft_consensus.cc:515] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.191958  7952 tablet_bootstrap.cc:654] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.214257  7983 raft_consensus.cc:515] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.215108  7948 tablet_bootstrap.cc:654] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.215493  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541510a88d1f44cdb6156324aa747e96" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.216250  7755 raft_consensus.cc:2468] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:09.217448  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541510a88d1f44cdb6156324aa747e96" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:09.223862  7869 leader_election.cc:304] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:09.226495  7957 consensus_queue.cc:1048] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:00:09.227120  7867 leader_election.cc:343] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.227944  8017 raft_consensus.cc:2804] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.228396  8017 raft_consensus.cc:493] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.228811  8017 raft_consensus.cc:3060] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.235984  8075 consensus_queue.cc:1048] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:09.237198  8114 leader_election.cc:290] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:09.243454  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76db30f9818e4e4cb3825f84ad8e9223" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:09.244314  7828 raft_consensus.cc:3060] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.209882  7949 tablet_bootstrap.cc:492] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:09.248413  7949 ts_tablet_manager.cc:1403] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.005s
I20260709 13:00:09.265892  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76db30f9818e4e4cb3825f84ad8e9223" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:09.266541  7828 raft_consensus.cc:2468] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:09.266762  7901 raft_consensus.cc:3060] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.267122  7983 leader_election.cc:290] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:09.268199  8017 raft_consensus.cc:515] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.270612  8017 leader_election.cc:290] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:09.272384  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541510a88d1f44cdb6156324aa747e96" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:09.274669  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541510a88d1f44cdb6156324aa747e96" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:09.275274  7754 raft_consensus.cc:3060] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.278652  8089 raft_consensus.cc:493] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.279207  8089 raft_consensus.cc:515] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
W20260709 13:00:09.281265  7867 leader_election.cc:343] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.282419  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00647e852184fb281c21a8e4739e9e4" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:09.283174  7643 leader_election.cc:304] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:09.284829  8075 consensus_queue.cc:1048] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:09.285478  7643 leader_election.cc:343] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.286309  7983 raft_consensus.cc:2804] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.289230  7983 raft_consensus.cc:697] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:09.290392  7983 consensus_queue.cc:237] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.253396  7949 raft_consensus.cc:359] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.295168  7949 raft_consensus.cc:385] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.295490  7949 raft_consensus.cc:740] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.295720  7952 tablet_bootstrap.cc:492] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:09.296249  7952 ts_tablet_manager.cc:1403] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.117s	user 0.020s	sys 0.014s
I20260709 13:00:09.297508  7901 raft_consensus.cc:2468] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:09.296195  7949 consensus_queue.cc:260] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.309099  7949 ts_tablet_manager.cc:1434] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:00:09.310381  7948 tablet_bootstrap.cc:492] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:09.310926  7948 ts_tablet_manager.cc:1403] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.127s	user 0.008s	sys 0.004s
I20260709 13:00:09.311443  7949 tablet_bootstrap.cc:492] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:09.313069  8027 raft_consensus.cc:493] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.313612  8027 raft_consensus.cc:515] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.310952  7990 consensus_queue.cc:1048] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:00:09.317358  8027 leader_election.cc:290] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:09.318261  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.318985  7752 raft_consensus.cc:2468] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:09.320405  7646 leader_election.cc:304] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:09.322165  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:09.323537  7643 leader_election.cc:343] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.301620  8089 leader_election.cc:290] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:09.325474  8089 raft_consensus.cc:2804] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.325930  8089 raft_consensus.cc:493] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.326372  8089 raft_consensus.cc:3060] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.306368  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00647e852184fb281c21a8e4739e9e4" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:09.327347  7901 raft_consensus.cc:2468] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:09.328689  7645 leader_election.cc:304] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:09.329967  7957 raft_consensus.cc:2804] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.330379  7957 raft_consensus.cc:493] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.331022  7957 raft_consensus.cc:3060] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.299899  7952 raft_consensus.cc:359] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.334115  7952 raft_consensus.cc:385] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.334178  7948 raft_consensus.cc:359] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.334661  7952 raft_consensus.cc:740] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.335028  7948 raft_consensus.cc:385] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.335542  7948 raft_consensus.cc:740] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.336400  7948 consensus_queue.cc:260] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.338748  7948 ts_tablet_manager.cc:1434] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:00:09.339787  7948 tablet_bootstrap.cc:492] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:09.340389  7957 raft_consensus.cc:515] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.339943  7952 consensus_queue.cc:260] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.342682  7990 consensus_queue.cc:1048] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:09.347002  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00647e852184fb281c21a8e4739e9e4" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:09.344007  7754 raft_consensus.cc:2468] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:09.349116  7957 leader_election.cc:290] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
W20260709 13:00:09.348520  7643 leader_election.cc:343] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.350281  7957 raft_consensus.cc:493] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.350805  7957 raft_consensus.cc:515] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.350142  7869 leader_election.cc:304] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:09.355988  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00647e852184fb281c21a8e4739e9e4" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:09.356401  8017 raft_consensus.cc:2804] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.360915  7952 ts_tablet_manager.cc:1434] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:00:09.362550  7952 tablet_bootstrap.cc:492] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:09.365993  7950 tablet_bootstrap.cc:492] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:09.366539  7950 ts_tablet_manager.cc:1403] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.167s	user 0.015s	sys 0.031s
I20260709 13:00:09.369154  7957 leader_election.cc:290] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:09.370465  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.370643  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:09.371397  7902 raft_consensus.cc:2468] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
W20260709 13:00:09.372318  7646 leader_election.cc:343] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.357035  8017 raft_consensus.cc:697] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:09.373122  7645 leader_election.cc:304] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:09.373582  8017 consensus_queue.cc:237] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.374516  7957 raft_consensus.cc:2804] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.375044  7957 raft_consensus.cc:493] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.375646  7957 raft_consensus.cc:3060] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.374799  7952 tablet_bootstrap.cc:654] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.356761  7901 raft_consensus.cc:3060] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.383308  8089 raft_consensus.cc:515] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.390964  7949 tablet_bootstrap.cc:654] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.391582  7948 tablet_bootstrap.cc:654] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.388434  7578 catalog_manager.cc:5697] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.397889  7901 raft_consensus.cc:2468] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:09.402261  7645 leader_election.cc:304] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:09.403676  7983 raft_consensus.cc:2804] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.404142  7983 raft_consensus.cc:697] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:09.405028  7983 consensus_queue.cc:237] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.404313  7957 raft_consensus.cc:515] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.408919  7957 leader_election.cc:290] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:09.409525  8075 raft_consensus.cc:493] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.410035  8075 raft_consensus.cc:515] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.417400  8075 leader_election.cc:290] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:09.417585  8089 leader_election.cc:290] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:09.434023  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:09.435057  7755 raft_consensus.cc:3060] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.442864  7950 raft_consensus.cc:359] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.443886  7950 raft_consensus.cc:385] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.444233  7950 raft_consensus.cc:740] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.450731  7950 consensus_queue.cc:260] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.453188  7950 ts_tablet_manager.cc:1434] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:00:09.454144  7950 tablet_bootstrap.cc:492] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:09.454861  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74faeec2e32f4c079635c385977c8ebf" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:09.455911  7827 raft_consensus.cc:2468] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:09.438714  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:09.463662  7952 tablet_bootstrap.cc:492] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:09.464560  7952 ts_tablet_manager.cc:1403] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.017s
I20260709 13:00:09.446358  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:09.468417  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74faeec2e32f4c079635c385977c8ebf" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.469148  7752 raft_consensus.cc:2468] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:09.470958  7866 leader_election.cc:304] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:09.471506  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:09.472105  8075 raft_consensus.cc:2804] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.472515  8075 raft_consensus.cc:493] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.472886  8075 raft_consensus.cc:3060] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.479034  7990 consensus_queue.cc:1048] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:09.481366  7643 leader_election.cc:343] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.468007  7901 raft_consensus.cc:3060] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:09.493412  7646 leader_election.cc:343] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.498003  7755 raft_consensus.cc:2468] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:09.499559  7646 leader_election.cc:304] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:09.500610  7949 tablet_bootstrap.cc:492] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:09.501148  7949 ts_tablet_manager.cc:1403] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.022s
I20260709 13:00:09.503648  8089 raft_consensus.cc:2804] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.504288  8089 raft_consensus.cc:697] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:09.505276  7952 raft_consensus.cc:359] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.506011  7952 raft_consensus.cc:385] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.506264  7949 raft_consensus.cc:359] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.506961  7949 raft_consensus.cc:385] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.507231  7949 raft_consensus.cc:740] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.508111  7949 consensus_queue.cc:260] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.509193  7950 tablet_bootstrap.cc:654] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.510102  7949 ts_tablet_manager.cc:1434] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:00:09.505199  8089 consensus_queue.cc:237] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.511070  7949 tablet_bootstrap.cc:492] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:09.501592  8075 raft_consensus.cc:515] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.511610  7574 catalog_manager.cc:5697] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.513496  8018 raft_consensus.cc:493] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.520900  8018 raft_consensus.cc:515] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.523304  8018 leader_election.cc:290] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:09.523970  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:09.525573  7949 tablet_bootstrap.cc:654] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.515300  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74faeec2e32f4c079635c385977c8ebf" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:09.526140  7827 raft_consensus.cc:3060] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.516206  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74faeec2e32f4c079635c385977c8ebf" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:09.529703  7755 raft_consensus.cc:3060] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.538847  8022 raft_consensus.cc:493] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.539603  8022 raft_consensus.cc:515] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.540962  7828 raft_consensus.cc:3060] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.544241  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:09.548733  7827 raft_consensus.cc:2468] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:09.518573  7901 raft_consensus.cc:2468] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:09.506263  7952 raft_consensus.cc:740] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.552222  7952 consensus_queue.cc:260] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.554284  7952 ts_tablet_manager.cc:1434] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.000s
I20260709 13:00:09.554769  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:09.557053  7645 leader_election.cc:304] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:09.525403  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.529093  8025 raft_consensus.cc:493] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.561292  8025 raft_consensus.cc:515] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.555195  7952 tablet_bootstrap.cc:492] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:09.563477  8025 leader_election.cc:290] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
W20260709 13:00:09.550423  7718 leader_election.cc:343] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.516899  7948 tablet_bootstrap.cc:492] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:09.565311  7948 ts_tablet_manager.cc:1403] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.226s	user 0.031s	sys 0.024s
I20260709 13:00:09.514206  8075 leader_election.cc:290] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:09.569443  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf003a44a8d49479fbe48301e5681b5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:09.567385  8089 raft_consensus.cc:2804] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.570160  7901 raft_consensus.cc:2468] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:09.570688  8089 raft_consensus.cc:697] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:09.571833  7948 raft_consensus.cc:359] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.567365  8022 leader_election.cc:290] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:09.571880  8089 consensus_queue.cc:237] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.573863  7755 raft_consensus.cc:2468] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:09.576797  7948 raft_consensus.cc:385] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.574561  7866 leader_election.cc:304] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:09.577494  7948 raft_consensus.cc:740] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.575959  8025 consensus_queue.cc:1048] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:09.565884  7719 leader_election.cc:343] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.579710  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf003a44a8d49479fbe48301e5681b5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:09.571768  7720 leader_election.cc:304] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
W20260709 13:00:09.581732  7718 leader_election.cc:343] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.582948  8025 raft_consensus.cc:2804] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.579924  7948 consensus_queue.cc:260] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.580878  8075 raft_consensus.cc:2804] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.568683  7574 catalog_manager.cc:5697] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:09.583899  8025 raft_consensus.cc:493] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.587761  8025 raft_consensus.cc:3060] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.586630  8075 raft_consensus.cc:697] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
W20260709 13:00:09.588425  8136 log.cc:927] Time spent T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:00:09.593750  7719 leader_election.cc:304] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:09.600903  8022 raft_consensus.cc:2749] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.587184  7948 ts_tablet_manager.cc:1434] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:00:09.603849  7948 tablet_bootstrap.cc:492] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:09.607612  7952 tablet_bootstrap.cc:654] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.611162  7795 leader_election.cc:304] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:09.618543  7950 tablet_bootstrap.cc:492] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:09.619099  7950 ts_tablet_manager.cc:1403] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.000s
I20260709 13:00:09.619554  7948 tablet_bootstrap.cc:654] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.623831  7576 catalog_manager.cc:5697] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:09.626967  7950 raft_consensus.cc:359] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.633337  7950 raft_consensus.cc:385] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.633754  7950 raft_consensus.cc:740] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.634656  7950 consensus_queue.cc:260] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.637095  7950 ts_tablet_manager.cc:1434] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:00:09.641695  7950 tablet_bootstrap.cc:492] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:09.645599  8018 raft_consensus.cc:2749] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.613727  8075 consensus_queue.cc:237] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.657380  7949 tablet_bootstrap.cc:492] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:09.658030  7949 ts_tablet_manager.cc:1403] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.147s	user 0.037s	sys 0.055s
I20260709 13:00:09.660846  7949 raft_consensus.cc:359] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.661581  7949 raft_consensus.cc:385] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.661947  7949 raft_consensus.cc:740] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.662667  7949 consensus_queue.cc:260] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.670876  7949 ts_tablet_manager.cc:1434] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:00:09.671970  7949 tablet_bootstrap.cc:492] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:09.668529  8025 raft_consensus.cc:515] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.684183  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf003a44a8d49479fbe48301e5681b5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
W20260709 13:00:09.685776  7718 leader_election.cc:343] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.689170  7578 catalog_manager.cc:5697] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.691429  7952 tablet_bootstrap.cc:492] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:09.692006  7952 ts_tablet_manager.cc:1403] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.011s
I20260709 13:00:09.694037  8025 leader_election.cc:290] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:09.695595  7952 raft_consensus.cc:359] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.696274  7952 raft_consensus.cc:385] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.696535  7952 raft_consensus.cc:740] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.697333  7952 consensus_queue.cc:260] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.698313  7948 tablet_bootstrap.cc:492] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:09.698843  7948 ts_tablet_manager.cc:1403] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.009s
I20260709 13:00:09.699954  7952 ts_tablet_manager.cc:1434] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:00:09.700325  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf003a44a8d49479fbe48301e5681b5" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:09.700930  7952 tablet_bootstrap.cc:492] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:09.701107  7901 raft_consensus.cc:3060] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.701942  7948 raft_consensus.cc:359] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.702696  7948 raft_consensus.cc:385] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.702994  7948 raft_consensus.cc:740] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.703896  7948 consensus_queue.cc:260] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.706120  7948 ts_tablet_manager.cc:1434] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:09.707046  7948 tablet_bootstrap.cc:492] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:09.707721  7952 tablet_bootstrap.cc:654] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.709766  7950 tablet_bootstrap.cc:654] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.713106  7948 tablet_bootstrap.cc:654] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.715224  7949 tablet_bootstrap.cc:654] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.712957  7576 catalog_manager.cc:5697] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:09.720871  7950 tablet_bootstrap.cc:492] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:09.722097  7950 ts_tablet_manager.cc:1403] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.000s
I20260709 13:00:09.726843  7901 raft_consensus.cc:2468] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:09.727149  7950 raft_consensus.cc:359] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.731688  7950 raft_consensus.cc:385] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.732017  7950 raft_consensus.cc:740] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.730371  7948 tablet_bootstrap.cc:492] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:09.733031  7948 ts_tablet_manager.cc:1403] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.007s
I20260709 13:00:09.732627  7720 leader_election.cc:304] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:09.734390  8025 raft_consensus.cc:2804] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.734985  8025 raft_consensus.cc:697] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:09.736081  8025 consensus_queue.cc:237] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.736083  7948 raft_consensus.cc:359] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.737856  7948 raft_consensus.cc:385] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.738131  7948 raft_consensus.cc:740] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.738904  7948 consensus_queue.cc:260] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.736356  7950 consensus_queue.cc:260] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.741956  8089 consensus_queue.cc:1048] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:09.742607  7950 ts_tablet_manager.cc:1434] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:00:09.743664  7950 tablet_bootstrap.cc:492] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:09.749940  7950 tablet_bootstrap.cc:654] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.753539  7948 ts_tablet_manager.cc:1434] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:00:09.754642  7948 tablet_bootstrap.cc:492] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:09.754732  7949 tablet_bootstrap.cc:492] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:09.755379  7949 ts_tablet_manager.cc:1403] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.015s
I20260709 13:00:09.758369  7949 raft_consensus.cc:359] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.759019  7949 raft_consensus.cc:385] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.759279  7949 raft_consensus.cc:740] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.761626  7949 consensus_queue.cc:260] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.763835  7949 ts_tablet_manager.cc:1434] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:00:09.764132  7948 tablet_bootstrap.cc:654] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.767485  7952 tablet_bootstrap.cc:492] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:09.768043  7952 ts_tablet_manager.cc:1403] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.024s
I20260709 13:00:09.770267  7952 raft_consensus.cc:359] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.770807  7952 raft_consensus.cc:385] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.771041  7952 raft_consensus.cc:740] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.770030  7574 catalog_manager.cc:5697] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:09.771724  7952 consensus_queue.cc:260] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.773146  7952 ts_tablet_manager.cc:1434] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:09.773394  7983 consensus_queue.cc:1048] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:09.774075  7952 tablet_bootstrap.cc:492] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:09.774704  7948 tablet_bootstrap.cc:492] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:09.775231  7948 ts_tablet_manager.cc:1403] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.004s
I20260709 13:00:09.777264  8018 raft_consensus.cc:493] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.777797  8018 raft_consensus.cc:515] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.779891  8018 leader_election.cc:290] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:09.780264  7952 tablet_bootstrap.cc:654] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.781219  7948 raft_consensus.cc:359] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.781994  7948 raft_consensus.cc:385] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.782264  7948 raft_consensus.cc:740] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.782960  7948 consensus_queue.cc:260] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.784803  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf003a44a8d49479fbe48301e5681b5" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:09.785149  7948 ts_tablet_manager.cc:1434] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:00:09.785920  7903 raft_consensus.cc:2393] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate 99e4e009f2884c8d9f7239b5375ab730 in this term.
I20260709 13:00:09.786206  7948 tablet_bootstrap.cc:492] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:09.788205  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf003a44a8d49479fbe48301e5681b5" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.789746  7795 leader_election.cc:304] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:09.790876  8018 raft_consensus.cc:3060] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.792501  7983 consensus_queue.cc:1048] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:09.800983  8075 raft_consensus.cc:493] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.801522  8075 raft_consensus.cc:515] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.802364  8018 raft_consensus.cc:2749] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.804207  8075 leader_election.cc:290] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:09.806201  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3aa569bb2f4c58bc92f779a43caad0" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.807174  7755 raft_consensus.cc:2468] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:09.806357  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3aa569bb2f4c58bc92f779a43caad0" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:09.810429  7869 leader_election.cc:304] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:09.811743  8075 raft_consensus.cc:2804] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.812626  8075 raft_consensus.cc:493] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.813442  8075 raft_consensus.cc:3060] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.813585  7948 tablet_bootstrap.cc:654] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:09.813920  7867 leader_election.cc:343] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.828107  8018 raft_consensus.cc:493] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.828756  8018 raft_consensus.cc:515] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.830945  8018 leader_election.cc:290] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:09.832768  7949 tablet_bootstrap.cc:492] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:09.834105  8075 raft_consensus.cc:515] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.839679  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:09.843173  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.844167  7755 raft_consensus.cc:2393] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate f91d8d830a474ea7a101fc5b6f920544 in this term.
I20260709 13:00:09.845510  8075 leader_election.cc:290] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:09.845619  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3aa569bb2f4c58bc92f779a43caad0" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:09.846568  7755 raft_consensus.cc:3060] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.850832  7949 tablet_bootstrap.cc:654] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.857594  7793 leader_election.cc:304] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:09.859745  8066 raft_consensus.cc:3060] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.861552  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3aa569bb2f4c58bc92f779a43caad0" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:09.864241  7828 raft_consensus.cc:3060] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:09.865029  7867 leader_election.cc:343] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.866108  7950 tablet_bootstrap.cc:492] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:09.866663  7950 ts_tablet_manager.cc:1403] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.034s
I20260709 13:00:09.869874  7755 raft_consensus.cc:2468] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:09.870630  7950 raft_consensus.cc:359] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.871413  7950 raft_consensus.cc:385] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.871268  7869 leader_election.cc:304] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:09.871757  7950 raft_consensus.cc:740] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.869879  8088 raft_consensus.cc:493] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.873936  8088 raft_consensus.cc:515] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.873313  7950 consensus_queue.cc:260] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.875954  8122 raft_consensus.cc:2804] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.876533  8122 raft_consensus.cc:697] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:09.877807  7950 ts_tablet_manager.cc:1434] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:00:09.877455  8122 consensus_queue.cc:237] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.878113  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541510a88d1f44cdb6156324aa747e96" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:09.880762  7950 tablet_bootstrap.cc:492] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:09.880724  8088 leader_election.cc:290] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:09.889441  7680 raft_consensus.cc:3060] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.893672  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541510a88d1f44cdb6156324aa747e96" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.894519  7755 raft_consensus.cc:2393] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f91d8d830a474ea7a101fc5b6f920544 in current term 1: Already voted for candidate 98b07c9e416d4e32a62431b41b1fefa7 in this term.
I20260709 13:00:09.896194  7646 leader_election.cc:304] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:09.888195  8066 raft_consensus.cc:2749] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.905895  7950 tablet_bootstrap.cc:654] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.913569  8027 raft_consensus.cc:493] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.914124  8027 raft_consensus.cc:515] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.915994  7983 consensus_queue.cc:1048] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:09.917385  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:09.918488  8122 raft_consensus.cc:493] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.925527  8122 raft_consensus.cc:515] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:09.924969  7752 raft_consensus.cc:2468] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:09.928131  8027 leader_election.cc:290] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:09.928212  7646 leader_election.cc:304] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:09.929482  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:09.929529  7957 raft_consensus.cc:2804] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.930783  7957 raft_consensus.cc:493] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.931113  7957 raft_consensus.cc:3060] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:09.933054  7643 leader_election.cc:343] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.935269  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fade69c67ff4012b5e46a32966edb24" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:09.936187  7677 raft_consensus.cc:2468] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:09.938058  7867 leader_election.cc:304] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:09.938745  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fade69c67ff4012b5e46a32966edb24" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:09.939155  8114 consensus_queue.cc:1048] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:09.941170  8114 raft_consensus.cc:2804] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.941632  8114 raft_consensus.cc:493] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.942094  8114 raft_consensus.cc:3060] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:09.946552  7866 leader_election.cc:343] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.953619  7952 tablet_bootstrap.cc:492] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:09.954324  7952 ts_tablet_manager.cc:1403] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.180s	user 0.028s	sys 0.034s
I20260709 13:00:09.954928  7990 raft_consensus.cc:493] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.955660  7990 raft_consensus.cc:515] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:09.958022  7952 raft_consensus.cc:359] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.959558  7952 raft_consensus.cc:385] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.959813  7952 raft_consensus.cc:740] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.960589  7952 consensus_queue.cc:260] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:09.961154  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445db6ed81c14979a6b26e0045cf7c13" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:09.963636  7990 leader_election.cc:290] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:09.964818  7952 ts_tablet_manager.cc:1434] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:00:09.965801  7952 tablet_bootstrap.cc:492] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:09.965528  7957 raft_consensus.cc:515] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:09.966598  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445db6ed81c14979a6b26e0045cf7c13" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
W20260709 13:00:09.968106  7718 leader_election.cc:343] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:09.975571  8088 raft_consensus.cc:2749] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:09.986580  7903 raft_consensus.cc:2468] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:09.988423  7720 leader_election.cc:304] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:09.989264  7957 leader_election.cc:290] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:09.989435  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:09.990012  7755 raft_consensus.cc:3060] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.990936  8075 consensus_queue.cc:1048] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:09.991072  7990 raft_consensus.cc:2804] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:09.991789  7990 raft_consensus.cc:493] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.992362  7990 raft_consensus.cc:3060] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.996031  7755 raft_consensus.cc:2468] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:09.984879  7949 tablet_bootstrap.cc:492] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:09.999963  7949 ts_tablet_manager.cc:1403] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.001s
I20260709 13:00:09.982277  8122 leader_election.cc:290] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:09.998663  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:10.003947  7950 tablet_bootstrap.cc:492] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:10.004592  7950 ts_tablet_manager.cc:1403] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.029s
I20260709 13:00:10.004788  7952 tablet_bootstrap.cc:654] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.005242  7646 leader_election.cc:304] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:10.006268  8088 raft_consensus.cc:2804] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.006784  8088 raft_consensus.cc:697] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:10.007614  7950 raft_consensus.cc:359] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.007813  8088 consensus_queue.cc:237] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.008421  7950 raft_consensus.cc:385] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.010651  7950 raft_consensus.cc:740] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.011538  8025 raft_consensus.cc:493] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.012063  8025 raft_consensus.cc:515] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.014473  8025 leader_election.cc:290] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
W20260709 13:00:10.012353  7643 leader_election.cc:343] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.011252  7950 consensus_queue.cc:260] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.022756  7950 ts_tablet_manager.cc:1434] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:00:10.038379  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:10.039183  7950 tablet_bootstrap.cc:492] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:10.042878  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:10.043828  7903 raft_consensus.cc:2393] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99e4e009f2884c8d9f7239b5375ab730 in current term 1: Already voted for candidate f91d8d830a474ea7a101fc5b6f920544 in this term.
I20260709 13:00:10.046531  7720 leader_election.cc:304] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:10.048859  7950 tablet_bootstrap.cc:654] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.049785  8025 raft_consensus.cc:3060] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.080339  7952 tablet_bootstrap.cc:492] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:10.081319  7952 ts_tablet_manager.cc:1403] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.116s	user 0.008s	sys 0.011s
I20260709 13:00:10.080691  8114 raft_consensus.cc:515] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.092271  8025 raft_consensus.cc:2749] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.088815  8122 consensus_queue.cc:1048] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.099386  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fade69c67ff4012b5e46a32966edb24" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
W20260709 13:00:10.090641  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:10.086059  7952 raft_consensus.cc:359] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.094602  7948 tablet_bootstrap.cc:492] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:10.096179  7990 raft_consensus.cc:515] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.096591  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fade69c67ff4012b5e46a32966edb24" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:10.106714  7990 leader_election.cc:290] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:10.108108  7957 consensus_queue.cc:1048] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:10.097067  7949 raft_consensus.cc:359] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.109944  7949 raft_consensus.cc:385] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.109338  7574 catalog_manager.cc:5697] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.110250  7677 raft_consensus.cc:3060] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.116770  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445db6ed81c14979a6b26e0045cf7c13" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:10.100361  8114 leader_election.cc:290] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:10.100724  7952 raft_consensus.cc:385] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.101003  7948 ts_tablet_manager.cc:1403] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.315s	user 0.047s	sys 0.066s
I20260709 13:00:10.110246  7949 raft_consensus.cc:740] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
W20260709 13:00:10.123461  7718 leader_election.cc:343] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.123749  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445db6ed81c14979a6b26e0045cf7c13" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:10.124362  7903 raft_consensus.cc:3060] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.120245  7952 raft_consensus.cc:740] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.127800  7952 consensus_queue.cc:260] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.129681  7949 consensus_queue.cc:260] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.136988  7827 raft_consensus.cc:3060] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.138291  7949 ts_tablet_manager.cc:1434] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.138s	user 0.006s	sys 0.000s
I20260709 13:00:10.138135  8122 consensus_queue.cc:1048] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.139281  7949 tablet_bootstrap.cc:492] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:10.139788  7903 raft_consensus.cc:2468] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:10.142414  8088 consensus_queue.cc:1048] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.146791  7827 raft_consensus.cc:2468] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:10.151218  7949 tablet_bootstrap.cc:654] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.150375  8114 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.151258  7952 ts_tablet_manager.cc:1434] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:00:10.163734  7952 tablet_bootstrap.cc:492] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:10.155619  7720 leader_election.cc:304] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:10.166363  7866 leader_election.cc:304] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:10.170351  7948 raft_consensus.cc:359] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.172407  7948 raft_consensus.cc:385] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.173229  8122 raft_consensus.cc:2804] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.173784  8122 raft_consensus.cc:697] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:10.174794  8122 consensus_queue.cc:237] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.165548  7983 consensus_queue.cc:1048] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:00:10.173231  7990 raft_consensus.cc:2804] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.176990  7990 raft_consensus.cc:697] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:10.177666  7950 tablet_bootstrap.cc:492] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:10.172758  7948 raft_consensus.cc:740] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.178215  7950 ts_tablet_manager.cc:1403] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.139s	user 0.018s	sys 0.021s
I20260709 13:00:10.177788  7990 consensus_queue.cc:237] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.178570  7948 consensus_queue.cc:260] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.181433  7948 ts_tablet_manager.cc:1434] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:00:10.181346  7950 raft_consensus.cc:359] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.165757  8114 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.182147  7950 raft_consensus.cc:385] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.182520  7948 tablet_bootstrap.cc:492] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:10.182464  7950 raft_consensus.cc:740] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.187203  7950 consensus_queue.cc:260] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.189474  7983 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.189790  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:10.190021  7983 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.190925  8114 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:10.192222  7983 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:10.166028  7677 raft_consensus.cc:2468] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:10.200898  7950 ts_tablet_manager.cc:1434] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:00:10.201937  7950 tablet_bootstrap.cc:492] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:10.206117  7952 tablet_bootstrap.cc:654] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.203193  7575 catalog_manager.cc:5697] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.229001  7680 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:10.247244  7948 tablet_bootstrap.cc:654] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.241653  7983 consensus_queue.cc:1048] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:00:10.240296  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:10.248782  7957 raft_consensus.cc:493] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.248219  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:10.256398  7957 raft_consensus.cc:515] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.256857  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
W20260709 13:00:10.258407  7869 leader_election.cc:343] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.258617  7957 leader_election.cc:290] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:10.260496  7949 tablet_bootstrap.cc:492] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:10.261474  7949 ts_tablet_manager.cc:1403] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.014s
I20260709 13:00:10.264580  7952 tablet_bootstrap.cc:492] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:10.265152  7952 ts_tablet_manager.cc:1403] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.102s	user 0.019s	sys 0.000s
I20260709 13:00:10.260226  7903 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:10.269016  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3aa569bb2f4c58bc92f779a43caad0" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:10.276757  7949 raft_consensus.cc:359] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.277541  7949 raft_consensus.cc:385] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.277864  7949 raft_consensus.cc:740] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.278064  7867 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:10.278887  8114 raft_consensus.cc:2804] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.279276  8114 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.279606  8114 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.285064  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3aa569bb2f4c58bc92f779a43caad0" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:10.286271  7753 raft_consensus.cc:2393] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f91d8d830a474ea7a101fc5b6f920544 in current term 1: Already voted for candidate 98b07c9e416d4e32a62431b41b1fefa7 in this term.
I20260709 13:00:10.286700  8017 raft_consensus.cc:493] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.287186  8017 raft_consensus.cc:515] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.288734  8025 raft_consensus.cc:493] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.268479  7645 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:10.289319  8017 leader_election.cc:290] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:10.289232  8025 raft_consensus.cc:515] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:10.290709  7646 leader_election.cc:343] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.291329  8025 leader_election.cc:290] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:10.292351  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:10.293526  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:10.294831  7950 tablet_bootstrap.cc:654] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:10.295142  7866 leader_election.cc:343] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:10.296012  7718 leader_election.cc:343] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.297482  8017 consensus_queue.cc:1048] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.278682  7949 consensus_queue.cc:260] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.300040  8114 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.302099  8089 raft_consensus.cc:2804] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.302672  8089 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.303114  8089 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.304497  7949 ts_tablet_manager.cc:1434] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:00:10.307209  7949 tablet_bootstrap.cc:492] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:10.307502  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
W20260709 13:00:10.313994  7869 leader_election.cc:343] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.314888  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:10.316788  7952 raft_consensus.cc:359] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.318471  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:10.320773  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
W20260709 13:00:10.322443  7867 leader_election.cc:343] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.323132  7867 leader_election.cc:304] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:10.324669  8018 raft_consensus.cc:493] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.325330  8018 raft_consensus.cc:515] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.317479  7952 raft_consensus.cc:385] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.327107  7952 raft_consensus.cc:740] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.328720  7952 consensus_queue.cc:260] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.330447  7983 raft_consensus.cc:493] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.330950  7983 raft_consensus.cc:515] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.335018  8018 leader_election.cc:290] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:10.336541  7645 leader_election.cc:304] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
W20260709 13:00:10.340345  7719 leader_election.cc:343] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.341027  7719 leader_election.cc:304] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:10.341804  8088 raft_consensus.cc:3060] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.346339  8025 raft_consensus.cc:2749] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.325986  8089 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.349309  7990 consensus_queue.cc:1048] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.351030  8089 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:10.353199  7677 raft_consensus.cc:2393] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b07c9e416d4e32a62431b41b1fefa7 in current term 1: Already voted for candidate f91d8d830a474ea7a101fc5b6f920544 in this term.
I20260709 13:00:10.358865  7949 tablet_bootstrap.cc:654] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.359398  8088 raft_consensus.cc:2749] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.359890  7952 ts_tablet_manager.cc:1434] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.000s
I20260709 13:00:10.362874  7952 tablet_bootstrap.cc:492] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:10.370522  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:10.371703  7754 raft_consensus.cc:2393] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate f91d8d830a474ea7a101fc5b6f920544 in this term.
I20260709 13:00:10.382899  7983 leader_election.cc:290] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:10.384008  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:10.385867  7643 leader_election.cc:343] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.387414  7952 tablet_bootstrap.cc:654] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.345507  8017 raft_consensus.cc:2749] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.392730  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:10.395558  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:10.396337  7751 raft_consensus.cc:2468] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:10.403503  7990 raft_consensus.cc:493] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.404069  7990 raft_consensus.cc:515] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.406374  7990 leader_election.cc:290] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:10.408486  8025 consensus_queue.cc:1048] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:10.408846  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64552f3c8f4af381c7ea6596d7f3ff" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:10.412292  7718 leader_election.cc:343] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.407039  7867 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:10.415134  8017 raft_consensus.cc:2749] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.307507  8114 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:10.440796  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64552f3c8f4af381c7ea6596d7f3ff" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:10.452005  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:10.468272  7948 tablet_bootstrap.cc:492] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:10.468854  7948 ts_tablet_manager.cc:1403] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.287s	user 0.013s	sys 0.000s
I20260709 13:00:10.471583  7948 raft_consensus.cc:359] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.472229  7948 raft_consensus.cc:385] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:10.461906  7646 leader_election.cc:343] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:10.464294  7720 leader_election.cc:343] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.475010  7720 leader_election.cc:304] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:10.476135  8138 raft_consensus.cc:2749] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.472523  7948 raft_consensus.cc:740] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.479660  7646 leader_election.cc:304] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:10.480400  7948 consensus_queue.cc:260] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.482168  7983 raft_consensus.cc:2804] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.482335  7949 tablet_bootstrap.cc:492] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:10.482614  7948 ts_tablet_manager.cc:1434] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:00:10.482633  7983 raft_consensus.cc:493] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.482932  7949 ts_tablet_manager.cc:1403] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.176s	user 0.014s	sys 0.004s
I20260709 13:00:10.483210  7983 raft_consensus.cc:3060] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.484549  7950 tablet_bootstrap.cc:492] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:10.485081  7950 ts_tablet_manager.cc:1403] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.283s	user 0.029s	sys 0.010s
I20260709 13:00:10.487785  7950 raft_consensus.cc:359] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.488435  7950 raft_consensus.cc:385] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.489953  7948 tablet_bootstrap.cc:492] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:10.490834  7949 raft_consensus.cc:359] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.491518  7949 raft_consensus.cc:385] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.491783  7949 raft_consensus.cc:740] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.492384  7949 consensus_queue.cc:260] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.494907  7949 ts_tablet_manager.cc:1434] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:00:10.495847  7949 tablet_bootstrap.cc:492] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:10.488734  7950 raft_consensus.cc:740] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.496680  7948 tablet_bootstrap.cc:654] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.499105  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:10.497843  7950 consensus_queue.cc:260] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.499939  7903 raft_consensus.cc:2393] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f91d8d830a474ea7a101fc5b6f920544 in current term 1: Already voted for candidate 98b07c9e416d4e32a62431b41b1fefa7 in this term.
I20260709 13:00:10.501718  7950 ts_tablet_manager.cc:1434] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:00:10.502405  7949 tablet_bootstrap.cc:654] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.502765  7950 tablet_bootstrap.cc:492] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:10.503152  7793 leader_election.cc:304] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:10.504817  8066 raft_consensus.cc:3060] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.509449  7950 tablet_bootstrap.cc:654] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.501561  7983 raft_consensus.cc:515] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.512804  7952 tablet_bootstrap.cc:492] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:10.513329  7952 ts_tablet_manager.cc:1403] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.001s
I20260709 13:00:10.517738  7948 tablet_bootstrap.cc:492] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:10.519989  7948 ts_tablet_manager.cc:1403] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:00:10.521572  7952 raft_consensus.cc:359] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.522301  7952 raft_consensus.cc:385] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.522563  7952 raft_consensus.cc:740] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.522641  7948 raft_consensus.cc:359] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.523278  7948 raft_consensus.cc:385] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.523221  7952 consensus_queue.cc:260] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.523646  7948 raft_consensus.cc:740] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.524417  7948 consensus_queue.cc:260] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.526365  7948 ts_tablet_manager.cc:1434] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:10.527163  7948 tablet_bootstrap.cc:492] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:10.532677  7645 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:10.539345  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:10.538234  8114 consensus_queue.cc:1048] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.540980  8089 raft_consensus.cc:2749] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:00:10.543188  7643 leader_election.cc:343] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.544129  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:10.544744  7753 raft_consensus.cc:3060] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.531026  7575 catalog_manager.cc:5697] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.549109  7952 ts_tablet_manager.cc:1434] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:00:10.553992  7952 tablet_bootstrap.cc:492] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:10.554515  7950 tablet_bootstrap.cc:492] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:10.555027  7950 ts_tablet_manager.cc:1403] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.003s
I20260709 13:00:10.556838  7753 raft_consensus.cc:2468] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:10.534118  7948 tablet_bootstrap.cc:654] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.560272  7646 leader_election.cc:304] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:10.561228  8027 raft_consensus.cc:2804] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.557749  7950 raft_consensus.cc:359] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.561674  8027 raft_consensus.cc:697] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:10.562063  7950 raft_consensus.cc:385] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.562361  7950 raft_consensus.cc:740] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.562731  8027 consensus_queue.cc:237] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.563068  7950 consensus_queue.cc:260] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.565420  7950 ts_tablet_manager.cc:1434] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:00:10.566157  7952 tablet_bootstrap.cc:654] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.566408  7950 tablet_bootstrap.cc:492] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:10.569032  7574 catalog_manager.cc:5697] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.539004  7983 leader_election.cc:290] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:10.575968  8066 raft_consensus.cc:2749] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.580525  7950 tablet_bootstrap.cc:654] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.583287  7948 tablet_bootstrap.cc:492] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:10.597153  7948 ts_tablet_manager.cc:1403] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.006s
I20260709 13:00:10.600893  7948 raft_consensus.cc:359] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.601882  7948 raft_consensus.cc:385] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.602309  7948 raft_consensus.cc:740] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.603205  7948 consensus_queue.cc:260] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.587481  7952 tablet_bootstrap.cc:492] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:10.605023  7952 ts_tablet_manager.cc:1403] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.000s
I20260709 13:00:10.594750  8017 consensus_queue.cc:1048] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:10.613466  7983 consensus_queue.cc:1048] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:10.615777  7952 raft_consensus.cc:359] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.617941  7952 raft_consensus.cc:385] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.618304  7952 raft_consensus.cc:740] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.619706  7952 consensus_queue.cc:260] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.625352  7828 raft_consensus.cc:3060] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.625397  7950 tablet_bootstrap.cc:492] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:10.630432  7952 ts_tablet_manager.cc:1434] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:00:10.630688  7950 ts_tablet_manager.cc:1403] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.010s
I20260709 13:00:10.631815  7952 tablet_bootstrap.cc:492] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:10.641525  7948 ts_tablet_manager.cc:1434] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 13:00:10.643391  7948 tablet_bootstrap.cc:492] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:10.659303  7949 tablet_bootstrap.cc:492] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:10.659837  7949 ts_tablet_manager.cc:1403] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.164s	user 0.061s	sys 0.042s
I20260709 13:00:10.661300  8122 consensus_queue.cc:1048] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.662681  7952 tablet_bootstrap.cc:654] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.663270  7949 raft_consensus.cc:359] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.663328  7950 raft_consensus.cc:359] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.663982  7949 raft_consensus.cc:385] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.664177  7950 raft_consensus.cc:385] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.677678  8017 raft_consensus.cc:493] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.664287  7949 raft_consensus.cc:740] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.679805  7949 consensus_queue.cc:260] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.664816  7950 raft_consensus.cc:740] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.694721  7983 consensus_queue.cc:1048] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.712630  7948 tablet_bootstrap.cc:654] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.713028  8017 raft_consensus.cc:515] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.680028  7990 consensus_queue.cc:1048] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:00:10.713805  7950 consensus_queue.cc:260] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.732065  7949 ts_tablet_manager.cc:1434] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.072s	user 0.010s	sys 0.002s
I20260709 13:00:10.736498  7949 tablet_bootstrap.cc:492] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:10.746950  7575 catalog_manager.cc:5697] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.750388  7950 ts_tablet_manager.cc:1434] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.118s	user 0.008s	sys 0.003s
I20260709 13:00:10.751663  7950 tablet_bootstrap.cc:492] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:10.752858  7990 consensus_queue.cc:1048] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.755100  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe505815234b019c30d15aac38e187" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:10.769096  8017 leader_election.cc:290] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:10.769335  7867 leader_election.cc:343] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.794293  7948 tablet_bootstrap.cc:492] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:10.794865  7948 ts_tablet_manager.cc:1403] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.001s
I20260709 13:00:10.796798  7957 raft_consensus.cc:493] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.797588  7957 raft_consensus.cc:515] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.798372  8066 raft_consensus.cc:493] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.798887  8066 raft_consensus.cc:515] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.800078  7957 leader_election.cc:290] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:10.803576  7952 tablet_bootstrap.cc:492] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
W20260709 13:00:10.803910  8190 log.cc:927] Time spent T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:00:10.804129  7952 ts_tablet_manager.cc:1403] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.013s
I20260709 13:00:10.805061  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe505815234b019c30d15aac38e187" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
W20260709 13:00:10.810701  7869 leader_election.cc:343] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.811172  7869 leader_election.cc:304] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:10.813470  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:10.814605  8075 raft_consensus.cc:2749] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.817679  7949 tablet_bootstrap.cc:654] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.813467  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:10.818246  7754 raft_consensus.cc:2468] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:10.820971  7990 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.821513  7990 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.822329  8025 raft_consensus.cc:493] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.822804  8025 raft_consensus.cc:515] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.823812  7990 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:10.824463  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:10.824892  8025 leader_election.cc:290] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:10.825728  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694bf015fc134546a01f1750539a8cf8" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:10.821969  7952 raft_consensus.cc:359] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.827267  7952 raft_consensus.cc:385] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.827399  8066 leader_election.cc:290] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:10.827585  7952 raft_consensus.cc:740] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
W20260709 13:00:10.827711  7718 leader_election.cc:343] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.828343  7952 consensus_queue.cc:260] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
W20260709 13:00:10.826452  7643 leader_election.cc:343] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.829026  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:10.829397  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:10.830066  7753 raft_consensus.cc:2393] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate f91d8d830a474ea7a101fc5b6f920544 in this term.
I20260709 13:00:10.830238  7902 raft_consensus.cc:2393] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99e4e009f2884c8d9f7239b5375ab730 in current term 1: Already voted for candidate 98b07c9e416d4e32a62431b41b1fefa7 in this term.
I20260709 13:00:10.832587  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:10.834405  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694bf015fc134546a01f1750539a8cf8" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
W20260709 13:00:10.835754  7720 leader_election.cc:343] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.836232  7720 leader_election.cc:304] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:10.835935  7795 leader_election.cc:304] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:10.833457  7677 raft_consensus.cc:2393] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99e4e009f2884c8d9f7239b5375ab730 in current term 1: Already voted for candidate f91d8d830a474ea7a101fc5b6f920544 in this term.
I20260709 13:00:10.837834  7990 raft_consensus.cc:2749] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.838828  7948 raft_consensus.cc:359] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.839529  7948 raft_consensus.cc:385] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.841174  7950 tablet_bootstrap.cc:654] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.841625  7719 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:10.843422  7990 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.844897  8066 raft_consensus.cc:3060] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.850617  7646 leader_election.cc:304] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:10.853363  7983 raft_consensus.cc:2804] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.853901  7983 raft_consensus.cc:493] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.854332  7983 raft_consensus.cc:3060] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.855407  7952 ts_tablet_manager.cc:1434] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:00:10.839818  7948 raft_consensus.cc:740] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.861795  7952 tablet_bootstrap.cc:492] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:10.861327  7948 consensus_queue.cc:260] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.872113  7948 ts_tablet_manager.cc:1434] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:00:10.873905  7948 tablet_bootstrap.cc:492] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:10.871912  8066 raft_consensus.cc:2749] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.892603  7983 raft_consensus.cc:515] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.895859  7957 raft_consensus.cc:493] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.896587  7957 raft_consensus.cc:515] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.897604  7983 leader_election.cc:290] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:10.900323  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
W20260709 13:00:10.902113  7643 leader_election.cc:343] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.904147  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:10.904343  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:10.904969  7754 raft_consensus.cc:3060] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:10.905942  7643 leader_election.cc:343] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.906603  7948 tablet_bootstrap.cc:654] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.907114  7957 leader_election.cc:290] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:10.907227  8017 raft_consensus.cc:493] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.907868  8017 raft_consensus.cc:515] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.908998  7949 tablet_bootstrap.cc:492] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:10.909528  7949 ts_tablet_manager.cc:1403] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.173s	user 0.030s	sys 0.038s
I20260709 13:00:10.911759  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64552f3c8f4af381c7ea6596d7f3ff" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:10.912477  7753 raft_consensus.cc:2468] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:10.913919  7950 tablet_bootstrap.cc:492] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:10.922103  7948 tablet_bootstrap.cc:492] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:10.922232  7950 ts_tablet_manager.cc:1403] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.028s
I20260709 13:00:10.922616  7948 ts_tablet_manager.cc:1403] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 13:00:10.916183  7952 tablet_bootstrap.cc:654] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.900553  7990 raft_consensus.cc:2749] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.916513  7754 raft_consensus.cc:2468] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:10.921857  8017 leader_election.cc:290] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:10.925371  7950 raft_consensus.cc:359] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.926154  7950 raft_consensus.cc:385] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.926471  7950 raft_consensus.cc:740] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.912485  7949 raft_consensus.cc:359] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.911782  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:10.921857  7869 leader_election.cc:304] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:10.927466  7950 consensus_queue.cc:260] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:10.928777  8017 raft_consensus.cc:2804] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.927802  7903 raft_consensus.cc:2468] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:10.927542  7949 raft_consensus.cc:385] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.929467  7948 raft_consensus.cc:359] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.929968  7949 raft_consensus.cc:740] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.930171  7948 raft_consensus.cc:385] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.930536  7948 raft_consensus.cc:740] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.930869  7645 leader_election.cc:304] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:10.930814  7949 consensus_queue.cc:260] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.931231  7948 consensus_queue.cc:260] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.933420  7948 ts_tablet_manager.cc:1434] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:10.934273  8017 raft_consensus.cc:493] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.935497  8017 raft_consensus.cc:3060] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.939265  7646 leader_election.cc:304] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:10.940828  8089 raft_consensus.cc:2804] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.941375  8089 raft_consensus.cc:697] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:10.914810  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64552f3c8f4af381c7ea6596d7f3ff" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:10.942329  8089 consensus_queue.cc:237] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:10.944072  8017 raft_consensus.cc:515] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
W20260709 13:00:10.945621  7866 leader_election.cc:343] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.947253  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64552f3c8f4af381c7ea6596d7f3ff" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:10.947923  7754 raft_consensus.cc:3060] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.934435  7950 ts_tablet_manager.cc:1434] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:10.949913  8017 leader_election.cc:290] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:10.934811  7957 raft_consensus.cc:2804] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.953364  7950 tablet_bootstrap.cc:492] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:10.955587  7754 raft_consensus.cc:2468] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:10.956912  7869 leader_election.cc:304] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:10.935096  7949 ts_tablet_manager.cc:1434] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.004s
I20260709 13:00:10.958557  7949 tablet_bootstrap.cc:492] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:10.959566  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64552f3c8f4af381c7ea6596d7f3ff" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
W20260709 13:00:10.960958  7866 leader_election.cc:343] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.964864  8017 raft_consensus.cc:2804] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.965826  8017 raft_consensus.cc:697] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:10.969246  7983 consensus_queue.cc:1048] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.966775  8017 consensus_queue.cc:237] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:10.973963  7957 raft_consensus.cc:493] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.974103  8075 raft_consensus.cc:493] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.974467  7957 raft_consensus.cc:3060] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.974761  8075 raft_consensus.cc:515] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:10.977046  7949 tablet_bootstrap.cc:654] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.978297  7950 tablet_bootstrap.cc:654] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.980914  7948 tablet_bootstrap.cc:492] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:10.993355  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4953a51e627b477992fa1569ba01e121" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:10.997819  8075 leader_election.cc:290] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:10.999838  7575 catalog_manager.cc:5697] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.002183  7957 raft_consensus.cc:515] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.012532  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:11.012562  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4953a51e627b477992fa1569ba01e121" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:11.013504  7827 raft_consensus.cc:3060] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:10.997865  7866 leader_election.cc:343] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:11.018697  7867 leader_election.cc:343] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.020905  7867 leader_election.cc:304] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:11.022776  8075 raft_consensus.cc:2749] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.022898  7957 leader_election.cc:290] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:11.024569  7827 raft_consensus.cc:2468] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:11.028970  7643 leader_election.cc:304] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:11.029870  7957 raft_consensus.cc:2804] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.031448  7957 raft_consensus.cc:697] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:11.034583  7957 consensus_queue.cc:237] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.042524  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:11.043282  7903 raft_consensus.cc:3060] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.056867  8027 consensus_queue.cc:1048] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.081609  8027 raft_consensus.cc:493] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.082214  8027 raft_consensus.cc:515] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.087566  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:11.090302  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:11.092020  7643 leader_election.cc:343] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:11.093003  7646 leader_election.cc:343] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.093492  7646 leader_election.cc:304] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:11.094478  7983 raft_consensus.cc:2749] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.084470  8027 leader_election.cc:290] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:11.097743  7948 tablet_bootstrap.cc:654] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.100888  7949 tablet_bootstrap.cc:492] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:11.101457  7949 ts_tablet_manager.cc:1403] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.143s	user 0.009s	sys 0.039s
I20260709 13:00:11.102347  7903 raft_consensus.cc:2468] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:11.104595  7949 raft_consensus.cc:359] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.105326  7949 raft_consensus.cc:385] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.105655  7949 raft_consensus.cc:740] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.108757  7950 tablet_bootstrap.cc:492] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:11.105330  7952 tablet_bootstrap.cc:492] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:11.109917  7952 ts_tablet_manager.cc:1403] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.248s	user 0.026s	sys 0.026s
I20260709 13:00:11.109388  7950 ts_tablet_manager.cc:1403] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.156s	user 0.023s	sys 0.025s
I20260709 13:00:11.117415  7950 raft_consensus.cc:359] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.118937  7950 raft_consensus.cc:385] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.118646  7952 raft_consensus.cc:359] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.119228  7950 raft_consensus.cc:740] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.119354  7952 raft_consensus.cc:385] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.119668  7952 raft_consensus.cc:740] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.120098  7950 consensus_queue.cc:260] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.121516  7949 consensus_queue.cc:260] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.125196  7950 ts_tablet_manager.cc:1434] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:00:11.126196  7950 tablet_bootstrap.cc:492] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:11.127547  7952 consensus_queue.cc:260] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.129153  7952 ts_tablet_manager.cc:1434] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:00:11.130057  7952 tablet_bootstrap.cc:492] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:11.131341  7949 ts_tablet_manager.cc:1434] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.004s
I20260709 13:00:11.133134  7949 tablet_bootstrap.cc:492] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:11.138476  7948 tablet_bootstrap.cc:492] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:11.139106  7948 ts_tablet_manager.cc:1403] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.158s	user 0.014s	sys 0.002s
I20260709 13:00:11.142630  7948 raft_consensus.cc:359] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.146509  7948 raft_consensus.cc:385] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.146838  7948 raft_consensus.cc:740] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.144268  7950 tablet_bootstrap.cc:654] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.147692  7948 consensus_queue.cc:260] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.150245  7948 ts_tablet_manager.cc:1434] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:00:11.150717  7949 tablet_bootstrap.cc:654] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.151217  7948 tablet_bootstrap.cc:492] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
W20260709 13:00:11.144717  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:11.152385  7952 tablet_bootstrap.cc:654] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.157322  8017 raft_consensus.cc:493] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.157876  8017 raft_consensus.cc:515] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.158531  7948 tablet_bootstrap.cc:654] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.160281  8017 leader_election.cc:290] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:11.162002  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728e396427a94afb9ff27339bbec3235" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:11.164191  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728e396427a94afb9ff27339bbec3235" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:11.166067  7869 leader_election.cc:343] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.170004  7576 catalog_manager.cc:5697] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.170775  7949 tablet_bootstrap.cc:492] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:11.172840  8017 raft_consensus.cc:493] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.165186  7827 raft_consensus.cc:2468] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:11.167188  7578 catalog_manager.cc:5697] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.174754  7952 tablet_bootstrap.cc:492] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:11.174814  7950 tablet_bootstrap.cc:492] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:11.175985  8017 raft_consensus.cc:515] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.177872  7952 ts_tablet_manager.cc:1403] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.005s
I20260709 13:00:11.177762  7866 leader_election.cc:304] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:11.179289  8017 leader_election.cc:290] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:11.179666  8195 raft_consensus.cc:2804] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.180099  8195 raft_consensus.cc:493] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.180431  8195 raft_consensus.cc:3060] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.180864  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:11.180840  7952 raft_consensus.cc:359] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.181649  7952 raft_consensus.cc:385] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.181946  7952 raft_consensus.cc:740] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
W20260709 13:00:11.182482  7867 leader_election.cc:343] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.177350  7949 ts_tablet_manager.cc:1403] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.002s
I20260709 13:00:11.183279  7950 ts_tablet_manager.cc:1403] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.007s
I20260709 13:00:11.185032  7948 tablet_bootstrap.cc:492] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:11.185478  7948 ts_tablet_manager.cc:1403] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.006s
I20260709 13:00:11.185850  7949 raft_consensus.cc:359] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.186523  7949 raft_consensus.cc:385] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.186760  7949 raft_consensus.cc:740] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.187389  7949 consensus_queue.cc:260] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.182622  7952 consensus_queue.cc:260] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.188174  7948 raft_consensus.cc:359] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.188867  7948 raft_consensus.cc:385] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.201148  7950 raft_consensus.cc:359] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.200979  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:11.202109  7990 raft_consensus.cc:493] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.201960  7950 raft_consensus.cc:385] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.202891  7950 raft_consensus.cc:740] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.202615  7990 raft_consensus.cc:515] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.204636  7952 ts_tablet_manager.cc:1434] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:00:11.204820  7990 leader_election.cc:290] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:11.205654  7952 tablet_bootstrap.cc:492] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
W20260709 13:00:11.205595  7866 leader_election.cc:343] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.206310  7866 leader_election.cc:304] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:11.206718  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:11.207376  7677 raft_consensus.cc:2468] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:11.208774  7719 leader_election.cc:304] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:11.209669  8017 raft_consensus.cc:2749] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.209990  7948 raft_consensus.cc:740] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.210693  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:11.210810  7948 consensus_queue.cc:260] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.209793  7949 ts_tablet_manager.cc:1434] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
W20260709 13:00:11.211951  7718 leader_election.cc:343] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.212555  7949 tablet_bootstrap.cc:492] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:11.209625  7990 raft_consensus.cc:2804] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.213186  7990 raft_consensus.cc:493] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.213531  7990 raft_consensus.cc:3060] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.216017  8195 raft_consensus.cc:515] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.219061  7949 tablet_bootstrap.cc:654] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.223474  7952 tablet_bootstrap.cc:654] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.227730  7948 ts_tablet_manager.cc:1434] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.002s
I20260709 13:00:11.235591  7948 tablet_bootstrap.cc:492] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:11.219022  7950 consensus_queue.cc:260] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.220206  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728e396427a94afb9ff27339bbec3235" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
W20260709 13:00:11.238400  7869 leader_election.cc:343] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.242252  7950 ts_tablet_manager.cc:1434] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 13:00:11.244028  7948 tablet_bootstrap.cc:654] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.246121  7950 tablet_bootstrap.cc:492] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:11.247787  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728e396427a94afb9ff27339bbec3235" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:11.248021  8195 leader_election.cc:290] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:11.248680  7827 raft_consensus.cc:3060] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.258250  7827 raft_consensus.cc:2468] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:11.259495  7866 leader_election.cc:304] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:11.260962  8075 raft_consensus.cc:2804] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.261508  8075 raft_consensus.cc:697] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:11.222043  7990 raft_consensus.cc:515] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.263334  8138 raft_consensus.cc:493] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.263859  8138 raft_consensus.cc:515] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.264400  7990 leader_election.cc:290] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:11.265905  8138 leader_election.cc:290] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:11.266211  7949 tablet_bootstrap.cc:492] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:11.266661  7949 ts_tablet_manager.cc:1403] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 13:00:11.257589  7952 tablet_bootstrap.cc:492] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:11.269023  7952 ts_tablet_manager.cc:1403] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.004s
I20260709 13:00:11.269529  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe505815234b019c30d15aac38e187" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:11.270222  7950 tablet_bootstrap.cc:654] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.271188  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:11.271790  7677 raft_consensus.cc:3060] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.272094  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe505815234b019c30d15aac38e187" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:11.262357  8075 consensus_queue.cc:237] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.273593  7952 raft_consensus.cc:359] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.274856  7952 raft_consensus.cc:385] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.275189  7952 raft_consensus.cc:740] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.270303  7680 raft_consensus.cc:2468] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:11.272014  7949 raft_consensus.cc:359] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.277711  7949 raft_consensus.cc:385] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.272929  7903 raft_consensus.cc:2468] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:11.278404  7949 raft_consensus.cc:740] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.279181  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:11.279736  7949 consensus_queue.cc:260] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.281196  7719 leader_election.cc:304] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:11.284026  7990 raft_consensus.cc:2804] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.284403  7990 raft_consensus.cc:493] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.284730  7990 raft_consensus.cc:3060] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.289605  7948 tablet_bootstrap.cc:492] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:11.290092  7948 ts_tablet_manager.cc:1403] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 13:00:11.298475  7948 raft_consensus.cc:359] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.299422  7948 raft_consensus.cc:385] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.299767  7948 raft_consensus.cc:740] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.301841  7948 consensus_queue.cc:260] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.300132  7827 raft_consensus.cc:3060] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.301721  7677 raft_consensus.cc:2468] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:11.312827  7949 ts_tablet_manager.cc:1434] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 13:00:11.316358  7957 raft_consensus.cc:493] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.317535  7949 tablet_bootstrap.cc:492] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:11.317356  7952 consensus_queue.cc:260] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.317054  7957 raft_consensus.cc:515] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.320029  7948 ts_tablet_manager.cc:1434] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 13:00:11.321063  7948 tablet_bootstrap.cc:492] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:11.322630  7952 ts_tablet_manager.cc:1434] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.005s
I20260709 13:00:11.323758  7952 tablet_bootstrap.cc:492] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:11.326713  7948 tablet_bootstrap.cc:654] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.331439  7827 raft_consensus.cc:2468] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:11.331569  7957 leader_election.cc:290] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:11.332197  7719 leader_election.cc:304] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:11.334749  7576 catalog_manager.cc:5697] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.336563  8066 raft_consensus.cc:493] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.341435  8066 raft_consensus.cc:515] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.348189  7949 tablet_bootstrap.cc:654] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.350191  8138 raft_consensus.cc:2804] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.350427  7950 tablet_bootstrap.cc:492] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:11.350793  8138 raft_consensus.cc:697] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:11.350980  7950 ts_tablet_manager.cc:1403] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.105s	user 0.027s	sys 0.014s
I20260709 13:00:11.357209  7990 raft_consensus.cc:515] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.359484  7990 leader_election.cc:290] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:11.370121  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:11.351797  8138 consensus_queue.cc:237] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.380667  8021 raft_consensus.cc:493] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.383095  8021 raft_consensus.cc:515] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.386729  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:11.387454  7751 raft_consensus.cc:2468] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:11.387555  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe505815234b019c30d15aac38e187" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:11.398940  7646 leader_election.cc:304] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:11.400887  8027 raft_consensus.cc:2804] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.401309  8027 raft_consensus.cc:493] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.401700  8027 raft_consensus.cc:3060] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.394173  7903 raft_consensus.cc:2468] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:11.388263  7680 raft_consensus.cc:3060] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.407953  8075 raft_consensus.cc:493] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.415032  8075 raft_consensus.cc:515] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.417184  7952 tablet_bootstrap.cc:654] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.429347  8075 leader_election.cc:290] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:11.431715  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694bf015fc134546a01f1750539a8cf8" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:11.439031  7866 leader_election.cc:343] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.441319  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694bf015fc134546a01f1750539a8cf8" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:11.442147  7754 raft_consensus.cc:2468] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 0.
I20260709 13:00:11.444077  7869 leader_election.cc:304] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:11.446295  8021 leader_election.cc:290] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:11.449437  8122 raft_consensus.cc:2804] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:11.452034  7793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 82319.2us
I20260709 13:00:11.452464  8122 raft_consensus.cc:493] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.455472  8122 raft_consensus.cc:3060] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.459604  7948 tablet_bootstrap.cc:492] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:11.460168  7948 ts_tablet_manager.cc:1403] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.139s	user 0.033s	sys 0.074s
I20260709 13:00:11.463305  7948 raft_consensus.cc:359] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.463701  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe505815234b019c30d15aac38e187" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:11.464025  7948 raft_consensus.cc:385] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.464586  7950 raft_consensus.cc:359] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.465369  7950 raft_consensus.cc:385] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.465238  8027 raft_consensus.cc:515] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.465767  7950 raft_consensus.cc:740] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.466542  7950 consensus_queue.cc:260] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.458973  8066 leader_election.cc:290] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:11.469758  8122 raft_consensus.cc:515] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.473845  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4953a51e627b477992fa1569ba01e121" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:11.474467  7903 raft_consensus.cc:2468] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:11.474697  8027 leader_election.cc:290] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:11.475474  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694bf015fc134546a01f1750539a8cf8" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:11.476068  7751 raft_consensus.cc:3060] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.476151  7949 tablet_bootstrap.cc:492] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:11.476868  7949 ts_tablet_manager.cc:1403] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.160s	user 0.059s	sys 0.030s
I20260709 13:00:11.464354  7948 raft_consensus.cc:740] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.464354  7901 raft_consensus.cc:3060] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.479976  8122 leader_election.cc:290] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:11.480998  7950 ts_tablet_manager.cc:1434] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.000s
I20260709 13:00:11.480439  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:11.482913  7677 raft_consensus.cc:2468] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:11.483171  7950 tablet_bootstrap.cc:492] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:11.484912  7794 leader_election.cc:304] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:11.487056  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694bf015fc134546a01f1750539a8cf8" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:11.487941  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:11.488749  7755 raft_consensus.cc:3060] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:11.493130  7643 consensus_peers.cc:597] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:11.493866  7866 leader_election.cc:343] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.481091  7948 consensus_queue.cc:260] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.495764  8066 raft_consensus.cc:2804] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.507068  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4953a51e627b477992fa1569ba01e121" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:11.507799  7679 raft_consensus.cc:2468] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:11.510397  7948 ts_tablet_manager.cc:1434] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:00:11.514530  7680 raft_consensus.cc:2468] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:11.514425  8089 consensus_queue.cc:1048] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.502508  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:11.516022  7719 leader_election.cc:304] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:11.519250  8138 raft_consensus.cc:2804] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.524588  8088 consensus_queue.cc:1048] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:11.527081  8075 consensus_queue.cc:1048] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.499802  8066 raft_consensus.cc:493] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.531116  7793 leader_election.cc:304] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:11.531230  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:11.543656  7902 raft_consensus.cc:3060] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.519872  8138 raft_consensus.cc:697] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:11.552958  7948 tablet_bootstrap.cc:492] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:11.529395  8066 raft_consensus.cc:3060] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.553158  8226 raft_consensus.cc:2804] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:11.566787  7751 raft_consensus.cc:2468] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:11.569869  7948 tablet_bootstrap.cc:654] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:11.560617  7866 consensus_peers.cc:597] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:11.564616  8226 raft_consensus.cc:493] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.572057  8226 raft_consensus.cc:3060] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.554085  7755 raft_consensus.cc:2468] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:11.585628  8088 consensus_queue.cc:1048] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:11.586505  7952 tablet_bootstrap.cc:492] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:11.587055  7952 ts_tablet_manager.cc:1403] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.264s	user 0.007s	sys 0.020s
I20260709 13:00:11.589435  8025 raft_consensus.cc:493] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.590123  8025 raft_consensus.cc:515] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.593046  7952 raft_consensus.cc:359] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.587738  7575 catalog_manager.cc:5697] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.593842  7952 raft_consensus.cc:385] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.594211  7952 raft_consensus.cc:740] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.592633  8025 leader_election.cc:290] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:11.594725  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaecfc17e784f2eb1bced30c22e86f8" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:11.595220  7952 consensus_queue.cc:260] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.580530  8195 raft_consensus.cc:493] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.602783  7680 raft_consensus.cc:2468] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:11.603508  8195 raft_consensus.cc:515] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.605140  7646 leader_election.cc:304] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:11.598604  7869 leader_election.cc:304] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:11.562440  8138 consensus_queue.cc:237] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.607420  8122 raft_consensus.cc:2804] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.607645  7901 raft_consensus.cc:2468] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:11.608052  8122 raft_consensus.cc:697] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:11.608947  8122 consensus_queue.cc:237] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.610599  7719 leader_election.cc:304] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:11.612897  7900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaecfc17e784f2eb1bced30c22e86f8" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:11.619531  7952 ts_tablet_manager.cc:1434] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.006s
I20260709 13:00:11.616860  8025 raft_consensus.cc:2804] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.620922  8025 raft_consensus.cc:493] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.621279  8025 raft_consensus.cc:3060] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.622359  8089 raft_consensus.cc:2804] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.630664  7949 raft_consensus.cc:359] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.631198  7949 raft_consensus.cc:385] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.631417  7949 raft_consensus.cc:740] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.632014  7949 consensus_queue.cc:260] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.633339  7948 tablet_bootstrap.cc:492] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:11.633772  7948 ts_tablet_manager.cc:1403] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.010s
I20260709 13:00:11.634691  8089 raft_consensus.cc:697] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:11.635540  8089 consensus_queue.cc:237] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.623205  7902 raft_consensus.cc:2468] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:11.639247  7949 ts_tablet_manager.cc:1434] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.162s	user 0.006s	sys 0.000s
I20260709 13:00:11.645056  7949 tablet_bootstrap.cc:492] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:11.650610  7952 tablet_bootstrap.cc:492] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
W20260709 13:00:11.656131  7720 leader_election.cc:343] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.656211  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:11.647286  8066 raft_consensus.cc:515] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
W20260709 13:00:11.660374  7866 leader_election.cc:343] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.660588  8066 leader_election.cc:290] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:11.662248  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4953a51e627b477992fa1569ba01e121" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:11.662592  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4953a51e627b477992fa1569ba01e121" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:11.662858  7899 raft_consensus.cc:3060] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.663276  7680 raft_consensus.cc:3060] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.666352  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:11.669342  7948 raft_consensus.cc:359] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.670053  7948 raft_consensus.cc:385] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:11.668438  7867 leader_election.cc:343] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.670318  7948 raft_consensus.cc:740] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.671095  7948 consensus_queue.cc:260] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.653131  8195 leader_election.cc:290] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:11.682576  7952 tablet_bootstrap.cc:654] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.685917  7948 ts_tablet_manager.cc:1434] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
I20260709 13:00:11.690410  8226 raft_consensus.cc:515] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.692986  7950 tablet_bootstrap.cc:654] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.693456  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:11.694109  7677 raft_consensus.cc:3060] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.695623  7949 tablet_bootstrap.cc:654] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.674329  7867 leader_election.cc:304] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:11.697103  7948 tablet_bootstrap.cc:492] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:11.702652  8122 consensus_queue.cc:1048] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:00:11.701732  8025 raft_consensus.cc:515] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.716532  7680 raft_consensus.cc:2468] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
W20260709 13:00:11.719825  7867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 51428.5us
I20260709 13:00:11.736148  7793 leader_election.cc:304] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:11.725690  8226 leader_election.cc:290] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:11.751816  8234 raft_consensus.cc:2749] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.754901  8195 raft_consensus.cc:493] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.755541  8195 raft_consensus.cc:515] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:11.739575  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5de0dffe634306bdeb7131e6d0d43c" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:11.769214  8025 leader_election.cc:290] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:11.770447  7574 catalog_manager.cc:5697] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.771466  8195 leader_election.cc:290] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:11.773088  8233 log.cc:927] Time spent T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730: Append to log took a long time: real 0.105s	user 0.005s	sys 0.000s
I20260709 13:00:11.775243  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaecfc17e784f2eb1bced30c22e86f8" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:11.775995  7680 raft_consensus.cc:3060] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.786298  8228 raft_consensus.cc:2804] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.786880  8228 raft_consensus.cc:697] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:11.787776  8228 consensus_queue.cc:237] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.789510  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:11.768435  7899 raft_consensus.cc:2468] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:11.796712  7948 tablet_bootstrap.cc:654] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.815922  7952 tablet_bootstrap.cc:492] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:11.816679  7952 ts_tablet_manager.cc:1403] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.011s
I20260709 13:00:11.806072  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaecfc17e784f2eb1bced30c22e86f8" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:11.827632  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:11.838156  7677 raft_consensus.cc:2468] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:11.821745  7680 raft_consensus.cc:2468] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:11.842768  7793 leader_election.cc:304] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:11.843708  8066 raft_consensus.cc:2804] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:11.844341  8066 raft_consensus.cc:697] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:11.845350  8066 consensus_queue.cc:237] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:11.849228  7867 leader_election.cc:343] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.851059  7575 catalog_manager.cc:5697] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:11.852510  7720 leader_election.cc:343] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:11.853984  7869 leader_election.cc:343] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.854478  7869 leader_election.cc:304] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:11.855291  8017 raft_consensus.cc:2749] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.859105  7719 leader_election.cc:304] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7
I20260709 13:00:11.858842  7576 catalog_manager.cc:5697] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.861152  7990 raft_consensus.cc:2804] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.861615  7990 raft_consensus.cc:697] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:11.862375  7990 consensus_queue.cc:237] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
W20260709 13:00:11.883788  8244 log.cc:927] Time spent T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:00:11.888056  7950 tablet_bootstrap.cc:492] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:11.889221  7950 ts_tablet_manager.cc:1403] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.407s	user 0.017s	sys 0.000s
I20260709 13:00:11.909412  7950 raft_consensus.cc:359] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.910400  7950 raft_consensus.cc:385] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.910768  7950 raft_consensus.cc:740] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.916947  7950 consensus_queue.cc:260] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
W20260709 13:00:11.911527  7869 consensus_peers.cc:597] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:11.922391  7950 ts_tablet_manager.cc:1434] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:00:11.928225  7950 tablet_bootstrap.cc:492] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:11.930962  7952 raft_consensus.cc:359] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.931687  7952 raft_consensus.cc:385] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.934716  7952 raft_consensus.cc:740] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.933248  7678 raft_consensus.cc:1240] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Rejecting Update request from peer 99e4e009f2884c8d9f7239b5375ab730 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:11.940538  7952 consensus_queue.cc:260] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:11.943471  7952 ts_tablet_manager.cc:1434] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.000s
I20260709 13:00:11.945096  7576 catalog_manager.cc:5697] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.952610  7952 tablet_bootstrap.cc:492] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:11.955775  7949 tablet_bootstrap.cc:492] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:11.956321  7949 ts_tablet_manager.cc:1403] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.311s	user 0.038s	sys 0.030s
I20260709 13:00:11.963384  8025 consensus_queue.cc:1059] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:11.964347  8025 raft_consensus.cc:3055] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:11.964727  8025 raft_consensus.cc:740] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:11.965530  8025 consensus_queue.cc:260] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.966737  8025 raft_consensus.cc:3060] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.968199  7949 raft_consensus.cc:359] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.968955  7949 raft_consensus.cc:385] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.969209  7949 raft_consensus.cc:740] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.969794  7949 consensus_queue.cc:260] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:11.973428  7949 ts_tablet_manager.cc:1434] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:00:11.981659  7949 tablet_bootstrap.cc:492] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:11.982761  7990 raft_consensus.cc:493] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.983254  7990 raft_consensus.cc:515] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:11.985118  7990 leader_election.cc:290] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:11.986200  7575 catalog_manager.cc:5697] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.988010  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728e396427a94afb9ff27339bbec3235" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:11.990139  7948 tablet_bootstrap.cc:492] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:11.994084  7948 ts_tablet_manager.cc:1403] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.307s	user 0.009s	sys 0.011s
I20260709 13:00:11.994113  7575 catalog_manager.cc:5697] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.993014  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728e396427a94afb9ff27339bbec3235" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:11.999156  7720 leader_election.cc:304] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:12.001693  7949 tablet_bootstrap.cc:654] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.001415  8025 raft_consensus.cc:2749] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.004952  7950 tablet_bootstrap.cc:654] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.006027  7952 tablet_bootstrap.cc:654] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.018520  7948 raft_consensus.cc:359] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.019280  7948 raft_consensus.cc:385] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.019527  7948 raft_consensus.cc:740] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.020179  7948 consensus_queue.cc:260] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.022496  7948 ts_tablet_manager.cc:1434] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:00:12.023465  7948 tablet_bootstrap.cc:492] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:12.027854  7949 tablet_bootstrap.cc:492] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:12.028467  7949 ts_tablet_manager.cc:1403] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.001s
I20260709 13:00:12.029668  7948 tablet_bootstrap.cc:654] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.031500  7949 raft_consensus.cc:359] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.032382  7949 raft_consensus.cc:385] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.032917  7949 raft_consensus.cc:740] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.034390  8122 raft_consensus.cc:493] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.033841  7949 consensus_queue.cc:260] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.034878  8122 raft_consensus.cc:515] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.037041  7949 ts_tablet_manager.cc:1434] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:00:12.037122  8122 leader_election.cc:290] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:12.038041  8226 raft_consensus.cc:493] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.038419  7949 tablet_bootstrap.cc:492] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:12.038564  8226 raft_consensus.cc:515] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.039096  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ba344081ac4a8fabd3c2ab0d9e71a6" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:12.041347  7950 tablet_bootstrap.cc:492] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:12.041837  7950 ts_tablet_manager.cc:1403] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.012s
I20260709 13:00:12.042114  8226 leader_election.cc:290] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:12.041972  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
W20260709 13:00:12.042737  7869 leader_election.cc:343] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.042966  7678 raft_consensus.cc:2468] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:12.042044  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:12.042033  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ba344081ac4a8fabd3c2ab0d9e71a6" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:12.044685  7793 leader_election.cc:304] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:12.044788  7950 raft_consensus.cc:359] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.045593  7950 raft_consensus.cc:385] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.045647  8226 raft_consensus.cc:2804] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.045953  7950 raft_consensus.cc:740] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.047170  7949 tablet_bootstrap.cc:654] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.044348  7901 raft_consensus.cc:2468] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:12.048568  7950 consensus_queue.cc:260] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:12.049376  7866 leader_election.cc:343] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.049861  7866 leader_election.cc:304] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:12.051800  8017 raft_consensus.cc:2749] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.046176  8226 raft_consensus.cc:493] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.054725  8226 raft_consensus.cc:3060] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.065151  7950 ts_tablet_manager.cc:1434] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:00:12.067991  7952 tablet_bootstrap.cc:492] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:12.068893  7952 ts_tablet_manager.cc:1403] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.003s
I20260709 13:00:12.068120  8226 raft_consensus.cc:515] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.073777  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:12.074411  7901 raft_consensus.cc:3060] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.076036  7950 tablet_bootstrap.cc:492] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:12.076719  7952 raft_consensus.cc:359] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.077684  7952 raft_consensus.cc:385] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.078017  7952 raft_consensus.cc:740] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.079030  7952 consensus_queue.cc:260] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.085786  7901 raft_consensus.cc:2468] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:12.088922  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:12.089547  7678 raft_consensus.cc:3060] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.089581  7794 leader_election.cc:304] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:12.090509  8226 leader_election.cc:290] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:12.091588  8226 raft_consensus.cc:2804] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.092329  8226 raft_consensus.cc:697] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:12.093487  8226 consensus_queue.cc:237] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.094156  7950 tablet_bootstrap.cc:654] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.102344  7678 raft_consensus.cc:2468] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:12.107558  7950 tablet_bootstrap.cc:492] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:12.108130  7950 ts_tablet_manager.cc:1403] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:00:12.110541  7950 raft_consensus.cc:359] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.111182  7950 raft_consensus.cc:385] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.111430  7950 raft_consensus.cc:740] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.112003  7950 consensus_queue.cc:260] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.116768  7952 ts_tablet_manager.cc:1434] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.001s
I20260709 13:00:12.119378  7950 ts_tablet_manager.cc:1434] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:00:12.120499  7950 tablet_bootstrap.cc:492] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
W20260709 13:00:12.124414  7866 consensus_peers.cc:597] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:12.133785  7827 raft_consensus.cc:3060] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.141019  7952 tablet_bootstrap.cc:492] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:12.120579  7948 tablet_bootstrap.cc:492] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:12.146467  7948 ts_tablet_manager.cc:1403] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.123s	user 0.006s	sys 0.009s
I20260709 13:00:12.146471  8122 raft_consensus.cc:493] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.147133  8122 raft_consensus.cc:515] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.150488  8122 leader_election.cc:290] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:12.151446  7948 raft_consensus.cc:359] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.152428  7948 raft_consensus.cc:385] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.152714  7948 raft_consensus.cc:740] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.154841  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaecfc17e784f2eb1bced30c22e86f8" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:12.155346  7948 consensus_queue.cc:260] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.157305  7950 tablet_bootstrap.cc:654] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.165774  7948 ts_tablet_manager.cc:1434] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.005s
I20260709 13:00:12.166783  7948 tablet_bootstrap.cc:492] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:12.168936  7949 tablet_bootstrap.cc:492] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:12.169485  7949 ts_tablet_manager.cc:1403] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.131s	user 0.031s	sys 0.054s
I20260709 13:00:12.171887  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaecfc17e784f2eb1bced30c22e86f8" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:12.172780  7676 raft_consensus.cc:2393] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b07c9e416d4e32a62431b41b1fefa7 in current term 1: Already voted for candidate 99e4e009f2884c8d9f7239b5375ab730 in this term.
I20260709 13:00:12.173075  7952 tablet_bootstrap.cc:654] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.174283  8089 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.174851  8089 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.176942  8089 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:12.177935  7950 tablet_bootstrap.cc:492] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:12.174185  7867 leader_election.cc:304] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:12.179845  7948 tablet_bootstrap.cc:654] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.181223  8253 raft_consensus.cc:3060] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.181500  8027 consensus_queue.cc:1048] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.181250  7949 raft_consensus.cc:359] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.183024  7949 raft_consensus.cc:385] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.183362  7949 raft_consensus.cc:740] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.184182  7949 consensus_queue.cc:260] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.178664  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:12.187029  7901 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:12.188400  7952 tablet_bootstrap.cc:492] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:12.188318  7645 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:12.188927  7952 ts_tablet_manager.cc:1403] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.000s
I20260709 13:00:12.189198  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:12.190251  7752 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:12.191682  7952 raft_consensus.cc:359] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.192379  7952 raft_consensus.cc:385] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.192703  8089 raft_consensus.cc:2804] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:12.191732  7949 ts_tablet_manager.cc:1434] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:00:12.195257  8089 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.195638  8089 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.196076  7949 tablet_bootstrap.cc:492] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:12.198361  8025 consensus_queue.cc:1048] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.200269  7957 consensus_queue.cc:1048] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.194865  7948 tablet_bootstrap.cc:492] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:12.203802  7952 raft_consensus.cc:740] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.203562  7948 ts_tablet_manager.cc:1403] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.004s
I20260709 13:00:12.204865  8253 raft_consensus.cc:2749] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.205703  7957 raft_consensus.cc:493] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.206318  7957 raft_consensus.cc:515] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.207466  7950 ts_tablet_manager.cc:1403] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.004s
I20260709 13:00:12.202977  8089 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.211642  7957 leader_election.cc:290] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:12.211907  7952 consensus_queue.cc:260] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.214762  7949 tablet_bootstrap.cc:654] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.216753  8089 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:12.219816  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:12.220791  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:12.221179  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:12.221432  7899 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.221869  7903 raft_consensus.cc:2468] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:12.230269  7952 ts_tablet_manager.cc:1434] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:00:12.231065  7952 tablet_bootstrap.cc:492] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:12.238327  7948 raft_consensus.cc:359] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.241345  7645 leader_election.cc:304] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:12.241809  8025 consensus_queue.cc:1048] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.244725  7948 raft_consensus.cc:385] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.252712  7948 raft_consensus.cc:740] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.253460  7948 consensus_queue.cc:260] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.250625  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:12.251067  8122 consensus_queue.cc:1048] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.251371  8089 raft_consensus.cc:2804] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.255738  8089 raft_consensus.cc:493] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.256114  8089 raft_consensus.cc:3060] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.257966  7752 raft_consensus.cc:3060] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.258716  7950 raft_consensus.cc:359] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.259382  7950 raft_consensus.cc:385] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.259860  7950 raft_consensus.cc:740] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.244226  7899 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:12.255371  7751 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.261842  7950 consensus_queue.cc:260] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.244210  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:12.265204  7755 raft_consensus.cc:2468] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:12.271124  7948 ts_tablet_manager.cc:1434] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:00:12.272245  7948 tablet_bootstrap.cc:492] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:12.275177  7578 catalog_manager.cc:5697] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.297070  8226 raft_consensus.cc:493] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.313561  8174 raft_consensus.cc:493] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.332540  8174 raft_consensus.cc:515] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.315582  7751 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:12.339879  8174 leader_election.cc:290] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:12.318933  8226 raft_consensus.cc:515] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.345386  7948 tablet_bootstrap.cc:654] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.347983  7952 tablet_bootstrap.cc:654] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.349541  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694bf015fc134546a01f1750539a8cf8" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:12.346563  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:12.364049  7718 leader_election.cc:343] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.374140  7990 consensus_queue.cc:1048] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.375242  7949 tablet_bootstrap.cc:492] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:12.375895  7949 ts_tablet_manager.cc:1403] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.180s	user 0.023s	sys 0.026s
I20260709 13:00:12.354027  8226 leader_election.cc:290] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:12.346233  8089 raft_consensus.cc:515] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.404692  8270 raft_consensus.cc:493] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.405275  8270 raft_consensus.cc:515] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.407670  8270 leader_election.cc:290] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:12.408893  8226 consensus_queue.cc:1048] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.413929  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694bf015fc134546a01f1750539a8cf8" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:12.414937  8228 raft_consensus.cc:493] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.415534  8089 leader_election.cc:290] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:12.404259  7949 raft_consensus.cc:359] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.417022  7949 raft_consensus.cc:385] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.417340  7949 raft_consensus.cc:740] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.418728  7949 consensus_queue.cc:260] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.420331  7949 ts_tablet_manager.cc:1434] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.044s	user 0.000s	sys 0.005s
I20260709 13:00:12.425253  7949 tablet_bootstrap.cc:492] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:12.415616  8228 raft_consensus.cc:515] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.430989  8228 leader_election.cc:290] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:12.431892  8274 raft_consensus.cc:493] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.432579  8274 raft_consensus.cc:515] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.436554  8274 leader_election.cc:290] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:12.437142  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5511f1a9fff49799b1a7d65756ffe56" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:12.440363  7718 leader_election.cc:343] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.441407  7950 ts_tablet_manager.cc:1434] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.233s	user 0.014s	sys 0.004s
I20260709 13:00:12.442749  7950 tablet_bootstrap.cc:492] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:12.450309  7949 tablet_bootstrap.cc:654] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.482153  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:12.483240  7827 raft_consensus.cc:2468] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:12.482915  7751 raft_consensus.cc:1275] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:00:12.491961  7751 pending_rounds.cc:85] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730: Aborting all ops after (but not including) 0
I20260709 13:00:12.492383  7751 pending_rounds.cc:107] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:00:12.492835  7751 raft_consensus.cc:2889] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:12.472929  7645 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:12.498548  7948 tablet_bootstrap.cc:492] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:12.499282  7948 ts_tablet_manager.cc:1403] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.227s	user 0.013s	sys 0.012s
I20260709 13:00:12.505349  8017 raft_consensus.cc:493] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.505802  8017 raft_consensus.cc:515] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.506232  7948 raft_consensus.cc:359] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.507061  7948 raft_consensus.cc:385] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.507347  7948 raft_consensus.cc:740] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.507828  8017 leader_election.cc:290] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:12.508018  7948 consensus_queue.cc:260] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.509912  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2d428ca5f74d97b4fc1fa713b19994" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:12.510692  7948 ts_tablet_manager.cc:1434] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:00:12.511780  7948 tablet_bootstrap.cc:492] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
W20260709 13:00:12.514207  7866 leader_election.cc:343] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.514786  7950 tablet_bootstrap.cc:654] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.518481  7952 tablet_bootstrap.cc:492] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
W20260709 13:00:12.521399  7645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 62386.8us
I20260709 13:00:12.521600  7952 ts_tablet_manager.cc:1403] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.291s	user 0.028s	sys 0.012s
I20260709 13:00:12.523904  8280 raft_consensus.cc:2804] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:12.532552  8280 raft_consensus.cc:697] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:12.532667  7643 leader_election.cc:304] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:12.533486  8280 consensus_queue.cc:237] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.535127  7952 raft_consensus.cc:359] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.535568  8276 raft_consensus.cc:2804] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.535862  7952 raft_consensus.cc:385] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.535959  8276 raft_consensus.cc:493] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.536298  7952 raft_consensus.cc:740] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.552202  7795 leader_election.cc:304] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:12.555222  7952 consensus_queue.cc:260] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.556344  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:12.558671  8066 raft_consensus.cc:2749] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.559741  8260 consensus_queue.cc:1048] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.561112  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:12.561767  7754 raft_consensus.cc:3060] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.562631  8277 consensus_queue.cc:1048] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:00:12.539963  8276 raft_consensus.cc:3060] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.566027  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:12.539942  7676 raft_consensus.cc:1275] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:00:12.547019  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2d428ca5f74d97b4fc1fa713b19994" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:12.573688  8174 consensus_queue.cc:1048] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:12.590010  7869 leader_election.cc:343] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.590516  7869 leader_election.cc:304] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:12.591601  8234 raft_consensus.cc:493] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.591768  7952 ts_tablet_manager.cc:1434] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:00:12.593034  8122 raft_consensus.cc:2749] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.593688  7952 tablet_bootstrap.cc:492] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:12.594079  8277 consensus_queue.cc:1048] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.597801  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:12.592298  8234 raft_consensus.cc:515] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.600009  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5511f1a9fff49799b1a7d65756ffe56" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:12.600728  7680 raft_consensus.cc:2468] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:12.601227  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8e6791febb41058f3dd1950131a939" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:12.603119  7866 leader_election.cc:343] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.603220  7795 leader_election.cc:304] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:12.605147  8234 leader_election.cc:290] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:12.612051  7754 raft_consensus.cc:2468] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:12.613037  8277 raft_consensus.cc:2749] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.619724  7952 tablet_bootstrap.cc:654] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.644035  7646 leader_election.cc:304] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:12.646942  7957 raft_consensus.cc:2804] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.647646  7957 raft_consensus.cc:697] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:12.648491  7957 consensus_queue.cc:237] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.648777  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8e6791febb41058f3dd1950131a939" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:12.608560  8276 raft_consensus.cc:515] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.655694  8276 leader_election.cc:290] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:12.657018  7829 raft_consensus.cc:3060] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:12.657457  7867 leader_election.cc:343] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.658219  7867 leader_election.cc:304] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:12.659772  8253 raft_consensus.cc:2749] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:12.664527  7719 leader_election.cc:343] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.665210  7719 leader_election.cc:304] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:12.666100  7949 tablet_bootstrap.cc:492] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:12.666782  7949 ts_tablet_manager.cc:1403] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.242s	user 0.021s	sys 0.008s
I20260709 13:00:12.666879  8283 raft_consensus.cc:2749] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.683722  7950 tablet_bootstrap.cc:492] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:12.684273  7950 ts_tablet_manager.cc:1403] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.242s	user 0.019s	sys 0.012s
I20260709 13:00:12.681331  8075 raft_consensus.cc:493] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.691980  8075 raft_consensus.cc:515] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.694101  8075 leader_election.cc:290] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:12.698024  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e478963dd04f1f8913edd2870132d1" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
W20260709 13:00:12.699383  7869 leader_election.cc:343] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.699277  7950 raft_consensus.cc:359] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.700008  7950 raft_consensus.cc:385] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.700300  7950 raft_consensus.cc:740] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.703661  7719 leader_election.cc:304] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:12.704509  8174 raft_consensus.cc:2804] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.704900  8174 raft_consensus.cc:493] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.707983  8174 raft_consensus.cc:3060] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.716208  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e478963dd04f1f8913edd2870132d1" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
W20260709 13:00:12.717911  7867 leader_election.cc:343] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.719403  7949 raft_consensus.cc:359] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.720181  7949 raft_consensus.cc:385] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.721012  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:12.722626  7828 raft_consensus.cc:3060] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.718377  7867 leader_election.cc:304] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:12.724526  8253 raft_consensus.cc:2749] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.726006  8260 consensus_queue.cc:1048] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.701040  7950 consensus_queue.cc:260] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.720505  7949 raft_consensus.cc:740] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.745251  7948 tablet_bootstrap.cc:654] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.749089  7950 ts_tablet_manager.cc:1434] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:00:12.753803  7950 tablet_bootstrap.cc:492] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:12.754726  7949 consensus_queue.cc:260] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.767006  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:12.767292  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:12.767728  7902 raft_consensus.cc:2468] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:12.767907  7903 raft_consensus.cc:3060] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.770138  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:12.770738  7899 raft_consensus.cc:3060] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.776054  7903 raft_consensus.cc:2468] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:12.778007  7899 raft_consensus.cc:2468] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:12.780264  7949 ts_tablet_manager.cc:1434] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 13:00:12.785221  7950 tablet_bootstrap.cc:654] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.790853  8174 raft_consensus.cc:515] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.796731  7827 raft_consensus.cc:3060] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.799063  8174 leader_election.cc:290] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:12.801316  7828 raft_consensus.cc:2468] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:12.804831  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5511f1a9fff49799b1a7d65756ffe56" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
W20260709 13:00:12.808991  7718 leader_election.cc:343] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.811801  7952 tablet_bootstrap.cc:492] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:12.812287  7952 ts_tablet_manager.cc:1403] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.011s
I20260709 13:00:12.813501  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5511f1a9fff49799b1a7d65756ffe56" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:12.822901  7678 raft_consensus.cc:3060] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:12.825527  8297 log.cc:927] Time spent T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:00:12.836129  7952 raft_consensus.cc:359] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.836927  7952 raft_consensus.cc:385] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.837204  7952 raft_consensus.cc:740] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.837870  7952 consensus_queue.cc:260] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.839735  7949 tablet_bootstrap.cc:492] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:12.839942  7952 ts_tablet_manager.cc:1434] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.000s
I20260709 13:00:12.825582  7643 leader_election.cc:304] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:12.843000  8272 raft_consensus.cc:2804] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.843482  8272 raft_consensus.cc:697] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:12.844250  8272 consensus_queue.cc:237] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.856204  7949 tablet_bootstrap.cc:654] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.861063  7952 tablet_bootstrap.cc:492] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:12.865680  7948 tablet_bootstrap.cc:492] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:12.866312  7948 ts_tablet_manager.cc:1403] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.355s	user 0.013s	sys 0.005s
I20260709 13:00:12.883260  7948 raft_consensus.cc:359] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.884896  7948 raft_consensus.cc:385] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.883251  7576 catalog_manager.cc:5697] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 2, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.885169  7948 raft_consensus.cc:740] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.883651  7678 raft_consensus.cc:2468] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:12.886762  7576 catalog_manager.cc:5697] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.888407  7719 leader_election.cc:304] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:12.893877  8283 raft_consensus.cc:2804] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.894359  8283 raft_consensus.cc:697] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:12.895126  8283 consensus_queue.cc:237] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.898774  7948 consensus_queue.cc:260] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:12.897231  8021 consensus_queue.cc:1048] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:12.908079  7950 tablet_bootstrap.cc:492] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:12.908821  7950 ts_tablet_manager.cc:1403] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.019s
I20260709 13:00:12.912343  7950 raft_consensus.cc:359] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.913262  7950 raft_consensus.cc:385] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.913527  7950 raft_consensus.cc:740] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.914598  7950 consensus_queue.cc:260] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.925956  7950 ts_tablet_manager.cc:1434] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:00:12.926762  7950 tablet_bootstrap.cc:492] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:12.928817  7952 tablet_bootstrap.cc:654] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.935463  7949 tablet_bootstrap.cc:492] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:12.936105  7949 ts_tablet_manager.cc:1403] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.097s	user 0.021s	sys 0.018s
I20260709 13:00:12.939929  7949 raft_consensus.cc:359] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.941365  7949 raft_consensus.cc:385] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.941787  7949 raft_consensus.cc:740] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.943629  7948 ts_tablet_manager.cc:1434] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:00:12.945014  7948 tablet_bootstrap.cc:492] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:12.942368  8174 raft_consensus.cc:493] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.953102  7949 consensus_queue.cc:260] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:12.946524  8174 raft_consensus.cc:515] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:12.962422  7948 tablet_bootstrap.cc:654] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.965880  8274 raft_consensus.cc:493] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.966604  8274 raft_consensus.cc:515] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:12.970119  8174 leader_election.cc:290] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:12.988075  8274 leader_election.cc:290] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:12.990181  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ba344081ac4a8fabd3c2ab0d9e71a6" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:12.990607  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e478963dd04f1f8913edd2870132d1" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
W20260709 13:00:12.991791  7718 leader_election.cc:343] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:12.992269  7719 leader_election.cc:343] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.992720  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ba344081ac4a8fabd3c2ab0d9e71a6" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:12.993484  7903 raft_consensus.cc:2468] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:12.992304  7900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e478963dd04f1f8913edd2870132d1" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:12.994495  7900 raft_consensus.cc:2468] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:12.994948  7720 leader_election.cc:304] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:12.996544  7720 leader_election.cc:304] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:12.997809  8273 raft_consensus.cc:2804] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.998180  8273 raft_consensus.cc:493] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.998549  8273 raft_consensus.cc:3060] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.000466  8274 raft_consensus.cc:2804] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.000896  8274 raft_consensus.cc:493] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.001159  7948 tablet_bootstrap.cc:492] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:13.001823  7948 ts_tablet_manager.cc:1403] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.014s
I20260709 13:00:13.001224  8274 raft_consensus.cc:3060] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.995121  7949 ts_tablet_manager.cc:1434] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.006s
I20260709 13:00:13.008183  7949 tablet_bootstrap.cc:492] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:12.997830  7950 tablet_bootstrap.cc:654] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.006083  7948 raft_consensus.cc:359] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.010617  7948 raft_consensus.cc:385] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.010977  7948 raft_consensus.cc:740] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.011734  7948 consensus_queue.cc:260] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.014405  7948 ts_tablet_manager.cc:1434] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 13:00:13.015422  7948 tablet_bootstrap.cc:492] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:13.016834  8273 raft_consensus.cc:515] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.019469  8273 leader_election.cc:290] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:13.020222  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ba344081ac4a8fabd3c2ab0d9e71a6" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:13.022662  7948 tablet_bootstrap.cc:654] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.028795  7950 tablet_bootstrap.cc:492] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
W20260709 13:00:13.029152  7718 leader_election.cc:343] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.030696  7950 ts_tablet_manager.cc:1403] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.000s
I20260709 13:00:13.034492  7950 raft_consensus.cc:359] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.035169  7950 raft_consensus.cc:385] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.035473  7950 raft_consensus.cc:740] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.036053  7950 consensus_queue.cc:260] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.038697  7900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ba344081ac4a8fabd3c2ab0d9e71a6" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:13.041518  7900 raft_consensus.cc:3060] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.046656  7948 tablet_bootstrap.cc:492] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:13.047165  7948 ts_tablet_manager.cc:1403] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.004s
I20260709 13:00:13.049345  7900 raft_consensus.cc:2468] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:13.049852  7948 raft_consensus.cc:359] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.050572  7948 raft_consensus.cc:385] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.050836  7948 raft_consensus.cc:740] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.051736  7948 consensus_queue.cc:260] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.055122  7952 tablet_bootstrap.cc:492] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:13.055408  7948 ts_tablet_manager.cc:1434] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:00:13.055641  7952 ts_tablet_manager.cc:1403] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.195s	user 0.044s	sys 0.017s
I20260709 13:00:13.056352  7948 tablet_bootstrap.cc:492] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:13.056475  7720 leader_election.cc:304] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:13.061432  8174 raft_consensus.cc:2804] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.061867  8174 raft_consensus.cc:697] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:13.062238  7957 consensus_queue.cc:1048] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.062778  8174 consensus_queue.cc:237] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.073026  7948 tablet_bootstrap.cc:654] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.075640  7949 tablet_bootstrap.cc:654] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.077208  8260 raft_consensus.cc:493] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.077872  8260 raft_consensus.cc:515] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:13.081005  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:13.081612  7676 raft_consensus.cc:2468] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:13.082841  7793 leader_election.cc:304] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:13.083735  8066 raft_consensus.cc:2804] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.084132  8066 raft_consensus.cc:493] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.084446  8066 raft_consensus.cc:3060] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.088972  8274 raft_consensus.cc:515] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.061915  7574 catalog_manager.cc:5697] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.090742  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:13.095459  7751 raft_consensus.cc:2468] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:13.099229  7952 raft_consensus.cc:359] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.099911  7952 raft_consensus.cc:385] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.100188  7952 raft_consensus.cc:740] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.103008  7755 raft_consensus.cc:1275] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:00:13.105089  7957 consensus_queue.cc:1048] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.107990  7952 consensus_queue.cc:260] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.112732  8260 leader_election.cc:290] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:13.136173  7900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e478963dd04f1f8913edd2870132d1" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:13.137173  7900 raft_consensus.cc:3060] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.137904  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e478963dd04f1f8913edd2870132d1" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:13.138506  7676 raft_consensus.cc:3060] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.139518  7952 ts_tablet_manager.cc:1434] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 13:00:13.140515  7952 tablet_bootstrap.cc:492] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:13.156154  7950 ts_tablet_manager.cc:1434] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.125s	user 0.035s	sys 0.043s
I20260709 13:00:13.157298  7950 tablet_bootstrap.cc:492] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:13.160147  8280 consensus_queue.cc:1048] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.150146  8234 raft_consensus.cc:493] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.166493  7948 tablet_bootstrap.cc:492] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:13.166352  8234 raft_consensus.cc:515] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.167176  7948 ts_tablet_manager.cc:1403] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.111s	user 0.026s	sys 0.010s
I20260709 13:00:13.167212  7900 raft_consensus.cc:2468] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:13.172748  8066 raft_consensus.cc:515] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:13.174952  8066 leader_election.cc:290] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:13.178188  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:13.161904  7575 catalog_manager.cc:5697] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.180893  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:13.168521  8234 leader_election.cc:290] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
W20260709 13:00:13.181282  7866 leader_election.cc:343] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.177026  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:13.184080  7677 raft_consensus.cc:3060] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.186491  7948 raft_consensus.cc:359] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.187160  7948 raft_consensus.cc:385] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.187425  7948 raft_consensus.cc:740] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.190208  7903 raft_consensus.cc:1275] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:00:13.196310  7957 consensus_queue.cc:1048] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.197758  7948 consensus_queue.cc:260] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.200088  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:13.212857  7751 raft_consensus.cc:3060] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:13.216166  8322 log.cc:927] Time spent T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:00:13.202121  7869 leader_election.cc:343] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.217044  7869 leader_election.cc:304] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:13.219539  8075 raft_consensus.cc:2749] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.227645  7720 leader_election.cc:304] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:13.228456  8317 raft_consensus.cc:2804] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.180400  8273 raft_consensus.cc:493] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.236251  8317 raft_consensus.cc:697] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:13.180567  7676 raft_consensus.cc:2468] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:13.236290  8273 raft_consensus.cc:515] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.232430  7950 tablet_bootstrap.cc:654] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.241243  8273 leader_election.cc:290] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:13.237490  8317 consensus_queue.cc:237] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.245463  8253 raft_consensus.cc:493] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.249673  7900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2d428ca5f74d97b4fc1fa713b19994" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:13.250679  8253 raft_consensus.cc:515] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.251365  7900 raft_consensus.cc:2468] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:13.251597  7949 tablet_bootstrap.cc:492] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:13.252100  7949 ts_tablet_manager.cc:1403] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.244s	user 0.034s	sys 0.015s
I20260709 13:00:13.252475  7720 leader_election.cc:304] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:13.252939  8253 leader_election.cc:290] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:13.254541  8273 raft_consensus.cc:2804] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.217061  7677 raft_consensus.cc:2468] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:13.253597  8075 raft_consensus.cc:493] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.254966  8273 raft_consensus.cc:493] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.255386  8273 raft_consensus.cc:3060] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.255254  8075 raft_consensus.cc:515] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.255479  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:13.253428  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2d428ca5f74d97b4fc1fa713b19994" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:13.256803  8272 consensus_queue.cc:1048] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.259152  7793 leader_election.cc:304] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:13.263784  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2165e65cf64b5daf805ec2f2fe5002" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:13.264113  8277 raft_consensus.cc:2804] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.264660  8277 raft_consensus.cc:697] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:13.261327  7949 raft_consensus.cc:359] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.262463  8075 leader_election.cc:290] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:13.265476  8277 consensus_queue.cc:237] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:13.270533  7866 leader_election.cc:343] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.258639  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:13.271119  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2165e65cf64b5daf805ec2f2fe5002" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:13.272357  7867 leader_election.cc:343] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.262893  8273 raft_consensus.cc:515] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.266383  7949 raft_consensus.cc:385] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.276491  7949 raft_consensus.cc:740] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.149987  8274 leader_election.cc:290] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:13.269917  7952 tablet_bootstrap.cc:654] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.272867  7867 leader_election.cc:304] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
W20260709 13:00:13.283479  7867 leader_election.cc:343] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.285053  7949 consensus_queue.cc:260] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.290344  7949 ts_tablet_manager.cc:1434] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
W20260709 13:00:13.284931  7718 leader_election.cc:343] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:13.292407  7866 leader_election.cc:343] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.292893  7866 leader_election.cc:304] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:13.294103  8234 raft_consensus.cc:2749] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.286170  8075 raft_consensus.cc:2749] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.305234  7949 tablet_bootstrap.cc:492] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:13.316522  7948 ts_tablet_manager.cc:1434] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.149s	user 0.011s	sys 0.001s
I20260709 13:00:13.320160  7948 tablet_bootstrap.cc:492] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:13.334899  7751 raft_consensus.cc:2468] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:13.336871  8273 leader_election.cc:290] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:13.337867  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2d428ca5f74d97b4fc1fa713b19994" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:13.338481  7903 raft_consensus.cc:3060] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.339876  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2d428ca5f74d97b4fc1fa713b19994" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
W20260709 13:00:13.341229  7718 leader_election.cc:343] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.346710  7949 tablet_bootstrap.cc:654] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.347864  7903 raft_consensus.cc:2468] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:13.367936  7720 leader_election.cc:304] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:13.374516  8174 raft_consensus.cc:2804] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.375051  8174 raft_consensus.cc:697] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:13.375903  8174 consensus_queue.cc:237] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.376878  7948 tablet_bootstrap.cc:654] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:13.385320  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:13.390237  7952 tablet_bootstrap.cc:492] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:13.390770  7952 ts_tablet_manager.cc:1403] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.250s	user 0.009s	sys 0.004s
I20260709 13:00:13.359133  8260 raft_consensus.cc:493] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.410363  7952 raft_consensus.cc:359] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.418148  7952 raft_consensus.cc:385] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.418529  7952 raft_consensus.cc:740] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.400741  8274 consensus_queue.cc:1048] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:00:13.423530  7952 consensus_queue.cc:260] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.403904  8260 raft_consensus.cc:515] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:13.473527  7645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 48774.2us
I20260709 13:00:13.476104  7829 raft_consensus.cc:3060] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.481333  8260 leader_election.cc:290] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:13.481573  7949 tablet_bootstrap.cc:492] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:13.482074  7949 ts_tablet_manager.cc:1403] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.016s
I20260709 13:00:13.485491  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5511f1a9fff49799b1a7d65756ffe56" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:13.487396  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5511f1a9fff49799b1a7d65756ffe56" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:13.488235  7677 raft_consensus.cc:2393] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate 99e4e009f2884c8d9f7239b5375ab730 in this term.
I20260709 13:00:13.490295  7793 leader_election.cc:304] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:13.490752  7950 tablet_bootstrap.cc:492] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:13.491286  7950 ts_tablet_manager.cc:1403] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.334s	user 0.024s	sys 0.016s
I20260709 13:00:13.502486  7952 ts_tablet_manager.cc:1434] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.003s
I20260709 13:00:13.503574  7952 tablet_bootstrap.cc:492] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:13.504536  8275 consensus_queue.cc:1048] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.527777  7949 raft_consensus.cc:359] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.528508  7949 raft_consensus.cc:385] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.528893  7949 raft_consensus.cc:740] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.529783  7949 consensus_queue.cc:260] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.500000  8260 raft_consensus.cc:2749] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.537151  7950 raft_consensus.cc:359] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:13.536401  7575 catalog_manager.cc:5697] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.538129  7950 raft_consensus.cc:385] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.538583  7950 raft_consensus.cc:740] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.539604  7950 consensus_queue.cc:260] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:13.476320  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 47937.7us
I20260709 13:00:13.542707  7948 tablet_bootstrap.cc:492] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:13.543244  7948 ts_tablet_manager.cc:1403] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.223s	user 0.009s	sys 0.021s
I20260709 13:00:13.547016  7949 ts_tablet_manager.cc:1434] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.000s
I20260709 13:00:13.550602  7949 tablet_bootstrap.cc:492] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:13.544369  7577 catalog_manager.cc:5697] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.561812  7950 ts_tablet_manager.cc:1434] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:00:13.568130  7950 tablet_bootstrap.cc:492] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:13.574008  8274 consensus_queue.cc:1048] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.576275  7948 raft_consensus.cc:359] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.577109  7948 raft_consensus.cc:385] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.577412  7948 raft_consensus.cc:740] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.578110  7948 consensus_queue.cc:260] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.578694  7950 tablet_bootstrap.cc:654] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.586894  8277 raft_consensus.cc:493] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.587462  8277 raft_consensus.cc:515] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.628582  7829 raft_consensus.cc:3060] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.640272  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ba344081ac4a8fabd3c2ab0d9e71a6" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:13.641537  7897 raft_consensus.cc:2393] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate 99e4e009f2884c8d9f7239b5375ab730 in this term.
I20260709 13:00:13.644120  8260 raft_consensus.cc:493] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.644596  8260 raft_consensus.cc:515] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.652863  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8e6791febb41058f3dd1950131a939" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
W20260709 13:00:13.654318  7793 leader_election.cc:343] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.656620  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8e6791febb41058f3dd1950131a939" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:13.656924  8260 leader_election.cc:290] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:13.657380  7899 raft_consensus.cc:2468] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:13.657823  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ba344081ac4a8fabd3c2ab0d9e71a6" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:13.658896  7794 leader_election.cc:304] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:13.659713  8021 raft_consensus.cc:2804] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.660082  8021 raft_consensus.cc:493] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.660422  8021 raft_consensus.cc:3060] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.668114  7949 tablet_bootstrap.cc:654] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.668366  8021 raft_consensus.cc:515] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.580493  7948 ts_tablet_manager.cc:1434] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:00:13.671401  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8e6791febb41058f3dd1950131a939" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:13.671782  8021 leader_election.cc:290] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:13.671878  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8e6791febb41058f3dd1950131a939" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:13.672017  7899 raft_consensus.cc:3060] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:13.673596  7793 leader_election.cc:343] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.681205  8075 raft_consensus.cc:493] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.681883  8075 raft_consensus.cc:515] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.685545  7948 tablet_bootstrap.cc:492] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:13.687067  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
W20260709 13:00:13.688784  7867 leader_election.cc:343] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.689615  8075 leader_election.cc:290] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:13.692468  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
W20260709 13:00:13.697502  7869 leader_election.cc:343] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.698091  7869 leader_election.cc:304] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:13.699499  8292 raft_consensus.cc:2749] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.700986  8317 consensus_queue.cc:1048] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.706482  8317 raft_consensus.cc:493] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.720546  7577 catalog_manager.cc:5697] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.719879  8277 leader_election.cc:290] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:13.722330  8317 raft_consensus.cc:515] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:13.757584  8025 consensus_queue.cc:1048] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:00:13.761096  7899 raft_consensus.cc:2468] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:13.778138  7794 leader_election.cc:304] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:13.781354  8021 raft_consensus.cc:2804] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.781973  8021 raft_consensus.cc:697] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:13.783051  8021 consensus_queue.cc:237] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.783835  8273 consensus_queue.cc:1048] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.808972  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def02c9a73c348d1a63a3b334f54f400" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
W20260709 13:00:13.810642  7719 leader_election.cc:343] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.811604  8317 leader_election.cc:290] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:13.764072  7795 leader_election.cc:304] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:13.812618  7948 tablet_bootstrap.cc:654] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.824975  8066 raft_consensus.cc:2749] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:13.815124  7795 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35833, user_credentials={real_user=slave}} blocked reactor thread for 61056.5us
I20260709 13:00:13.829988  7950 tablet_bootstrap.cc:492] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:13.830597  7950 ts_tablet_manager.cc:1403] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.263s	user 0.014s	sys 0.010s
I20260709 13:00:13.833338  7950 raft_consensus.cc:359] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.833979  7950 raft_consensus.cc:385] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.834168  7952 tablet_bootstrap.cc:654] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.834268  7950 raft_consensus.cc:740] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.835103  7950 consensus_queue.cc:260] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:13.837973  7950 ts_tablet_manager.cc:1434] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:00:13.839162  7950 tablet_bootstrap.cc:492] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:13.889185  8292 raft_consensus.cc:493] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.908607  8272 raft_consensus.cc:493] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.910182  8292 raft_consensus.cc:515] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:13.925412  8272 raft_consensus.cc:515] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:13.939507  7952 tablet_bootstrap.cc:492] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:13.940073  7952 ts_tablet_manager.cc:1403] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.437s	user 0.024s	sys 0.000s
I20260709 13:00:13.939980  8292 leader_election.cc:290] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:13.908324  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 135780us
W20260709 13:00:13.943856  7720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 167987us
I20260709 13:00:13.957639  7952 raft_consensus.cc:359] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:13.966936  7952 raft_consensus.cc:385] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.967231  7952 raft_consensus.cc:740] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.973896  7952 consensus_queue.cc:260] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:13.973026  7948 tablet_bootstrap.cc:492] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:13.976329  7948 ts_tablet_manager.cc:1403] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.291s	user 0.029s	sys 0.010s
I20260709 13:00:13.979830  7900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:13.980569  7900 raft_consensus.cc:2468] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:13.981393  7952 ts_tablet_manager.cc:1434] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:00:13.982450  7952 tablet_bootstrap.cc:492] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:13.982846  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:13.990464  7949 tablet_bootstrap.cc:492] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:13.991011  7949 ts_tablet_manager.cc:1403] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.441s	user 0.017s	sys 0.015s
I20260709 13:00:13.993148  7645 leader_election.cc:304] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:13.994521  7957 raft_consensus.cc:2804] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.994884  7957 raft_consensus.cc:493] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.995204  7957 raft_consensus.cc:3060] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.959554  8272 leader_election.cc:290] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:13.955816  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:13.998064  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def02c9a73c348d1a63a3b334f54f400" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:13.999971  7577 catalog_manager.cc:5697] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.014389  7957 raft_consensus.cc:515] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
W20260709 13:00:14.016994  7869 leader_election.cc:343] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:14.021198  7867 leader_election.cc:343] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.021622  7867 leader_election.cc:304] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:14.030659  7957 leader_election.cc:290] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
W20260709 13:00:14.038709  7718 leader_election.cc:343] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.039280  7718 leader_election.cc:304] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:14.041023  7950 tablet_bootstrap.cc:654] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.041252  8174 consensus_queue.cc:1048] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.044399  8174 raft_consensus.cc:2749] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.051524  7949 raft_consensus.cc:359] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:14.055675  7949 raft_consensus.cc:385] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.056021  7949 raft_consensus.cc:740] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.059799  7949 consensus_queue.cc:260] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:14.036003  8025 consensus_queue.cc:1048] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:00:14.048000  8075 raft_consensus.cc:2749] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.068717  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:14.071201  7949 ts_tablet_manager.cc:1434] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:00:14.047435  8277 consensus_queue.cc:1048] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:00:14.089309  7949 tablet_bootstrap.cc:492] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:14.063506  8272 raft_consensus.cc:493] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.103397  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:14.104140  8066 consensus_queue.cc:1048] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.107158  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:14.107829  7899 raft_consensus.cc:3060] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.121431  7948 raft_consensus.cc:359] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.122632  7948 raft_consensus.cc:385] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.123052  7948 raft_consensus.cc:740] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.099928  8272 raft_consensus.cc:515] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.124142  7948 consensus_queue.cc:260] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.127018  8272 leader_election.cc:290] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:14.127724  7952 tablet_bootstrap.cc:654] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:14.197182  7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35833, user_credentials={real_user=slave}} blocked reactor thread for 127489us
I20260709 13:00:14.206614  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1104646f70f4ff4bae122a61937a61c" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:14.236766  7948 ts_tablet_manager.cc:1434] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.154s	user 0.009s	sys 0.000s
W20260709 13:00:14.253911  7646 leader_election.cc:343] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.271612  7948 tablet_bootstrap.cc:492] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7: Bootstrap starting.
I20260709 13:00:14.273751  8292 raft_consensus.cc:493] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.275049  8292 raft_consensus.cc:515] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.284984  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1104646f70f4ff4bae122a61937a61c" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:14.287873  7577 catalog_manager.cc:5697] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.308072  7950 tablet_bootstrap.cc:492] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
W20260709 13:00:14.310807  7643 leader_election.cc:343] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.313818  7950 ts_tablet_manager.cc:1403] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.475s	user 0.030s	sys 0.019s
W20260709 13:00:14.314426  7794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 48404.4us
I20260709 13:00:14.318327  7949 tablet_bootstrap.cc:654] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.333447  8292 leader_election.cc:290] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:14.320415  8353 raft_consensus.cc:493] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.349632  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 310778us
W20260709 13:00:14.350239  7643 leader_election.cc:343] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.356046  7948 tablet_bootstrap.cc:654] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:14.361961  7643 leader_election.cc:343] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.362507  7643 leader_election.cc:304] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:14.365850  8027 raft_consensus.cc:2749] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.355921  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95450b5e9cc54eb6a0799a88a3e01b37" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:14.379514  7899 raft_consensus.cc:2468] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:14.381652  7645 leader_election.cc:304] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:14.370846  8353 raft_consensus.cc:515] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:14.382979  8358 raft_consensus.cc:2804] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.385294  8358 raft_consensus.cc:697] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:14.386822  8358 consensus_queue.cc:237] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
W20260709 13:00:14.398582  7866 leader_election.cc:343] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.398882  7952 tablet_bootstrap.cc:492] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:14.405267  7952 ts_tablet_manager.cc:1403] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.423s	user 0.014s	sys 0.009s
I20260709 13:00:14.404378  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95450b5e9cc54eb6a0799a88a3e01b37" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:14.385313  8353 leader_election.cc:290] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:14.434285  7898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:14.435253  7898 raft_consensus.cc:2468] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:14.451999  7949 tablet_bootstrap.cc:492] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:14.452870  7949 ts_tablet_manager.cc:1403] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.364s	user 0.016s	sys 0.005s
W20260709 13:00:14.458099  7867 leader_election.cc:343] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.458616  7867 leader_election.cc:304] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:14.460551  8234 raft_consensus.cc:2749] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.465790  7720 leader_election.cc:304] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:14.466744  8273 raft_consensus.cc:2804] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.467155  8273 raft_consensus.cc:493] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.467499  8273 raft_consensus.cc:3060] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.489100  7952 raft_consensus.cc:359] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.490170  7952 raft_consensus.cc:385] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.490551  7952 raft_consensus.cc:740] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.491479  7952 consensus_queue.cc:260] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.484685  8021 consensus_queue.cc:1048] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.082s
W20260709 13:00:14.500969  7718 consensus_peers.cc:597] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:14.501506  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 71540.9us
I20260709 13:00:14.504732  7950 raft_consensus.cc:359] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.505545  7950 raft_consensus.cc:385] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.505805  7950 raft_consensus.cc:740] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.506484  7950 consensus_queue.cc:260] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.510134  7950 ts_tablet_manager.cc:1434] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.196s	user 0.003s	sys 0.006s
I20260709 13:00:14.511741  7950 tablet_bootstrap.cc:492] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:14.514660  7948 tablet_bootstrap.cc:492] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7: No bootstrap required, opened a new log
I20260709 13:00:14.515173  7948 ts_tablet_manager.cc:1403] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent bootstrapping tablet: real 0.276s	user 0.023s	sys 0.012s
W20260709 13:00:14.527535  7793 consensus_peers.cc:597] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:14.528146  7793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 93623.3us
I20260709 13:00:14.547139  7949 raft_consensus.cc:359] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.548197  7949 raft_consensus.cc:385] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.548534  7949 raft_consensus.cc:740] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.549299  7949 consensus_queue.cc:260] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.553471  7952 ts_tablet_manager.cc:1434] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.148s	user 0.008s	sys 0.001s
I20260709 13:00:14.571623  7948 raft_consensus.cc:359] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:14.588835  7948 raft_consensus.cc:385] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.589080  7948 raft_consensus.cc:740] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.592636  7829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:14.595757  7949 ts_tablet_manager.cc:1434] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.143s	user 0.007s	sys 0.002s
I20260709 13:00:14.595113  8369 raft_consensus.cc:493] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.601032  7718 leader_election.cc:343] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.601886  8369 raft_consensus.cc:515] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:14.604303  8025 raft_consensus.cc:493] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.605036  7952 tablet_bootstrap.cc:492] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:14.604853  8025 raft_consensus.cc:515] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.605547  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2d428ca5f74d97b4fc1fa713b19994" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:14.609258  8025 leader_election.cc:290] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:14.611919  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1104646f70f4ff4bae122a61937a61c" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:14.612615  7675 raft_consensus.cc:2468] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:14.619253  7952 tablet_bootstrap.cc:654] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.623366  7949 tablet_bootstrap.cc:492] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:14.636688  7948 consensus_queue.cc:260] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:14.641081  7719 leader_election.cc:304] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:14.643029  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1104646f70f4ff4bae122a61937a61c" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:14.643906  8174 raft_consensus.cc:2804] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.644318  8174 raft_consensus.cc:493] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.644718  8174 raft_consensus.cc:3060] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.645637  8369 leader_election.cc:290] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:14.646637  8273 raft_consensus.cc:515] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:14.649214  8273 leader_election.cc:290] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:14.651713  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:14.652951  7903 raft_consensus.cc:3060] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:14.657848  7718 leader_election.cc:343] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.658478  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2d428ca5f74d97b4fc1fa713b19994" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:14.660035  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:14.663213  7950 tablet_bootstrap.cc:654] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.665540  7948 ts_tablet_manager.cc:1434] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.000s
W20260709 13:00:14.665820  7718 leader_election.cc:343] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.674897  7794 leader_election.cc:304] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:14.679486  7575 catalog_manager.cc:5697] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.689160  8369 raft_consensus.cc:2749] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.699312  7949 tablet_bootstrap.cc:654] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.704615  7950 tablet_bootstrap.cc:492] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:14.705806  7950 ts_tablet_manager.cc:1403] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.002s
I20260709 13:00:14.708033  8357 raft_consensus.cc:493] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.708531  8357 raft_consensus.cc:515] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.710934  8357 leader_election.cc:290] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:14.714438  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def02c9a73c348d1a63a3b334f54f400" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:14.715282  7750 raft_consensus.cc:2468] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:14.715735  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def02c9a73c348d1a63a3b334f54f400" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:14.716760  7795 leader_election.cc:304] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 
W20260709 13:00:14.717471  7793 leader_election.cc:343] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.717561  8357 raft_consensus.cc:2804] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.717990  8357 raft_consensus.cc:493] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.718303  8357 raft_consensus.cc:3060] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.720959  7903 raft_consensus.cc:2468] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:14.722097  8174 raft_consensus.cc:515] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.722793  7720 leader_election.cc:304] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:14.724287  8025 raft_consensus.cc:2804] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.724730  8025 raft_consensus.cc:697] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:14.724931  7675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1104646f70f4ff4bae122a61937a61c" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:14.725733  8025 consensus_queue.cc:237] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:14.727322  7950 raft_consensus.cc:359] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.728055  7950 raft_consensus.cc:385] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.728302  7950 raft_consensus.cc:740] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.729351  7950 consensus_queue.cc:260] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.725598  7675 raft_consensus.cc:3060] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.732959  7950 ts_tablet_manager.cc:1434] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:00:14.724711  8174 leader_election.cc:290] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:14.734596  7949 tablet_bootstrap.cc:492] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:14.733459  7952 tablet_bootstrap.cc:492] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:14.735074  7949 ts_tablet_manager.cc:1403] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.000s
I20260709 13:00:14.735147  7952 ts_tablet_manager.cc:1403] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.000s
I20260709 13:00:14.738050  7949 raft_consensus.cc:359] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.738664  7949 raft_consensus.cc:385] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.738927  7949 raft_consensus.cc:740] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.731455  8357 raft_consensus.cc:515] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.739919  8358 raft_consensus.cc:493] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.739712  7952 raft_consensus.cc:359] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.740896  7952 raft_consensus.cc:385] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.740531  8358 raft_consensus.cc:515] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.742414  7952 raft_consensus.cc:740] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.743417  7952 consensus_queue.cc:260] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.745594  7950 tablet_bootstrap.cc:492] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:14.747282  7952 ts_tablet_manager.cc:1434] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:00:14.748548  7952 tablet_bootstrap.cc:492] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
W20260709 13:00:14.744623  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:14.750778  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def02c9a73c348d1a63a3b334f54f400" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:14.751371  7677 raft_consensus.cc:3060] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.751819  8273 raft_consensus.cc:493] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.752310  8273 raft_consensus.cc:515] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.753774  7950 tablet_bootstrap.cc:654] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.755049  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:14.755750  7903 raft_consensus.cc:2468] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
I20260709 13:00:14.757037  7720 leader_election.cc:304] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:14.758545  8273 leader_election.cc:290] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:14.759354  8341 raft_consensus.cc:2804] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.760113  8341 raft_consensus.cc:493] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.760577  8341 raft_consensus.cc:3060] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.763201  7952 tablet_bootstrap.cc:654] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.769145  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:14.771054  8357 leader_election.cc:290] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:14.772066  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def02c9a73c348d1a63a3b334f54f400" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:14.772722  7750 raft_consensus.cc:3060] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.772886  7677 raft_consensus.cc:2468] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:14.773277  7949 consensus_queue.cc:260] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.776841  7793 leader_election.cc:304] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
W20260709 13:00:14.777876  7719 leader_election.cc:343] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.780534  8358 leader_election.cc:290] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:14.782420  7824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8e6791febb41058f3dd1950131a939" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:14.782776  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1104646f70f4ff4bae122a61937a61c" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:14.784111  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8e6791febb41058f3dd1950131a939" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
W20260709 13:00:14.784421  7718 leader_election.cc:343] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.785770  7645 leader_election.cc:304] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:14.781066  8357 raft_consensus.cc:2804] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.797521  8280 raft_consensus.cc:2749] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.798954  7949 ts_tablet_manager.cc:1434] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.001s
I20260709 13:00:14.800130  7949 tablet_bootstrap.cc:492] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:14.805833  8341 raft_consensus.cc:515] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.809728  8341 leader_election.cc:290] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:14.810233  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:14.810876  7903 raft_consensus.cc:3060] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.813905  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
W20260709 13:00:14.816937  7719 leader_election.cc:343] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.825416  7950 tablet_bootstrap.cc:492] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:14.825994  7950 ts_tablet_manager.cc:1403] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.017s
I20260709 13:00:14.826388  7750 raft_consensus.cc:2468] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:14.828330  7903 raft_consensus.cc:2468] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:14.829484  7720 leader_election.cc:304] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:14.812878  8357 raft_consensus.cc:697] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:14.830248  8273 raft_consensus.cc:2804] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.830773  8273 raft_consensus.cc:697] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:14.831591  8273 consensus_queue.cc:237] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.832808  7952 tablet_bootstrap.cc:492] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:14.833439  7952 ts_tablet_manager.cc:1403] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.009s
I20260709 13:00:14.831209  8357 consensus_queue.cc:237] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.819805  7675 raft_consensus.cc:2468] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:14.844866  7826 raft_consensus.cc:3060] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.845129  7952 raft_consensus.cc:359] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.845906  7952 raft_consensus.cc:385] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.845906  7719 leader_election.cc:304] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:14.846946  8025 raft_consensus.cc:2804] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.847393  8025 raft_consensus.cc:697] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:14.848134  8025 consensus_queue.cc:237] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.846251  7952 raft_consensus.cc:740] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.849429  7952 consensus_queue.cc:260] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.851783  7949 tablet_bootstrap.cc:654] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.853336  7952 ts_tablet_manager.cc:1434] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:00:14.855343  7952 tablet_bootstrap.cc:492] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:14.868279  7950 raft_consensus.cc:359] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.869182  7950 raft_consensus.cc:385] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.869494  7950 raft_consensus.cc:740] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.870255  7950 consensus_queue.cc:260] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.873325  7950 ts_tablet_manager.cc:1434] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:00:14.874969  7950 tablet_bootstrap.cc:492] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:14.884430  7950 tablet_bootstrap.cc:654] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.884558  7577 catalog_manager.cc:5697] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.881306  7578 catalog_manager.cc:5697] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.914211  7577 catalog_manager.cc:5697] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.930387  7577 catalog_manager.cc:5697] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.916455  7950 tablet_bootstrap.cc:492] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:14.917752  7826 raft_consensus.cc:3060] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.933363  7949 tablet_bootstrap.cc:492] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:14.922807  7952 tablet_bootstrap.cc:654] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.938391  7950 ts_tablet_manager.cc:1403] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.006s
I20260709 13:00:14.946486  7949 ts_tablet_manager.cc:1403] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.009s
I20260709 13:00:14.948200  7675 raft_consensus.cc:3060] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.951342  7949 raft_consensus.cc:359] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.952212  7949 raft_consensus.cc:385] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.952549  7949 raft_consensus.cc:740] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.952368  7950 raft_consensus.cc:359] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.953130  7950 raft_consensus.cc:385] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.953426  7950 raft_consensus.cc:740] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.953439  7949 consensus_queue.cc:260] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:14.954221  7950 consensus_queue.cc:260] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.955953  7949 ts_tablet_manager.cc:1434] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:00:14.956498  7950 ts_tablet_manager.cc:1434] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:00:14.957134  7949 tablet_bootstrap.cc:492] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:14.958580  7950 tablet_bootstrap.cc:492] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730: Bootstrap starting.
I20260709 13:00:14.963191  7952 tablet_bootstrap.cc:492] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:14.964481  7952 ts_tablet_manager.cc:1403] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.109s	user 0.006s	sys 0.007s
I20260709 13:00:14.982522  7952 raft_consensus.cc:359] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:14.983497  7952 raft_consensus.cc:385] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.990455  7952 raft_consensus.cc:740] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.991160  8369 raft_consensus.cc:493] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.991693  8369 raft_consensus.cc:515] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.986191  8292 raft_consensus.cc:493] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.993783  8292 raft_consensus.cc:515] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:14.998051  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2165e65cf64b5daf805ec2f2fe5002" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:14.998965  8369 leader_election.cc:290] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:15.002071  8359 consensus_queue.cc:1048] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.002300  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
W20260709 13:00:15.004937  7867 leader_election.cc:343] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.007469  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2165e65cf64b5daf805ec2f2fe5002" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:15.009689  7866 leader_election.cc:343] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.010248  7866 leader_election.cc:304] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:15.011539  8234 raft_consensus.cc:2749] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.008957  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:14.990595  7950 tablet_bootstrap.cc:654] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.012624  7903 raft_consensus.cc:2468] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:15.014773  7794 leader_election.cc:304] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:15.016216  8234 raft_consensus.cc:493] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.016924  8234 raft_consensus.cc:515] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:14.984156  7949 tablet_bootstrap.cc:654] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.020661  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f988382674008a12a0b6392cf7197" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:15.020041  8234 leader_election.cc:290] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
W20260709 13:00:15.022773  7869 leader_election.cc:343] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.023624  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f988382674008a12a0b6392cf7197" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:15.013183  8292 leader_election.cc:290] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
W20260709 13:00:15.026494  7866 leader_election.cc:343] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.027125  7866 leader_election.cc:304] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:15.028900  8234 raft_consensus.cc:2749] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.031571  7949 tablet_bootstrap.cc:492] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:15.032011  8025 raft_consensus.cc:493] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.032299  7949 ts_tablet_manager.cc:1403] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.004s
I20260709 13:00:15.032521  8025 raft_consensus.cc:515] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:15.031618  7952 consensus_queue.cc:260] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:15.037235  7949 raft_consensus.cc:359] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:15.039204  7949 raft_consensus.cc:385] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.039520  7949 raft_consensus.cc:740] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.036739  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:15.043283  7949 consensus_queue.cc:260] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:15.054167  7949 ts_tablet_manager.cc:1434] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.006s
I20260709 13:00:15.056428  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:15.059067  7949 tablet_bootstrap.cc:492] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
W20260709 13:00:15.059651  7719 leader_election.cc:343] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.063465  7952 ts_tablet_manager.cc:1434] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.001s
I20260709 13:00:15.066283  8369 raft_consensus.cc:2804] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:15.072124  7718 leader_election.cc:343] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.072836  7718 leader_election.cc:304] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:15.074100  8273 raft_consensus.cc:2749] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.080060  8358 consensus_queue.cc:1048] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.082517  8359 raft_consensus.cc:493] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.086186  8359 raft_consensus.cc:515] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:15.089780  8359 leader_election.cc:290] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:15.091122  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:15.091946  7751 raft_consensus.cc:2468] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:15.093160  8025 leader_election.cc:290] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:15.093786  7952 tablet_bootstrap.cc:492] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:15.094255  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:15.095007  7903 raft_consensus.cc:2468] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 0.
I20260709 13:00:15.093173  7646 leader_election.cc:304] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:15.106484  8359 raft_consensus.cc:2804] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.107020  8359 raft_consensus.cc:493] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.107472  8359 raft_consensus.cc:3060] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.115832  7952 tablet_bootstrap.cc:654] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.117873  7950 tablet_bootstrap.cc:492] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730: No bootstrap required, opened a new log
I20260709 13:00:15.118462  7950 ts_tablet_manager.cc:1403] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730: Time spent bootstrapping tablet: real 0.161s	user 0.008s	sys 0.018s
I20260709 13:00:15.132781  7949 tablet_bootstrap.cc:654] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.101650  8369 raft_consensus.cc:493] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:15.134109  8369 raft_consensus.cc:3060] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.129963  8359 raft_consensus.cc:515] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:15.142452  8359 leader_election.cc:290] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:15.145565  7950 raft_consensus.cc:359] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:15.146420  7950 raft_consensus.cc:385] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.146705  7950 raft_consensus.cc:740] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.147415  7950 consensus_queue.cc:260] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:15.154592  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:15.155260  7750 raft_consensus.cc:3060] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.155370  7950 ts_tablet_manager.cc:1434] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:00:15.156719  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:15.157336  7903 raft_consensus.cc:3060] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.170902  7903 raft_consensus.cc:2468] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:15.171013  8025 raft_consensus.cc:493] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.171669  8025 raft_consensus.cc:515] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:15.173575  8025 leader_election.cc:290] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:15.184914  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f988382674008a12a0b6392cf7197" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:15.181681  8357 raft_consensus.cc:493] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.192586  7645 leader_election.cc:304] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:15.197427  7957 raft_consensus.cc:2804] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.194695  8357 raft_consensus.cc:515] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:15.201757  8357 leader_election.cc:290] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
W20260709 13:00:15.202316  7718 leader_election.cc:343] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.194573  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f988382674008a12a0b6392cf7197" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:15.222991  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:15.223107  8369 raft_consensus.cc:515] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:15.225241  7827 raft_consensus.cc:3060] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.187222  7750 raft_consensus.cc:2468] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 1.
I20260709 13:00:15.197165  8359 raft_consensus.cc:493] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.237668  7957 raft_consensus.cc:697] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:15.248926  7824 raft_consensus.cc:1240] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Rejecting Update request from peer f91d8d830a474ea7a101fc5b6f920544 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.249866  7949 tablet_bootstrap.cc:492] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:15.250005  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:15.250437  7949 ts_tablet_manager.cc:1403] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.192s	user 0.007s	sys 0.016s
I20260709 13:00:15.253686  7949 raft_consensus.cc:359] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:15.254375  7949 raft_consensus.cc:385] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.254654  7949 raft_consensus.cc:740] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.255321  7949 consensus_queue.cc:260] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:15.224557  8174 consensus_queue.cc:1048] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:00:15.243135  7957 consensus_queue.cc:237] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:15.239521  7899 raft_consensus.cc:2468] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 0.
W20260709 13:00:15.273476  7643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 77543.6us
I20260709 13:00:15.271045  7897 raft_consensus.cc:2393] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 1: Already voted for candidate 99e4e009f2884c8d9f7239b5375ab730 in this term.
I20260709 13:00:15.237541  8359 raft_consensus.cc:515] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:15.298177  8359 leader_election.cc:290] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:15.273861  8273 consensus_queue.cc:1048] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:00:15.288535  8369 leader_election.cc:290] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:15.303889  7949 ts_tablet_manager.cc:1434] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.002s
I20260709 13:00:15.299530  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:15.315338  7720 leader_election.cc:304] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:15.333514  8025 raft_consensus.cc:2804] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.333931  8025 raft_consensus.cc:493] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.334242  8025 raft_consensus.cc:3060] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.341138  7794 leader_election.cc:304] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:15.348592  7952 tablet_bootstrap.cc:492] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:15.349324  7952 ts_tablet_manager.cc:1403] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.256s	user 0.015s	sys 0.006s
I20260709 13:00:15.351920  8272 consensus_queue.cc:1059] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:00:15.352936  8272 raft_consensus.cc:3055] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.353379  8272 raft_consensus.cc:740] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:15.344238  8357 raft_consensus.cc:2749] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.363503  7952 raft_consensus.cc:359] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:15.364446  7952 raft_consensus.cc:385] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.364789  7952 raft_consensus.cc:740] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.355059  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:15.421514  7949 tablet_bootstrap.cc:492] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:15.388794  8357 raft_consensus.cc:493] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.354431  8272 consensus_queue.cc:260] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:15.457295  8317 consensus_queue.cc:1048] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:15.441434  8357 raft_consensus.cc:515] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:15.463311  8272 raft_consensus.cc:3060] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.481626  7952 consensus_queue.cc:260] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:15.498535  7952 ts_tablet_manager.cc:1434] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.149s	user 0.013s	sys 0.004s
I20260709 13:00:15.501869  7952 tablet_bootstrap.cc:492] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:15.505481  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:15.506551  7902 raft_consensus.cc:2393] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f91d8d830a474ea7a101fc5b6f920544 in current term 1: Already voted for candidate 99e4e009f2884c8d9f7239b5375ab730 in this term.
I20260709 13:00:15.511556  7827 raft_consensus.cc:3060] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.484678  8400 raft_consensus.cc:493] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.489980  8273 consensus_queue.cc:1048] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
W20260709 13:00:15.530948  7793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 93973.7us
I20260709 13:00:15.558463  8357 leader_election.cc:290] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:15.552042  7720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 87941.2us
I20260709 13:00:15.533531  8400 raft_consensus.cc:515] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:15.581178  8174 consensus_queue.cc:1048] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.584124  7952 tablet_bootstrap.cc:654] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.601827  8400 leader_election.cc:290] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:15.588861  7677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:15.612094  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1104646f70f4ff4bae122a61937a61c" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:15.618981  7949 tablet_bootstrap.cc:654] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.630584  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95450b5e9cc54eb6a0799a88a3e01b37" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:15.631318  7902 raft_consensus.cc:2468] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:15.632457  7794 leader_election.cc:304] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:15.633327  8357 raft_consensus.cc:2804] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.646456  8025 raft_consensus.cc:515] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
W20260709 13:00:15.657074  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 76103us
W20260709 13:00:15.657298  7720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 61758us
I20260709 13:00:15.648699  8357 raft_consensus.cc:493] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.670900  8025 leader_election.cc:290] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:15.602406  8416 raft_consensus.cc:493] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:15.654495  7866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 44220.2us
I20260709 13:00:15.673390  8357 raft_consensus.cc:3060] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.691511  7674 raft_consensus.cc:3060] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.697481  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1104646f70f4ff4bae122a61937a61c" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:15.680133  8416 raft_consensus.cc:515] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:15.703297  8416 leader_election.cc:290] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:15.708619  8357 raft_consensus.cc:515] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:15.733330  7645 leader_election.cc:304] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:15.737900  7949 tablet_bootstrap.cc:492] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:15.738436  7949 ts_tablet_manager.cc:1403] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.355s	user 0.025s	sys 0.009s
I20260709 13:00:15.754102  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f988382674008a12a0b6392cf7197" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:15.789682  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95450b5e9cc54eb6a0799a88a3e01b37" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:15.790393  7899 raft_consensus.cc:3060] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.802239  7949 raft_consensus.cc:359] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:15.803223  7949 raft_consensus.cc:385] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.803579  7949 raft_consensus.cc:740] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.805653  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95450b5e9cc54eb6a0799a88a3e01b37" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:15.806691  7827 raft_consensus.cc:2393] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f91d8d830a474ea7a101fc5b6f920544 in current term 1: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:15.822206  7677 raft_consensus.cc:2468] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:15.830039  7949 consensus_queue.cc:260] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:15.807240  7897 raft_consensus.cc:3060] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.828807  8404 raft_consensus.cc:2749] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.834654  7825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f988382674008a12a0b6392cf7197" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:15.847604  7949 ts_tablet_manager.cc:1434] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.109s	user 0.001s	sys 0.008s
I20260709 13:00:15.850116  8025 consensus_queue.cc:1048] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.867532  7949 tablet_bootstrap.cc:492] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:15.882114  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95450b5e9cc54eb6a0799a88a3e01b37" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:15.882931  7678 raft_consensus.cc:2468] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:15.889971  7897 raft_consensus.cc:2468] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:15.893953  7900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95450b5e9cc54eb6a0799a88a3e01b37" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:15.906070  7645 leader_election.cc:304] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:15.908018  8404 raft_consensus.cc:3060] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:15.879937  7718 leader_election.cc:343] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.917085  8357 leader_election.cc:290] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
W20260709 13:00:15.923645  7626 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:15.924423  7578 catalog_manager.cc:5697] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 0 to 1, leader changed from <none> to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.937178  8397 consensus_queue.cc:1048] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:15.947352  7720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 95470.5us
I20260709 13:00:15.955878  7720 leader_election.cc:304] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:15.957844  8025 raft_consensus.cc:2804] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.958323  8025 raft_consensus.cc:697] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:15.959082  8025 consensus_queue.cc:237] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:15.938017  8404 raft_consensus.cc:2749] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.990249  7952 tablet_bootstrap.cc:492] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:15.990829  7952 ts_tablet_manager.cc:1403] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.489s	user 0.013s	sys 0.015s
I20260709 13:00:15.958567  8407 consensus_queue.cc:1048] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:00:15.990931  8426 consensus_queue.cc:1048] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 13:00:16.011014  7899 raft_consensus.cc:2468] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:16.018941  7952 raft_consensus.cc:359] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:16.019969  7952 raft_consensus.cc:385] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.020304  7952 raft_consensus.cc:740] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.024312  7952 consensus_queue.cc:260] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:16.056504  8428 log.cc:927] Time spent T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:00:16.073215  7952 ts_tablet_manager.cc:1434] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.002s
I20260709 13:00:16.074810  7952 tablet_bootstrap.cc:492] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:15.985034  7793 leader_election.cc:304] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:16.107860  8426 raft_consensus.cc:2749] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:16.108047  7793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 131979us
I20260709 13:00:16.109671  7793 leader_election.cc:304] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7
I20260709 13:00:16.110709  8426 raft_consensus.cc:2804] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.111254  8426 raft_consensus.cc:697] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:16.116441  7949 tablet_bootstrap.cc:654] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.112134  8426 consensus_queue.cc:237] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:16.130932  8357 raft_consensus.cc:493] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.131497  8357 raft_consensus.cc:515] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:16.131778  7794 leader_election.cc:304] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:16.132962  8369 raft_consensus.cc:2804] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.133412  8369 raft_consensus.cc:697] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:16.133623  8357 leader_election.cc:290] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:16.134208  8369 consensus_queue.cc:237] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:16.135210  8412 consensus_queue.cc:1048] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:16.147281  7575 catalog_manager.cc:5697] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.151579  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:16.152357  7749 raft_consensus.cc:2468] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:16.156442  7952 tablet_bootstrap.cc:654] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.158643  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:16.159328  7679 raft_consensus.cc:2468] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:16.160840  7678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95450b5e9cc54eb6a0799a88a3e01b37" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:16.161252  7793 leader_election.cc:304] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:16.162458  8403 raft_consensus.cc:2804] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.162933  8403 raft_consensus.cc:493] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.163336  8403 raft_consensus.cc:3060] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.210624  7678 raft_consensus.cc:2468] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:16.251715  7949 tablet_bootstrap.cc:492] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:16.252234  7949 ts_tablet_manager.cc:1403] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.398s	user 0.021s	sys 0.007s
I20260709 13:00:16.260532  7949 raft_consensus.cc:359] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:16.261301  7949 raft_consensus.cc:385] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.261564  7949 raft_consensus.cc:740] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.262225  7949 consensus_queue.cc:260] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:16.264882  7949 ts_tablet_manager.cc:1434] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:00:16.272006  7949 tablet_bootstrap.cc:492] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff: Bootstrap starting.
I20260709 13:00:16.272367  8403 raft_consensus.cc:515] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:16.284957  8403 leader_election.cc:290] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:16.287442  7676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:16.288422  7676 raft_consensus.cc:3060] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.293871  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:16.294512  7749 raft_consensus.cc:3060] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.314582  7676 raft_consensus.cc:2468] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:16.316295  7749 raft_consensus.cc:2468] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:16.326076  7795 leader_election.cc:304] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:16.326928  8403 raft_consensus.cc:2804] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.327412  8403 raft_consensus.cc:697] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:16.318208  7952 tablet_bootstrap.cc:492] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: No bootstrap required, opened a new log
I20260709 13:00:16.331548  7952 ts_tablet_manager.cc:1403] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.257s	user 0.027s	sys 0.023s
I20260709 13:00:16.328210  8403 consensus_queue.cc:237] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:16.321468  7949 tablet_bootstrap.cc:654] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.334787  7952 raft_consensus.cc:359] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:16.339115  7952 raft_consensus.cc:385] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.339447  7952 raft_consensus.cc:740] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.340164  7952 consensus_queue.cc:260] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:16.342748  7952 ts_tablet_manager.cc:1434] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:00:16.342716  7577 catalog_manager.cc:5697] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.347157  7949 tablet_bootstrap.cc:492] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff: No bootstrap required, opened a new log
I20260709 13:00:16.347779  7949 ts_tablet_manager.cc:1403] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.000s
I20260709 13:00:16.352552  7949 raft_consensus.cc:359] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:16.353457  7949 raft_consensus.cc:385] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.353660  7577 catalog_manager.cc:5697] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.353773  7949 raft_consensus.cc:740] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.361100  7949 consensus_queue.cc:260] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:16.363008  7949 ts_tablet_manager.cc:1434] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:00:16.385445  7577 catalog_manager.cc:5697] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.419831  8403 raft_consensus.cc:493] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.420356  8403 raft_consensus.cc:515] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:16.423138  8403 leader_election.cc:290] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:16.423691  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2165e65cf64b5daf805ec2f2fe5002" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:16.424001  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2165e65cf64b5daf805ec2f2fe5002" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:16.424405  7674 raft_consensus.cc:2468] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:16.425060  7896 raft_consensus.cc:2468] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 0.
I20260709 13:00:16.425498  7793 leader_election.cc:304] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:16.426496  8403 raft_consensus.cc:2804] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.426872  8403 raft_consensus.cc:493] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.427186  8403 raft_consensus.cc:3060] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.434013  8403 raft_consensus.cc:515] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:16.434312  8427 consensus_queue.cc:1048] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:16.436103  8403 leader_election.cc:290] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:16.437090  7674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2165e65cf64b5daf805ec2f2fe5002" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:16.437173  7898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2165e65cf64b5daf805ec2f2fe5002" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:16.437916  7674 raft_consensus.cc:3060] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.438004  7898 raft_consensus.cc:3060] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.444831  7674 raft_consensus.cc:2468] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:16.447153  7793 leader_election.cc:304] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:16.447944  8403 raft_consensus.cc:2804] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.448444  8403 raft_consensus.cc:697] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:16.449239  8403 consensus_queue.cc:237] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:16.452833  7822 raft_consensus.cc:3060] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.453480  7898 raft_consensus.cc:2468] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:16.461606  8025 consensus_queue.cc:1048] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.478595  7577 catalog_manager.cc:5697] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.539716  7896 raft_consensus.cc:3060] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.546226  7896 raft_consensus.cc:1275] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.547456  8403 consensus_queue.cc:1048] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.556414  7674 raft_consensus.cc:1275] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.557945  8403 consensus_queue.cc:1048] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.632450  8403 consensus_queue.cc:1048] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:16.642170  8369 consensus_queue.cc:1048] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.872290  8422 consensus_queue.cc:1048] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.878701  8426 consensus_queue.cc:1048] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.910426  8426 consensus_queue.cc:1048] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.911094  8422 consensus_queue.cc:1048] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:17.913403   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:00:17.958935  7793 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:00:17.963630  7793 consensus_peers.cc:597] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:17.964246  7793 consensus_peers.cc:597] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:17.968976  7867 consensus_peers.cc:597] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:17.977751  7719 consensus_peers.cc:597] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:17.991786   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:17.992699   431 tablet_replica.cc:333] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:17.993407   431 raft_consensus.cc:2243] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:17.993882   431 raft_consensus.cc:2272] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:17.995873   431 tablet_replica.cc:333] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:17.996501   431 raft_consensus.cc:2243] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:17.996964   431 raft_consensus.cc:2272] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:17.998873   431 tablet_replica.cc:333] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:17.999469   431 raft_consensus.cc:2243] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.000506   431 raft_consensus.cc:2272] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.003003   431 tablet_replica.cc:333] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.003854   431 raft_consensus.cc:2243] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.005596   431 raft_consensus.cc:2272] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:18.007822  7719 consensus_peers.cc:597] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.008363   431 tablet_replica.cc:333] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.009361   431 raft_consensus.cc:2243] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.009929   431 raft_consensus.cc:2272] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.013118   431 tablet_replica.cc:333] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.013983   431 raft_consensus.cc:2243] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:00:18.014645  7719 consensus_peers.cc:597] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.015075   431 raft_consensus.cc:2272] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.018154   431 tablet_replica.cc:333] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.019037   431 raft_consensus.cc:2243] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.019623   431 raft_consensus.cc:2272] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:18.019801  7867 consensus_peers.cc:597] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.022284   431 tablet_replica.cc:333] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.023082   431 raft_consensus.cc:2243] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:00:18.023396  7793 consensus_peers.cc:597] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.023615   431 raft_consensus.cc:2272] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.025667   431 tablet_replica.cc:333] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.026242   431 raft_consensus.cc:2243] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.026685   431 raft_consensus.cc:2272] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.028831   431 tablet_replica.cc:333] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.029557   431 raft_consensus.cc:2243] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.030504   431 raft_consensus.cc:2272] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.033282   431 tablet_replica.cc:333] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.033962   431 raft_consensus.cc:2243] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.034416   431 raft_consensus.cc:2272] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.036362   431 tablet_replica.cc:333] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.037009   431 raft_consensus.cc:2243] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.037871   431 raft_consensus.cc:2272] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.040432   431 tablet_replica.cc:333] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.041345   431 raft_consensus.cc:2243] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.041898   431 raft_consensus.cc:2272] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.044446   431 tablet_replica.cc:333] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.045126   431 raft_consensus.cc:2243] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.045974   431 raft_consensus.cc:2272] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:18.046949  7793 consensus_peers.cc:597] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.048225   431 tablet_replica.cc:333] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.048894   431 raft_consensus.cc:2243] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.049607   431 raft_consensus.cc:2272] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.051914   431 tablet_replica.cc:333] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.052547   431 raft_consensus.cc:2243] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.053499   431 raft_consensus.cc:2272] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.055560   431 tablet_replica.cc:333] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.056082   431 raft_consensus.cc:2243] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.056864   431 raft_consensus.cc:2272] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.058688   431 tablet_replica.cc:333] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.059182   431 raft_consensus.cc:2243] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.059846   431 raft_consensus.cc:2272] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.062100   431 tablet_replica.cc:333] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.062896   431 raft_consensus.cc:2243] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.063416   431 raft_consensus.cc:2272] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.065653   431 tablet_replica.cc:333] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.066406   431 raft_consensus.cc:2243] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.066908   431 raft_consensus.cc:2272] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.069100   431 tablet_replica.cc:333] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.069653   431 raft_consensus.cc:2243] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.070084   431 raft_consensus.cc:2272] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.072108   431 tablet_replica.cc:333] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.072628   431 raft_consensus.cc:2243] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.073429   431 raft_consensus.cc:2272] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.075320   431 tablet_replica.cc:333] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.075912   431 raft_consensus.cc:2243] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.076340   431 raft_consensus.cc:2272] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.078550   431 tablet_replica.cc:333] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.079164   431 raft_consensus.cc:2243] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.079586   431 raft_consensus.cc:2272] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.081727   431 tablet_replica.cc:333] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.082307   431 raft_consensus.cc:2243] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.082710   431 raft_consensus.cc:2272] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.084431   431 tablet_replica.cc:333] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.084997   431 raft_consensus.cc:2243] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.085749   431 raft_consensus.cc:2272] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.087702   431 tablet_replica.cc:333] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.088255   431 raft_consensus.cc:2243] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.089113   431 raft_consensus.cc:2272] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.091185   431 tablet_replica.cc:333] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.091723   431 raft_consensus.cc:2243] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.092163   431 raft_consensus.cc:2272] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.094542   431 tablet_replica.cc:333] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.095093   431 raft_consensus.cc:2243] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.095482   431 raft_consensus.cc:2272] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.097303   431 tablet_replica.cc:333] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.097847   431 raft_consensus.cc:2243] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.098299   431 raft_consensus.cc:2272] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.100705   431 tablet_replica.cc:333] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.101313   431 raft_consensus.cc:2243] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.101778   431 raft_consensus.cc:2272] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.103538   431 tablet_replica.cc:333] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.104123   431 raft_consensus.cc:2243] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.105017   431 raft_consensus.cc:2272] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.106838   431 tablet_replica.cc:333] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.107345   431 raft_consensus.cc:2243] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.107736   431 raft_consensus.cc:2272] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.109504   431 tablet_replica.cc:333] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.110214   431 raft_consensus.cc:2243] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.111022   431 raft_consensus.cc:2272] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.113278   431 tablet_replica.cc:333] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.113776   431 raft_consensus.cc:2243] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.114526   431 raft_consensus.cc:2272] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.116375   431 tablet_replica.cc:333] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.117012   431 raft_consensus.cc:2243] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.117766   431 raft_consensus.cc:2272] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.119999   431 tablet_replica.cc:333] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.120513   431 raft_consensus.cc:2243] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.121042   431 raft_consensus.cc:2272] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.123252   431 tablet_replica.cc:333] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.123788   431 raft_consensus.cc:2243] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.124523   431 raft_consensus.cc:2272] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.126401   431 tablet_replica.cc:333] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.126910   431 raft_consensus.cc:2243] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.127300   431 raft_consensus.cc:2272] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.129613   431 tablet_replica.cc:333] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.130329   431 raft_consensus.cc:2243] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.130805   431 raft_consensus.cc:2272] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.133297   431 tablet_replica.cc:333] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.133946   431 raft_consensus.cc:2243] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.134435   431 raft_consensus.cc:2272] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.137055   431 tablet_replica.cc:333] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.137732   431 raft_consensus.cc:2243] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.138715   431 raft_consensus.cc:2272] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.141352   431 tablet_replica.cc:333] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.142009   431 raft_consensus.cc:2243] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.142477   431 raft_consensus.cc:2272] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.144244   431 tablet_replica.cc:333] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.144891   431 raft_consensus.cc:2243] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.145239   431 raft_consensus.cc:2272] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.147435   431 tablet_replica.cc:333] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: stopping tablet replica
I20260709 13:00:18.147909   431 raft_consensus.cc:2243] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:18.148718   431 raft_consensus.cc:2272] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:18.169314  7793 consensus_peers.cc:597] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.206477  7867 consensus_peers.cc:597] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.226778  7867 consensus_peers.cc:597] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.230350   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:00:18.255277  7719 consensus_peers.cc:597] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.260169  7793 consensus_peers.cc:597] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.269275  7793 consensus_peers.cc:597] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.279533  7793 consensus_peers.cc:597] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.287567  7719 consensus_peers.cc:597] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.290078  7719 consensus_peers.cc:597] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.301638  7719 consensus_peers.cc:597] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.314996   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:18.321489  8479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:18.322108  8480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:18.324699  8482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:18.325089   431 server_base.cc:1061] running on GCE node
I20260709 13:00:18.330608   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:18.330917   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:18.331197   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602018331175 us; error 0 us; skew 500 ppm
I20260709 13:00:18.331982   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:00:18.333194  7793 consensus_peers.cc:597] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.335099   431 webserver.cc:533] Webserver started at http://127.0.107.193:37139/ using document root <none> and password file <none>
I20260709 13:00:18.335660   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:18.336069   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:00:18.341663   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.001s
W20260709 13:00:18.350517  7867 consensus_peers.cc:597] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.351516  8487 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:18.352450   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:00:18.352810   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "f91d8d830a474ea7a101fc5b6f920544"
format_stamp: "Formatted at 2026-07-09 13:00:04 on dist-test-slave-73vh"
I20260709 13:00:18.353209   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:18.383059   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:18.384472   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:18.386063   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:18.390970  8494 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:00:18.413275  7719 consensus_peers.cc:597] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.426299  7793 consensus_peers.cc:597] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.459928  7793 consensus_peers.cc:597] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.464381  7793 consensus_peers.cc:597] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:18.469421  7719 consensus_peers.cc:597] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.640128   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:00:18.640586   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.251s	user 0.009s	sys 0.001s
I20260709 13:00:18.640933   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:00:18.645398  8494 tablet_bootstrap.cc:492] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.657763  8494 tablet_bootstrap.cc:492] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.658699  8494 tablet_bootstrap.cc:492] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.659247  8494 ts_tablet_manager.cc:1403] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:00:18.661720  8494 raft_consensus.cc:359] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:18.662369  8494 raft_consensus.cc:740] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.663100  8494 consensus_queue.cc:260] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:18.679916  8494 ts_tablet_manager.cc:1434] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.017s
I20260709 13:00:18.680773  8494 tablet_bootstrap.cc:492] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.696585  8494 tablet_bootstrap.cc:492] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.697496  8494 tablet_bootstrap.cc:492] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.698141  8494 ts_tablet_manager.cc:1403] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:00:18.700589  8494 raft_consensus.cc:359] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.701300  8494 raft_consensus.cc:740] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.701977  8494 consensus_queue.cc:260] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.703761  8494 ts_tablet_manager.cc:1434] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:18.704567  8494 tablet_bootstrap.cc:492] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.722277  8494 tablet_bootstrap.cc:492] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.723309  8494 tablet_bootstrap.cc:492] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.723927  8494 ts_tablet_manager.cc:1403] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:00:18.726436  8494 raft_consensus.cc:359] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.727103  8494 raft_consensus.cc:740] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.727735  8494 consensus_queue.cc:260] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.729806  8494 ts_tablet_manager.cc:1434] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:00:18.730579  8494 tablet_bootstrap.cc:492] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.745973  8494 tablet_bootstrap.cc:492] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.746877  8494 tablet_bootstrap.cc:492] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.747498  8494 ts_tablet_manager.cc:1403] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:00:18.749857  8494 raft_consensus.cc:359] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:18.750519  8494 raft_consensus.cc:740] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.751215  8494 consensus_queue.cc:260] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:18.753255  8494 ts_tablet_manager.cc:1434] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:00:18.754001  8494 tablet_bootstrap.cc:492] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.771556  8494 tablet_bootstrap.cc:492] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.772478  8494 tablet_bootstrap.cc:492] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.773108  8494 ts_tablet_manager.cc:1403] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.011s
I20260709 13:00:18.775504  8494 raft_consensus.cc:359] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:18.776160  8494 raft_consensus.cc:740] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.776871  8494 consensus_queue.cc:260] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:18.778920  8494 ts_tablet_manager.cc:1434] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:18.779645  8494 tablet_bootstrap.cc:492] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
W20260709 13:00:18.802380  7776 debug-util.cc:398] Leaking SignalData structure 0x7b08002ddea0 after lost signal to thread 434
W20260709 13:00:18.803762  7776 debug-util.cc:398] Leaking SignalData structure 0x7b080011e340 after lost signal to thread 7612
W20260709 13:00:18.806425  7776 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba0e0 after lost signal to thread 7779
W20260709 13:00:18.807582  7776 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6080 after lost signal to thread 7853
W20260709 13:00:18.808750  7776 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfc80 after lost signal to thread 7927
I20260709 13:00:18.809036  8494 tablet_bootstrap.cc:492] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.809978  8494 tablet_bootstrap.cc:492] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.810587  8494 ts_tablet_manager.cc:1403] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 13:00:18.813493  8494 raft_consensus.cc:359] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.814147  8494 raft_consensus.cc:740] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.814908  8494 consensus_queue.cc:260] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.817987  8494 ts_tablet_manager.cc:1434] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:18.818719  8494 tablet_bootstrap.cc:492] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.839165  8494 tablet_bootstrap.cc:492] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.840086  8494 tablet_bootstrap.cc:492] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.840705  8494 ts_tablet_manager.cc:1403] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:00:18.842998  8494 raft_consensus.cc:359] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.843667  8494 raft_consensus.cc:740] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.844491  8494 consensus_queue.cc:260] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.846593  8494 ts_tablet_manager.cc:1434] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:18.847321  8494 tablet_bootstrap.cc:492] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.868757  8494 tablet_bootstrap.cc:492] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.869666  8494 tablet_bootstrap.cc:492] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.870304  8494 ts_tablet_manager.cc:1403] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 13:00:18.872822  8494 raft_consensus.cc:359] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.873454  8494 raft_consensus.cc:740] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.874218  8494 consensus_queue.cc:260] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:18.876302  8494 ts_tablet_manager.cc:1434] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:18.877061  8494 tablet_bootstrap.cc:492] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.897437  8494 tablet_bootstrap.cc:492] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.898370  8494 tablet_bootstrap.cc:492] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.898978  8494 ts_tablet_manager.cc:1403] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:00:18.901340  8494 raft_consensus.cc:359] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:18.902998  8494 raft_consensus.cc:740] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.903764  8494 consensus_queue.cc:260] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:18.905975  8494 ts_tablet_manager.cc:1434] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:18.906713  8494 tablet_bootstrap.cc:492] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.927224  8494 tablet_bootstrap.cc:492] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.928095  8494 tablet_bootstrap.cc:492] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.928864  8494 ts_tablet_manager.cc:1403] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.011s
I20260709 13:00:18.931201  8494 raft_consensus.cc:359] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:18.931886  8494 raft_consensus.cc:740] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.932713  8494 consensus_queue.cc:260] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:18.934818  8494 ts_tablet_manager.cc:1434] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:18.935619  8494 tablet_bootstrap.cc:492] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:18.942257   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:00:18.948946   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.308s	user 0.257s	sys 0.005s
I20260709 13:00:18.959131  8494 tablet_bootstrap.cc:492] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:18.960280  8494 tablet_bootstrap.cc:492] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:18.961139  8494 ts_tablet_manager.cc:1403] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.004s
I20260709 13:00:18.963853  8494 raft_consensus.cc:359] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:18.964586  8494 raft_consensus.cc:740] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.965489  8494 consensus_queue.cc:260] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:18.968114  8494 ts_tablet_manager.cc:1434] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:18.969197  8494 tablet_bootstrap.cc:492] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:19.024284  8494 tablet_bootstrap.cc:492] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.025466  8494 tablet_bootstrap.cc:492] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:19.026362  8494 ts_tablet_manager.cc:1403] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.057s	user 0.036s	sys 0.020s
I20260709 13:00:19.029767  8494 raft_consensus.cc:359] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.030766  8494 raft_consensus.cc:740] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.031849  8494 consensus_queue.cc:260] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.034266  8494 ts_tablet_manager.cc:1434] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:19.035148  8494 tablet_bootstrap.cc:492] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:19.057839  8494 tablet_bootstrap.cc:492] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.060405  8494 tablet_bootstrap.cc:492] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:19.062589  8494 ts_tablet_manager.cc:1403] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 13:00:19.066684  8494 raft_consensus.cc:359] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.067554  8494 raft_consensus.cc:740] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.072430  8494 consensus_queue.cc:260] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.076334  8494 ts_tablet_manager.cc:1434] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:00:19.077486  8494 tablet_bootstrap.cc:492] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:19.099205  8494 tablet_bootstrap.cc:492] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.100299  8494 tablet_bootstrap.cc:492] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:19.101148  8494 ts_tablet_manager.cc:1403] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 13:00:19.103958  8494 raft_consensus.cc:359] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.105494  8494 raft_consensus.cc:740] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.106426  8494 consensus_queue.cc:260] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.108891  8494 ts_tablet_manager.cc:1434] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:19.109754  8494 tablet_bootstrap.cc:492] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:19.134995  8494 tablet_bootstrap.cc:492] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.136057  8494 tablet_bootstrap.cc:492] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:19.136850  8494 ts_tablet_manager.cc:1403] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 13:00:19.139477  8494 raft_consensus.cc:359] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.142112  8494 raft_consensus.cc:740] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.142940  8494 consensus_queue.cc:260] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.145529  8494 ts_tablet_manager.cc:1434] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:19.146427  8494 tablet_bootstrap.cc:492] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:19.187206  8494 tablet_bootstrap.cc:492] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.188711  8494 tablet_bootstrap.cc:492] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:19.189556  8494 ts_tablet_manager.cc:1403] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.015s
I20260709 13:00:19.192143  8494 raft_consensus.cc:359] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.193392  8494 raft_consensus.cc:740] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.194211  8494 consensus_queue.cc:260] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.195611  8464 raft_consensus.cc:493] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.196166  8464 raft_consensus.cc:515] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.196805  8494 ts_tablet_manager.cc:1434] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:19.197645  8494 tablet_bootstrap.cc:492] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:19.198717  8427 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.199225  8427 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.198333  8464 leader_election.cc:290] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:19.201203  8464 raft_consensus.cc:493] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.206032  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.207600  8471 raft_consensus.cc:493] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.213622  8502 raft_consensus.cc:493] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.214432  8502 raft_consensus.cc:515] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.216832  8025 raft_consensus.cc:493] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.208133  8471 raft_consensus.cc:515] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.217525  8025 raft_consensus.cc:515] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.226145  8427 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.228999  8025 leader_election.cc:290] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:19.231757  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f368c04a174168bd99e224010f9d92" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.234067  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:19.236119  8502 leader_election.cc:290] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:19.206137  8464 raft_consensus.cc:515] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.227819  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76db30f9818e4e4cb3825f84ad8e9223" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.237033  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.238015  8464 leader_election.cc:290] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.238134  8471 leader_election.cc:290] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.243609  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:19.256408  8413 raft_consensus.cc:493] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.257061  8413 raft_consensus.cc:515] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.259305  8413 leader_election.cc:290] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
W20260709 13:00:19.260300  7719 leader_election.cc:336] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.260886  8471 raft_consensus.cc:493] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.261015  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.261548  8471 raft_consensus.cc:515] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.261082  7719 leader_election.cc:304] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.264084  8413 raft_consensus.cc:493] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.270131  8471 leader_election.cc:290] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.262683  8494 tablet_bootstrap.cc:492] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.270362  8413 raft_consensus.cc:515] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.271111  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.271406  8494 tablet_bootstrap.cc:492] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:19.272233  8494 ts_tablet_manager.cc:1403] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.017s
I20260709 13:00:19.273188  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.275475  8494 raft_consensus.cc:359] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.276484  8494 raft_consensus.cc:740] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.275282  8413 leader_election.cc:290] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.277912  8494 consensus_queue.cc:260] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.279295  8539 raft_consensus.cc:2749] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.293848  8494 ts_tablet_manager.cc:1434] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:00:19.294721  8403 raft_consensus.cc:493] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.295063  8494 tablet_bootstrap.cc:492] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:19.295394  8403 raft_consensus.cc:515] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.303800  8413 raft_consensus.cc:493] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.304342  8413 raft_consensus.cc:515] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.304842  8403 leader_election.cc:290] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.306422  8413 leader_election.cc:290] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:19.306492  7867 leader_election.cc:336] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.308123  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.308800  7754 raft_consensus.cc:2468] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:19.308368  7867 leader_election.cc:304] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
W20260709 13:00:19.309957  7793 leader_election.cc:336] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.309867  7869 leader_election.cc:304] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:19.310933  8469 raft_consensus.cc:493] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.311148  8413 raft_consensus.cc:2804] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.311439  8469 raft_consensus.cc:515] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.311841  8471 raft_consensus.cc:2749] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.311546  8413 raft_consensus.cc:493] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.314118  8413 raft_consensus.cc:3060] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.313634  8469 leader_election.cc:290] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:19.320565  7793 leader_election.cc:336] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.320873  7867 leader_election.cc:336] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.321614  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f368c04a174168bd99e224010f9d92" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.322824  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.323278  7750 raft_consensus.cc:2468] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
W20260709 13:00:19.322551  7719 leader_election.cc:336] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.324249  7719 leader_election.cc:304] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
W20260709 13:00:19.325697  7719 leader_election.cc:336] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.326131  7719 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.326298  8539 raft_consensus.cc:493] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.326860  8502 raft_consensus.cc:2749] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:19.327203  7719 leader_election.cc:336] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.327553  8502 raft_consensus.cc:2749] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:19.327057  8539 raft_consensus.cc:515] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.327787  7719 leader_election.cc:304] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.328899  8403 raft_consensus.cc:493] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.324813  7867 leader_election.cc:304] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.331900  8502 raft_consensus.cc:2749] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:19.332115  7719 leader_election.cc:336] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.331724  8403 raft_consensus.cc:515] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.332149  8539 leader_election.cc:290] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.332825  7719 leader_election.cc:304] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.333206  8471 raft_consensus.cc:2749] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.334164  8403 leader_election.cc:290] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.335531  8502 raft_consensus.cc:2749] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:19.336827  7867 leader_election.cc:336] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.337275  7867 leader_election.cc:304] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.338446  8403 raft_consensus.cc:493] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.338825  8539 raft_consensus.cc:493] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.338971  8403 raft_consensus.cc:515] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.339355  8539 raft_consensus.cc:515] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.340371  7795 leader_election.cc:304] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.341192  8403 leader_election.cc:290] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.341727  8403 raft_consensus.cc:2749] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.342222  7795 leader_election.cc:304] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.342381  8502 raft_consensus.cc:493] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.342496  8539 leader_election.cc:290] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:19.342878  8502 raft_consensus.cc:515] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.343529  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.344995  8502 leader_election.cc:290] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
W20260709 13:00:19.346252  7793 leader_election.cc:336] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.343338  8471 raft_consensus.cc:2749] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.347956  8403 raft_consensus.cc:2804] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.348397  8403 raft_consensus.cc:493] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.348769  8403 raft_consensus.cc:3060] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.353284  8413 raft_consensus.cc:515] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
W20260709 13:00:19.356979  7793 leader_election.cc:336] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.357978  8469 raft_consensus.cc:493] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.358479  8469 raft_consensus.cc:515] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.358819  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.356559  8403 raft_consensus.cc:515] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.360595  8469 leader_election.cc:290] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.360528  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:19.360486  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:19.361334  7903 raft_consensus.cc:2468] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:19.361728  7750 raft_consensus.cc:3060] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.362608  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:19.366065  8413 leader_election.cc:290] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.367228  7720 leader_election.cc:304] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:19.368040  8502 raft_consensus.cc:2804] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.368408  8502 raft_consensus.cc:493] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.368803  8502 raft_consensus.cc:3060] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:19.368988  7793 leader_election.cc:336] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.369346  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76db30f9818e4e4cb3825f84ad8e9223" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
W20260709 13:00:19.369669  7793 leader_election.cc:336] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.369971  7903 raft_consensus.cc:2468] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
W20260709 13:00:19.371778  7867 leader_election.cc:336] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.372087  7795 leader_election.cc:304] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.372452  7867 leader_election.cc:304] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
W20260709 13:00:19.373880  7867 leader_election.cc:336] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.374665  8426 raft_consensus.cc:2749] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.374701  8413 raft_consensus.cc:2749] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.377938  7794 leader_election.cc:304] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.365232  8403 leader_election.cc:290] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.376497  8502 raft_consensus.cc:515] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.381055  8539 raft_consensus.cc:493] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.381603  8539 raft_consensus.cc:515] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.382341  8403 raft_consensus.cc:2804] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.382754  8403 raft_consensus.cc:493] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.383104  8403 raft_consensus.cc:3060] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.383725  8539 leader_election.cc:290] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.384135  8413 raft_consensus.cc:493] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.385386  8502 leader_election.cc:290] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.386404  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
W20260709 13:00:19.386498  7719 leader_election.cc:336] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.387394  7752 raft_consensus.cc:2468] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
W20260709 13:00:19.387817  7719 leader_election.cc:336] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.386521  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f368c04a174168bd99e224010f9d92" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:19.378855  8494 tablet_bootstrap.cc:492] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.391140  8426 raft_consensus.cc:493] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.391716  8426 raft_consensus.cc:515] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.393216  8494 tablet_bootstrap.cc:492] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:19.393950  8494 ts_tablet_manager.cc:1403] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.005s
I20260709 13:00:19.394146  8426 leader_election.cc:290] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.390695  7719 leader_election.cc:304] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.398351  8403 raft_consensus.cc:515] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
W20260709 13:00:19.398933  7793 leader_election.cc:336] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.399552  8502 raft_consensus.cc:2749] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.400672  8403 leader_election.cc:290] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.400764  8426 raft_consensus.cc:493] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.384990  8413 raft_consensus.cc:515] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
W20260709 13:00:19.401012  7719 leader_election.cc:336] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.401479  7754 raft_consensus.cc:3060] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.376566  7750 raft_consensus.cc:2468] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:19.403920  7719 leader_election.cc:304] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.404953  8413 leader_election.cc:290] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:19.405572  7793 leader_election.cc:336] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.405632  7867 leader_election.cc:336] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.401886  8494 raft_consensus.cc:359] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.409130  8539 raft_consensus.cc:2749] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.409231  8494 raft_consensus.cc:740] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:19.410310  8413 raft_consensus.cc:493] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.412039  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76db30f9818e4e4cb3825f84ad8e9223" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:19.412396  8413 raft_consensus.cc:515] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.412796  7897 raft_consensus.cc:3060] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.412567  8494 consensus_queue.cc:260] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.414829  8413 leader_election.cc:290] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.414991  8494 ts_tablet_manager.cc:1434] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:00:19.416035  8494 tablet_bootstrap.cc:492] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:19.417164  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:19.417984  7895 raft_consensus.cc:3060] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:19.418429  7719 leader_election.cc:336] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.419049  7719 leader_election.cc:336] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.410719  8539 raft_consensus.cc:493] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.411027  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:19.411386  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:19.411646  7795 leader_election.cc:304] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.420562  7869 leader_election.cc:304] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.421756  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.422540  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.437626  7823 raft_consensus.cc:2468] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:19.437855  8413 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.437999  7895 raft_consensus.cc:2468] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 2.
I20260709 13:00:19.438482  8413 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.439579  7866 leader_election.cc:304] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:19.439838  7894 raft_consensus.cc:2468] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:19.440622  8403 raft_consensus.cc:2804] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.440779  8413 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.441092  8403 raft_consensus.cc:493] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.441547  8403 raft_consensus.cc:3060] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.437207  7754 raft_consensus.cc:2468] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:19.443552  7795 leader_election.cc:304] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.429553  7903 raft_consensus.cc:2468] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:19.401427  8426 raft_consensus.cc:515] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.429594  8539 raft_consensus.cc:515] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.445534  8409 raft_consensus.cc:2804] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.444346  8469 raft_consensus.cc:2804] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.434710  7750 raft_consensus.cc:2468] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:19.437040  8471 raft_consensus.cc:2804] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.447535  8471 raft_consensus.cc:697] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:19.447880  8409 raft_consensus.cc:493] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.448544  8471 consensus_queue.cc:237] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.446842  8469 raft_consensus.cc:697] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:19.451175  8470 raft_consensus.cc:493] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.451257  8413 raft_consensus.cc:493] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.451768  8470 raft_consensus.cc:515] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.451924  8413 raft_consensus.cc:515] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.452332  7897 raft_consensus.cc:2468] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:19.454233  8426 leader_election.cc:290] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.451298  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.454353  8413 leader_election.cc:290] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.455075  8470 leader_election.cc:290] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.448518  8409 raft_consensus.cc:3060] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.456918  7869 leader_election.cc:304] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:19.457733  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.458595  7754 raft_consensus.cc:2468] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:19.460193  8469 consensus_queue.cc:237] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.459477  7720 leader_election.cc:304] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.463016  7794 leader_election.cc:304] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.464478  7794 leader_election.cc:304] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.464823  8470 raft_consensus.cc:2804] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.465418  8470 raft_consensus.cc:493] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.465674  8426 raft_consensus.cc:2804] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.465809  8539 leader_election.cc:290] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:19.464478  7720 leader_election.cc:304] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.455231  7750 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:19.458845  8413 raft_consensus.cc:2804] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.470214  8464 raft_consensus.cc:2804] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.470335  8413 raft_consensus.cc:493] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.470839  8464 raft_consensus.cc:697] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:19.471014  8413 raft_consensus.cc:3060] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.471484  8427 raft_consensus.cc:493] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.471865  8464 consensus_queue.cc:237] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.472054  8427 raft_consensus.cc:515] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.473822  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00647e852184fb281c21a8e4739e9e4" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:19.475273  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:19.479776  7903 raft_consensus.cc:2468] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:19.475847  8502 raft_consensus.cc:2804] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:19.476234  7867 leader_election.cc:336] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.477038  7719 leader_election.cc:336] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.477147  8540 raft_consensus.cc:493] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.464350  7869 leader_election.cc:304] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
W20260709 13:00:19.484596  7867 leader_election.cc:336] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.484087  7869 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:19.465921  8470 raft_consensus.cc:3060] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.505354  8557 raft_consensus.cc:493] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.505955  8557 raft_consensus.cc:515] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.498945  8553 raft_consensus.cc:2804] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.513975  8494 tablet_bootstrap.cc:492] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.516115  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.516876  7823 raft_consensus.cc:2468] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:19.517150  7794 leader_election.cc:304] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:19.481144  8502 raft_consensus.cc:493] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.518275  7718 leader_election.cc:304] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.522166  8494 tablet_bootstrap.cc:492] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:19.522926  8494 ts_tablet_manager.cc:1403] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.107s	user 0.022s	sys 0.007s
I20260709 13:00:19.524111  8557 leader_election.cc:290] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.531239  8502 raft_consensus.cc:3060] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.535065  8427 leader_election.cc:290] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
W20260709 13:00:19.543443  7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35833, user_credentials={real_user=slave}} blocked reactor thread for 59418.9us
I20260709 13:00:19.515130  8426 raft_consensus.cc:697] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:19.571169  7578 catalog_manager.cc:5697] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.517658  8553 raft_consensus.cc:493] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.573606  8025 raft_consensus.cc:2804] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.574721  8025 raft_consensus.cc:493] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.575132  8025 raft_consensus.cc:3060] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.507880  8540 raft_consensus.cc:515] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:19.580916  7719 leader_election.cc:336] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.595297  8494 raft_consensus.cc:359] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
W20260709 13:00:19.596904  7794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 57418.5us
I20260709 13:00:19.619318  8494 raft_consensus.cc:740] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
W20260709 13:00:19.601248  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 83056.8us
I20260709 13:00:19.587620  8025 raft_consensus.cc:515] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.620991  8494 consensus_queue.cc:260] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.655050  8464 raft_consensus.cc:493] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
W20260709 13:00:19.601969  7793 leader_election.cc:336] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.661227  7793 leader_election.cc:304] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.662876  8494 ts_tablet_manager.cc:1434] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.132s	user 0.010s	sys 0.009s
I20260709 13:00:19.663996  8494 tablet_bootstrap.cc:492] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:19.581676  8553 raft_consensus.cc:3060] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.674489  8025 leader_election.cc:290] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:19.660838  8540 leader_election.cc:290] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:19.581552  8557 raft_consensus.cc:2804] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.592000  8556 raft_consensus.cc:493] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.595759  8559 raft_consensus.cc:2804] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:19.597679  8469 raft_consensus.cc:493] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.598424  8558 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.656600  8464 raft_consensus.cc:515] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.694096  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.683395  8557 raft_consensus.cc:493] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.694422  8464 leader_election.cc:290] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:19.694870  7750 raft_consensus.cc:2468] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:19.690258  8556 raft_consensus.cc:515] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.694883  8557 raft_consensus.cc:3060] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.696864  8573 raft_consensus.cc:493] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.697367  8573 raft_consensus.cc:515] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.697607  8556 leader_election.cc:290] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.698354  8556 raft_consensus.cc:2749] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.699527  8573 leader_election.cc:290] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.690878  8469 raft_consensus.cc:515] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:19.706365  7867 leader_election.cc:336] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.706846  8469 leader_election.cc:290] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:19.707357  7867 leader_election.cc:336] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.713223  8470 raft_consensus.cc:515] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.592468  8409 raft_consensus.cc:515] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.694785  8574 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.719669  8574 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.720749  8558 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.722905  8558 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.687696  8559 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.725507  8559 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.679217  8426 consensus_queue.cc:237] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.729415  8571 raft_consensus.cc:493] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.735873  8409 leader_election.cc:290] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.737702  8574 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.729984  8571 raft_consensus.cc:515] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.739926  8571 leader_election.cc:290] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.703474  8413 raft_consensus.cc:515] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.742193  8413 leader_election.cc:290] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.727702  7576 catalog_manager.cc:5697] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:19.746313  7719 leader_election.cc:336] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.747043  7719 leader_election.cc:336] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.747723  8502 raft_consensus.cc:515] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.749722  8470 leader_election.cc:290] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.755399  8403 raft_consensus.cc:515] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:19.747687  7719 leader_election.cc:336] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.756611  8502 leader_election.cc:290] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.758369  8403 leader_election.cc:290] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:19.765655  7793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 163695us
W20260709 13:00:19.766489  7793 leader_election.cc:336] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.781152  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:19.789063  8584 raft_consensus.cc:493] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.789798  8584 raft_consensus.cc:515] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.798064  8584 leader_election.cc:290] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.778420  8557 raft_consensus.cc:515] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:19.806649  8553 raft_consensus.cc:515] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.807010  8557 leader_election.cc:290] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:19.805186  7894 raft_consensus.cc:2393] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 99e4e009f2884c8d9f7239b5375ab730 in current term 2: Already voted for candidate 98b07c9e416d4e32a62431b41b1fefa7 in this term.
I20260709 13:00:19.784713  7795 leader_election.cc:304] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:19.827287  8557 raft_consensus.cc:2804] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.840412  8557 raft_consensus.cc:493] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.842417  8557 raft_consensus.cc:3060] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.843681  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:19.844519  7751 raft_consensus.cc:2393] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b07c9e416d4e32a62431b41b1fefa7 in current term 2: Already voted for candidate 99e4e009f2884c8d9f7239b5375ab730 in this term.
I20260709 13:00:19.847416  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.848060  7752 raft_consensus.cc:2468] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:19.849078  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:19.849697  7751 raft_consensus.cc:3060] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.853487  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.854209  7750 raft_consensus.cc:2468] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:19.856823  7795 leader_election.cc:304] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:19.859068  8587 raft_consensus.cc:2804] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.859493  8587 raft_consensus.cc:493] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.859732  8553 leader_election.cc:290] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.859920  8587 raft_consensus.cc:3060] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.865121  7795 leader_election.cc:304] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:19.866168  8559 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.866950  8584 raft_consensus.cc:2804] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.867450  8584 raft_consensus.cc:493] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.867934  8584 raft_consensus.cc:3060] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:19.869730  7867 leader_election.cc:336] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.870352  7867 leader_election.cc:336] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.870815  7867 leader_election.cc:336] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.871284  7867 leader_election.cc:336] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.871706  7867 leader_election.cc:304] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
W20260709 13:00:19.872385  7794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 252117us
I20260709 13:00:19.877069  8593 raft_consensus.cc:2749] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:19.883872  7577 catalog_manager.cc:5697] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:19.885850  7793 leader_election.cc:336] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.888931  7793 leader_election.cc:336] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.889340  7793 leader_election.cc:336] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.889846  7793 leader_election.cc:336] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.890205  7793 leader_election.cc:336] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.890553  7793 leader_election.cc:336] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.891244  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:19.891544  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:19.891988  7755 raft_consensus.cc:2468] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
W20260709 13:00:19.871539  7719 leader_election.cc:336] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.892879  7719 leader_election.cc:304] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.892097  7754 raft_consensus.cc:3060] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.897795  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:19.898604  7752 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.900271  7751 raft_consensus.cc:2468] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:19.884292  8559 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.910935  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:19.911899  7827 raft_consensus.cc:2393] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b07c9e416d4e32a62431b41b1fefa7 in current term 2: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:19.911059  7751 raft_consensus.cc:1275] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:19.913147  8584 raft_consensus.cc:515] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.914150  8593 consensus_queue.cc:1048] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:19.914390  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.915215  7827 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:19.915359  8584 leader_election.cc:290] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:19.917649  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00647e852184fb281c21a8e4739e9e4" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.918495  7827 raft_consensus.cc:2468] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:19.919986  8566 raft_consensus.cc:2749] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:19.922859  7719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 51332.5us
W20260709 13:00:19.922362  7793 leader_election.cc:336] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:19.924949  7793 leader_election.cc:336] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.926350  7795 leader_election.cc:304] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.927498  7795 leader_election.cc:304] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:19.938794  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.942997  7827 raft_consensus.cc:2393] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99e4e009f2884c8d9f7239b5375ab730 in current term 2: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:19.945399  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.946153  7821 raft_consensus.cc:2468] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 1.
I20260709 13:00:19.937160  8561 raft_consensus.cc:2804] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:19.947229  8561 raft_consensus.cc:493] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:19.947525  8561 raft_consensus.cc:3060] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.953174  7754 raft_consensus.cc:2468] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:19.955226  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:19.956099  7755 raft_consensus.cc:3060] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.957644  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:19.954239  7869 leader_election.cc:304] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:19.955192  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:19.961082  7828 raft_consensus.cc:3060] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.949136  7752 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 3.
I20260709 13:00:19.965566  7869 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: 
I20260709 13:00:19.966437  8581 raft_consensus.cc:2804] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:19.966364  8559 raft_consensus.cc:2804] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.967061  8581 raft_consensus.cc:697] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:19.967372  8559 raft_consensus.cc:697] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:19.968571  8559 consensus_queue.cc:237] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:19.969509  7755 raft_consensus.cc:2468] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:19.937669  8584 raft_consensus.cc:2804] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.970758  8584 raft_consensus.cc:697] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:19.971709  8584 consensus_queue.cc:237] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.967990  8581 consensus_queue.cc:237] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
W20260709 13:00:19.975992  7867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43363, user_credentials={real_user=slave}} blocked reactor thread for 48183.5us
I20260709 13:00:19.875469  8587 raft_consensus.cc:515] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:19.980758  8587 leader_election.cc:290] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:19.941536  7793 leader_election.cc:336] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:19.984256  7828 raft_consensus.cc:2468] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 2.
I20260709 13:00:19.987881  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:19.988786  7903 raft_consensus.cc:2468] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:20.009343  7795 leader_election.cc:304] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:20.010879  8426 raft_consensus.cc:2804] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.011637  8426 raft_consensus.cc:697] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:20.012964  8426 consensus_queue.cc:237] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
W20260709 13:00:20.018669  7793 leader_election.cc:336] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:20.023950  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:20.024854  7755 raft_consensus.cc:3060] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.029834  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.029974  8557 raft_consensus.cc:515] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.030762  7894 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:19.980453  8561 raft_consensus.cc:515] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.035193  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:20.036041  7897 raft_consensus.cc:2393] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 2: Already voted for candidate 98b07c9e416d4e32a62431b41b1fefa7 in this term.
W20260709 13:00:20.036214  7793 leader_election.cc:336] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:20.037317  7822 raft_consensus.cc:2393] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99e4e009f2884c8d9f7239b5375ab730 in current term 2: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:20.037431  8561 leader_election.cc:290] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:20.039400  7755 raft_consensus.cc:2468] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:20.046609  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:20.047825  7894 raft_consensus.cc:3060] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:20.049043  7793 leader_election.cc:336] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:20.039240  8557 leader_election.cc:290] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:20.053257  7793 leader_election.cc:336] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:20.054035  7793 consensus_peers.cc:597] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.088039  8494 tablet_bootstrap.cc:492] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:20.089186  8494 tablet_bootstrap.cc:492] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:20.089818  8494 ts_tablet_manager.cc:1403] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.426s	user 0.025s	sys 0.052s
I20260709 13:00:20.095161  7794 leader_election.cc:304] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.096220  7795 leader_election.cc:304] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.099776  7866 leader_election.cc:304] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.091849  7718 leader_election.cc:304] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.104060  7794 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.111167  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:20.111382  7894 raft_consensus.cc:2468] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:20.111894  7752 raft_consensus.cc:3060] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.112730  8557 raft_consensus.cc:2804] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:20.118002  8557 raft_consensus.cc:493] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:20.118424  8557 raft_consensus.cc:3060] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.120932  8577 raft_consensus.cc:2749] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.125165  7718 leader_election.cc:304] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.113361  7866 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.115540  8568 raft_consensus.cc:2749] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.126173  8568 raft_consensus.cc:2804] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:20.126453  8583 raft_consensus.cc:2804] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:20.126535  8568 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:20.126849  7718 leader_election.cc:304] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.127068  8583 raft_consensus.cc:493] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:20.127153  8568 raft_consensus.cc:3060] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.127560  8583 raft_consensus.cc:3060] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.128897  8586 raft_consensus.cc:2804] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.129410  8586 raft_consensus.cc:697] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:20.129839  8494 raft_consensus.cc:359] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.116515  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:20.130231  8586 consensus_queue.cc:237] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.131448  7749 raft_consensus.cc:3060] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.126466  7866 leader_election.cc:304] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.130584  8494 raft_consensus.cc:740] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.134613  7718 leader_election.cc:304] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.134881  7794 leader_election.cc:304] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544
W20260709 13:00:20.137190  7867 leader_election.cc:336] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:20.138048  7867 leader_election.cc:336] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:20.135094  8494 consensus_queue.cc:260] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.143805  8494 ts_tablet_manager.cc:1434] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.003s
I20260709 13:00:20.144855  8494 tablet_bootstrap.cc:492] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:20.150439  8575 raft_consensus.cc:2749] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.155962  8557 raft_consensus.cc:515] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.147874  8403 raft_consensus.cc:2804] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:20.162948  8403 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:20.163385  8403 raft_consensus.cc:3060] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.148011  8593 raft_consensus.cc:2804] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:20.166152  7867 consensus_peers.cc:597] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.166455  8593 raft_consensus.cc:493] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:20.166869  8593 raft_consensus.cc:3060] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.168354  8557 leader_election.cc:290] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:20.159984  7749 raft_consensus.cc:2468] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:20.170835  8025 raft_consensus.cc:2749] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.172257  7897 raft_consensus.cc:1275] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Refusing update from remote peer 99e4e009f2884c8d9f7239b5375ab730: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:20.172825  7793 leader_election.cc:336] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:20.174288  8025 consensus_queue.cc:1048] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.140974  8426 raft_consensus.cc:2804] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.181151  8426 raft_consensus.cc:697] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:20.160916  8496 raft_consensus.cc:493] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.181687  7897 raft_consensus.cc:1275] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:20.159708  7719 consensus_peers.cc:597] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.186198  7752 raft_consensus.cc:2468] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:20.201032  7795 leader_election.cc:304] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.193734  7794 leader_election.cc:304] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.195168  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:20.204344  7903 raft_consensus.cc:3060] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.206136  7795 leader_election.cc:304] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.207873  8561 raft_consensus.cc:2804] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.213279  8565 raft_consensus.cc:2804] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.207594  8584 raft_consensus.cc:2804] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.229544  8565 raft_consensus.cc:697] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:20.222450  8587 consensus_queue.cc:1048] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:00:20.231427  8561 raft_consensus.cc:697] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:20.232218  8584 raft_consensus.cc:697] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:20.251720  7903 raft_consensus.cc:2468] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:20.253098  7794 leader_election.cc:304] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.256191  8576 raft_consensus.cc:2804] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.230629  8568 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.199513  8496 raft_consensus.cc:515] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.240396  8583 raft_consensus.cc:515] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.229202  8426 consensus_queue.cc:237] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.235707  8565 consensus_queue.cc:237] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.268922  8576 raft_consensus.cc:697] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:20.269910  7751 raft_consensus.cc:1275] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.276098  8584 consensus_queue.cc:237] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.280179  8496 leader_election.cc:290] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:20.276314  8612 raft_consensus.cc:493] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.318159  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcc74c073a446fdb54d5af775d46abc" candidate_uuid: "99e4e009f2884c8d9f7239b5375ab730" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:20.319000  7827 raft_consensus.cc:3060] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.306039  8403 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.271240  8561 consensus_queue.cc:237] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.286155  8611 raft_consensus.cc:493] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.316629  8583 leader_election.cc:290] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:20.344626  8496 raft_consensus.cc:493] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.344796  8568 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:20.348281  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:20.351034  8403 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:20.351639  7828 raft_consensus.cc:2393] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b07c9e416d4e32a62431b41b1fefa7 in current term 2: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:20.278311  8576 consensus_queue.cc:237] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.345269  8496 raft_consensus.cc:515] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.374750  7827 raft_consensus.cc:2468] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e4e009f2884c8d9f7239b5375ab730 in term 2.
I20260709 13:00:20.322283  8612 raft_consensus.cc:515] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:20.333323  8426 consensus_queue.cc:1048] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:00:20.381333  7718 leader_election.cc:304] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:20.388989  8025 raft_consensus.cc:2804] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.389472  8025 raft_consensus.cc:697] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 2 LEADER]: Becoming Leader. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:20.390254  8025 consensus_queue.cc:237] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.340803  8611 raft_consensus.cc:515] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:20.398826  8496 leader_election.cc:290] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:20.364943  8593 raft_consensus.cc:515] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.415623  8611 leader_election.cc:290] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:20.409412  8496 raft_consensus.cc:493] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.418421  8612 leader_election.cc:290] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:20.474041  8593 leader_election.cc:290] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:20.460239  8496 raft_consensus.cc:515] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.483323  8626 raft_consensus.cc:493] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.484469  8626 raft_consensus.cc:515] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
W20260709 13:00:20.532511  7866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 75164.1us
I20260709 13:00:20.536162  8494 tablet_bootstrap.cc:492] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:20.536154  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00647e852184fb281c21a8e4739e9e4" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:20.538106  7827 raft_consensus.cc:3060] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.538816  8612 raft_consensus.cc:493] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.547166  7827 raft_consensus.cc:2468] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:20.547257  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:20.548213  7897 raft_consensus.cc:2393] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 2: Already voted for candidate 98b07c9e416d4e32a62431b41b1fefa7 in this term.
I20260709 13:00:20.550144  8611 raft_consensus.cc:493] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.550629  7866 leader_election.cc:304] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:20.550663  8611 raft_consensus.cc:515] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:20.552001  8553 raft_consensus.cc:2804] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.552493  8553 raft_consensus.cc:697] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:20.553238  8611 leader_election.cc:290] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:20.553380  8553 consensus_queue.cc:237] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.559568  8496 leader_election.cc:290] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:20.543685  8626 leader_election.cc:290] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:20.560364  7793 consensus_peers.cc:597] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.564167  7754 raft_consensus.cc:1275] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:20.565496  7719 leader_election.cc:336] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:20.566278  7719 consensus_peers.cc:597] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:20.580013  8494 tablet_bootstrap.cc:492] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:20.561512  8612 raft_consensus.cc:515] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:20.583716  8612 leader_election.cc:290] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:20.586102  8558 consensus_queue.cc:1048] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.595170  8494 ts_tablet_manager.cc:1403] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.451s	user 0.033s	sys 0.015s
I20260709 13:00:20.614194  7755 raft_consensus.cc:1275] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.619153  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e478963dd04f1f8913edd2870132d1" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.620538  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.622364  7903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe505815234b019c30d15aac38e187" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.631448  7901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.635780  8496 raft_consensus.cc:493] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.636289  8496 raft_consensus.cc:515] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.636471  8580 consensus_queue.cc:1048] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.638460  8496 leader_election.cc:290] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:20.639149  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.634100  8626 raft_consensus.cc:493] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.620995  8612 raft_consensus.cc:493] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.641077  8612 raft_consensus.cc:515] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.620924  7900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9708521c863f4f02b5ea46f35013e91c" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.643081  8612 leader_election.cc:290] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:20.643859  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.634711  8494 raft_consensus.cc:359] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.644675  7897 raft_consensus.cc:2393] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f91d8d830a474ea7a101fc5b6f920544 in current term 2: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:20.645112  8494 raft_consensus.cc:740] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:20.640313  8626 raft_consensus.cc:515] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:20.646044  8494 consensus_queue.cc:260] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
W20260709 13:00:20.651947  7793 consensus_peers.cc:597] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:20.665347  7719 consensus_peers.cc:597] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:20.666088  7719 consensus_peers.cc:597] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:20.652560  7793 leader_election.cc:336] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:20.657260  7576 catalog_manager.cc:5697] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 2 to 3, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.667973  7793 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff; no voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.668527  8494 ts_tablet_manager.cc:1434] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:00:20.669648  8494 tablet_bootstrap.cc:492] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:20.669032  7576 catalog_manager.cc:5697] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:20.669929  7793 consensus_peers.cc:597] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:20.647017  8626 leader_election.cc:290] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:20.682590  7749 raft_consensus.cc:1275] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.683104  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c0ccc08b9c4764be5e221aa04d31ef" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.675143  8612 raft_consensus.cc:493] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.674453  8576 raft_consensus.cc:2749] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:20.690907  7793 consensus_peers.cc:597] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:20.691552  7755 raft_consensus.cc:1275] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:20.688323  8584 consensus_queue.cc:1048] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:00:20.693424  8581 consensus_queue.cc:1048] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.690341  8612 raft_consensus.cc:515] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:20.695770  8612 leader_election.cc:290] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:20.707693  7867 consensus_peers.cc:597] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:20.708252  7867 consensus_peers.cc:597] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.700269  7897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
W20260709 13:00:20.721567  7719 consensus_peers.cc:597] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:20.726446  7867 leader_election.cc:336] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:20.732120  7867 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:20.730912  7577 catalog_manager.cc:5697] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.736090  7577 catalog_manager.cc:5697] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.738719  7577 catalog_manager.cc:5697] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.742292  7577 catalog_manager.cc:5697] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.745082  7577 catalog_manager.cc:5697] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.746407  7754 raft_consensus.cc:1275] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.746528  8612 raft_consensus.cc:493] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.748731  7577 catalog_manager.cc:5697] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.751761  7577 catalog_manager.cc:5697] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.753705  8555 consensus_queue.cc:1048] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.752234  8612 raft_consensus.cc:515] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:20.756820  8612 leader_election.cc:290] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:20.755937  7577 catalog_manager.cc:5697] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.740969  8581 raft_consensus.cc:2749] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.752524  7754 raft_consensus.cc:1275] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.769618  7828 raft_consensus.cc:1275] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Refusing update from remote peer 99e4e009f2884c8d9f7239b5375ab730: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.770931  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:20.771442  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c0ccc08b9c4764be5e221aa04d31ef" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:20.772469  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:20.773118  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:20.772521  8403 consensus_queue.cc:1048] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.775388  7900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3aa569bb2f4c58bc92f779a43caad0" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.776750  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:20.781883  7828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:20.786770  8488 leader_election.cc:304] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:20.788172  8488 leader_election.cc:304] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:20.789067  8626 raft_consensus.cc:2749] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.789700  8626 raft_consensus.cc:2749] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.791379  8488 leader_election.cc:304] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:20.793183  8626 raft_consensus.cc:3060] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:20.798746  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 47010.7us
W20260709 13:00:20.801064  7719 consensus_peers.cc:597] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:20.816931  7867 leader_election.cc:336] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
W20260709 13:00:20.817957  7867 consensus_peers.cc:597] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.821394  8626 raft_consensus.cc:2749] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.821707  8586 consensus_queue.cc:1048] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.822903  8612 raft_consensus.cc:493] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.844726  7793 consensus_peers.cc:597] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:20.847187  7793 consensus_peers.cc:597] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:20.847627  7793 consensus_peers.cc:597] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.843063  8612 raft_consensus.cc:515] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:20.866125  8612 leader_election.cc:290] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:20.868109  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
W20260709 13:00:20.870884  7719 consensus_peers.cc:597] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:20.891191  7793 consensus_peers.cc:597] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:20.892467  7793 consensus_peers.cc:597] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.881589  8612 raft_consensus.cc:493] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.894503  8612 raft_consensus.cc:515] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:20.897392  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4953a51e627b477992fa1569ba01e121" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:20.899014  8612 leader_election.cc:290] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:20.899895  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4953a51e627b477992fa1569ba01e121" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:20.900137  7754 raft_consensus.cc:1275] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.901564  8490 leader_election.cc:304] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:20.903443  8612 raft_consensus.cc:2749] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.906087  8575 consensus_queue.cc:1048] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.914129  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0d5877ad7a44398c02291a8cbf65d7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.924134  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e478963dd04f1f8913edd2870132d1" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.925665  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9708521c863f4f02b5ea46f35013e91c" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.928489  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.929793  7894 raft_consensus.cc:1275] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.933120  7578 catalog_manager.cc:5697] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.938705  7755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.939150  7749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.939576  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.944882  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9411be3e9dce40b3bb27db670ad0ac4f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.932446  8470 consensus_queue.cc:1048] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:00:20.947516  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3aa569bb2f4c58bc92f779a43caad0" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.948385  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe505815234b019c30d15aac38e187" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.949724  7753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595e433cb28c45c1891f471d7d5e3493" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:20.961040  7826 raft_consensus.cc:1275] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Refusing update from remote peer 99e4e009f2884c8d9f7239b5375ab730: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.966018  8491 leader_election.cc:304] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:20.967489  8491 leader_election.cc:304] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:20.968255  8626 raft_consensus.cc:2749] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.968788  8612 raft_consensus.cc:2749] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.974004  7576 catalog_manager.cc:5697] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.979864  8491 leader_election.cc:304] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:20.985188  8491 leader_election.cc:304] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:20.986408  8491 leader_election.cc:304] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:20.980181  8464 consensus_queue.cc:1048] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:00:20.988976  8496 raft_consensus.cc:2749] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.989849  8496 raft_consensus.cc:2749] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:20.990628  8496 raft_consensus.cc:2749] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.001367  7900 raft_consensus.cc:1275] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.992478  8491 leader_election.cc:304] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:21.004953  8403 consensus_queue.cc:1048] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:21.005513  8612 raft_consensus.cc:2749] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.007004  8491 leader_election.cc:304] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:21.011757  8612 raft_consensus.cc:2749] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.015012  8491 leader_election.cc:304] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:21.018971  8494 tablet_bootstrap.cc:492] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.029325   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43363
I20260709 13:00:21.029459  8658 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43363 every 8 connection(s)
I20260709 13:00:21.027575  8612 raft_consensus.cc:2749] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.034742  8491 leader_election.cc:304] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:21.045215  8494 tablet_bootstrap.cc:492] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.046017  8494 ts_tablet_manager.cc:1403] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.377s	user 0.034s	sys 0.002s
I20260709 13:00:21.048357  8612 raft_consensus.cc:493] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.048904  8612 raft_consensus.cc:515] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:21.049785  8494 raft_consensus.cc:359] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.051265  8494 raft_consensus.cc:740] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.051944  8494 consensus_queue.cc:260] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.052381  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:21.054090  8494 ts_tablet_manager.cc:1434] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:21.054915  8494 tablet_bootstrap.cc:492] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.051280  8612 leader_election.cc:290] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:21.063103  8612 raft_consensus.cc:2749] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.063683  8491 leader_election.cc:304] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:21.064582  8612 raft_consensus.cc:2749] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.065152  8626 raft_consensus.cc:493] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.065963  8626 raft_consensus.cc:515] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.068627  8626 leader_election.cc:290] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:21.069875  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:21.070103  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a838c80f5aa84e38ae70747f05808e0d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:21.071702  8490 leader_election.cc:304] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:21.073262  8626 raft_consensus.cc:2749] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:21.059401  7576 catalog_manager.cc:5697] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 2, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "99e4e009f2884c8d9f7239b5375ab730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } }
I20260709 13:00:21.065128  8491 leader_election.cc:304] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:21.082384  8626 raft_consensus.cc:2749] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.128706  7823 raft_consensus.cc:1275] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:21.132795  8637 consensus_queue.cc:1048] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:00:21.153187  8494 tablet_bootstrap.cc:492] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.154208  8494 tablet_bootstrap.cc:492] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
W20260709 13:00:21.154248  7719 consensus_peers.cc:597] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:21.154889  8494 ts_tablet_manager.cc:1403] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.008s
W20260709 13:00:21.155288  7719 consensus_peers.cc:597] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:21.155977  7719 consensus_peers.cc:597] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:21.174535  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e8786bbce6485a8f5293b40587c372" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:21.176774  8494 raft_consensus.cc:359] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.177014  8491 leader_election.cc:304] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730
I20260709 13:00:21.177911  8626 raft_consensus.cc:493] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.178447  8612 raft_consensus.cc:2749] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.178452  8626 raft_consensus.cc:515] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:21.181936  8626 leader_election.cc:290] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:21.182574  8545 raft_consensus.cc:3060] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.182945  8542 raft_consensus.cc:3060] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.177564  8494 raft_consensus.cc:740] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.184938  8494 consensus_queue.cc:260] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.186141  8494 ts_tablet_manager.cc:1434] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:00:21.186705  8494 tablet_bootstrap.cc:492] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.191767  8546 raft_consensus.cc:1275] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:21.202108  7793 consensus_peers.cc:597] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:21.203609  8660 log.cc:927] Time spent T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:21.203794  8403 consensus_queue.cc:1048] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:21.205394  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
W20260709 13:00:21.212400  7793 consensus_peers.cc:597] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:21.225160  8548 raft_consensus.cc:3060] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.229981  8496 raft_consensus.cc:493] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.232522  8496 raft_consensus.cc:515] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.234624  8496 leader_election.cc:290] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:21.216053  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:21.236897  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fade69c67ff4012b5e46a32966edb24" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:21.245349  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fade69c67ff4012b5e46a32966edb24" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:21.252516  8488 leader_election.cc:304] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:21.253902  8626 raft_consensus.cc:2749] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.280880  8542 raft_consensus.cc:1275] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:21.279191  8545 raft_consensus.cc:1275] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:21.295249  8661 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43053
I20260709 13:00:21.295809  8661 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:21.296705  8661 heartbeater.cc:507] Master 127.0.107.254:43053 requested a full tablet report, sending...
I20260709 13:00:21.286787  8491 leader_election.cc:304] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d8d830a474ea7a101fc5b6f920544; no voters: 99e4e009f2884c8d9f7239b5375ab730, cbfd6094b47e463383f6b206c98e52ff
I20260709 13:00:21.300216  8626 raft_consensus.cc:2749] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:21.301385  8494 tablet_bootstrap.cc:492] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.302678  8494 tablet_bootstrap.cc:492] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.303104  8470 consensus_queue.cc:1048] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:21.303525  8494 ts_tablet_manager.cc:1403] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.117s	user 0.024s	sys 0.018s
I20260709 13:00:21.306246  8470 consensus_queue.cc:1048] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:21.307533  8494 raft_consensus.cc:359] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.308298  8494 raft_consensus.cc:740] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.315855  8543 raft_consensus.cc:3060] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.322065  8494 consensus_queue.cc:260] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.323803  8494 ts_tablet_manager.cc:1434] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:00:21.324447  8494 tablet_bootstrap.cc:492] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
W20260709 13:00:21.328130  7867 consensus_peers.cc:597] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:21.342020  7867 consensus_peers.cc:597] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:21.342686  7867 consensus_peers.cc:597] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:21.325906  8548 raft_consensus.cc:3060] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:21.347306  7793 consensus_peers.cc:597] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:21.348157  8544 raft_consensus.cc:3060] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:21.418085  7793 consensus_peers.cc:597] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:21.419479  8494 tablet_bootstrap.cc:492] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.420563  8494 tablet_bootstrap.cc:492] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.423704  8494 ts_tablet_manager.cc:1403] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.099s	user 0.025s	sys 0.012s
I20260709 13:00:21.426854  8494 raft_consensus.cc:359] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.427570  8494 raft_consensus.cc:740] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.428242  8494 consensus_queue.cc:260] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.430567  8494 ts_tablet_manager.cc:1434] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:00:21.431945  8494 tablet_bootstrap.cc:492] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.443063  7576 ts_manager.cc:194] Re-registered known tserver with Master: f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:21.467262  8494 tablet_bootstrap.cc:492] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.468209  8494 tablet_bootstrap.cc:492] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.468870  8494 ts_tablet_manager.cc:1403] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.014s
I20260709 13:00:21.472493  8494 raft_consensus.cc:359] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:21.473191  8494 raft_consensus.cc:740] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.473842  8494 consensus_queue.cc:260] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:21.484388  8494 ts_tablet_manager.cc:1434] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 13:00:21.485301  8494 tablet_bootstrap.cc:492] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.485525  8548 raft_consensus.cc:3060] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.527845  8494 tablet_bootstrap.cc:492] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.529240  8494 tablet_bootstrap.cc:492] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.529908  8494 ts_tablet_manager.cc:1403] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.012s
I20260709 13:00:21.532793  8494 raft_consensus.cc:359] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:21.547302  8494 raft_consensus.cc:740] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.548100  8494 consensus_queue.cc:260] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:21.553061  8494 ts_tablet_manager.cc:1434] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:00:21.553928  8494 tablet_bootstrap.cc:492] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.596431  8494 tablet_bootstrap.cc:492] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.599104  8494 tablet_bootstrap.cc:492] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.600046  8494 ts_tablet_manager.cc:1403] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.004s
I20260709 13:00:21.602926  8494 raft_consensus.cc:359] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:21.603804  8494 raft_consensus.cc:740] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.604712  8494 consensus_queue.cc:260] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:21.607435  8494 ts_tablet_manager.cc:1434] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:21.608350  8494 tablet_bootstrap.cc:492] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.624822  7576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60370
I20260709 13:00:21.630518  8661 heartbeater.cc:499] Master 127.0.107.254:43053 was elected leader, sending a full tablet report...
I20260709 13:00:21.642446  8494 tablet_bootstrap.cc:492] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.644033  8634 raft_consensus.cc:493] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.644590  8634 raft_consensus.cc:515] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:21.648113  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
W20260709 13:00:21.649619  7867 leader_election.cc:343] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:21.653141  8634 leader_election.cc:290] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:21.654428  8494 tablet_bootstrap.cc:492] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.656123  8494 ts_tablet_manager.cc:1403] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.003s
I20260709 13:00:21.658890  8494 raft_consensus.cc:359] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:21.659258  8548 raft_consensus.cc:3060] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.659693  7751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730" is_pre_election: true
I20260709 13:00:21.660415  7751 raft_consensus.cc:2468] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:21.662774  7869 leader_election.cc:304] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:21.664211  8553 raft_consensus.cc:2804] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:21.664628  8553 raft_consensus.cc:493] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.665043  8553 raft_consensus.cc:3060] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.659564  8494 raft_consensus.cc:740] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.680112  8494 consensus_queue.cc:260] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:21.682209  8494 ts_tablet_manager.cc:1434] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:00:21.682951  8494 tablet_bootstrap.cc:492] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.690657  8553 raft_consensus.cc:515] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:21.693544  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:21.693759  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acef6aca57b4db8a13916f345d24f12" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:21.694375  7750 raft_consensus.cc:3060] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.702091  8553 leader_election.cc:290] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: Requested vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:21.706147  7867 leader_election.cc:343] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:21.717697  8542 raft_consensus.cc:3060] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.720808  7750 raft_consensus.cc:2468] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 3.
I20260709 13:00:21.725438  7869 leader_election.cc:304] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, 99e4e009f2884c8d9f7239b5375ab730; no voters: f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:21.727497  8553 raft_consensus.cc:2804] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:21.728329  8553 raft_consensus.cc:697] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:21.730540  8553 consensus_queue.cc:237] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:21.763744  8494 tablet_bootstrap.cc:492] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.765267  8494 tablet_bootstrap.cc:492] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.766723  7575 catalog_manager.cc:5697] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 1 to 3, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:21.771950  8494 ts_tablet_manager.cc:1403] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.083s	user 0.041s	sys 0.015s
I20260709 13:00:21.775817  8494 raft_consensus.cc:359] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.777086  8494 raft_consensus.cc:740] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.778296  8494 consensus_queue.cc:260] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.786425  8494 ts_tablet_manager.cc:1434] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:00:21.789680  8494 tablet_bootstrap.cc:492] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.873798  8637 raft_consensus.cc:493] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.874326  8637 raft_consensus.cc:515] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.876665  8637 leader_election.cc:290] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:21.877396  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:21.878161  7826 raft_consensus.cc:2468] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:21.879352  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:21.880107  8542 raft_consensus.cc:2468] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:21.879369  7866 leader_election.cc:304] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:21.882453  8637 raft_consensus.cc:2804] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:21.882817  8637 raft_consensus.cc:493] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.883141  8637 raft_consensus.cc:3060] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.895047  8494 tablet_bootstrap.cc:492] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.896108  8494 tablet_bootstrap.cc:492] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.899943  8637 raft_consensus.cc:515] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.902806  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:21.903111  8494 ts_tablet_manager.cc:1403] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.006s
I20260709 13:00:21.903506  7826 raft_consensus.cc:3060] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.906857  8637 leader_election.cc:290] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:21.907140  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33aed1bca5e4615a453a14181ce357d" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:21.907560  8494 raft_consensus.cc:359] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:21.908308  8494 raft_consensus.cc:740] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.907872  8542 raft_consensus.cc:3060] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:21.909174  8494 consensus_queue.cc:260] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:21.911031  8494 ts_tablet_manager.cc:1434] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 13:00:21.914650  7826 raft_consensus.cc:2468] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 3.
I20260709 13:00:21.916002  8494 tablet_bootstrap.cc:492] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.916810  8542 raft_consensus.cc:2468] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 3.
I20260709 13:00:21.918116  7866 leader_election.cc:304] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:21.918901  8553 raft_consensus.cc:2804] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:21.919386  8553 raft_consensus.cc:697] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:21.920217  8553 consensus_queue.cc:237] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.970279  8494 tablet_bootstrap.cc:492] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:21.971346  8494 tablet_bootstrap.cc:492] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:21.971983  8494 ts_tablet_manager.cc:1403] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.018s
I20260709 13:00:21.978644  8494 raft_consensus.cc:359] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.981228  8494 raft_consensus.cc:740] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:21.982013  8494 consensus_queue.cc:260] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:21.988955  8494 ts_tablet_manager.cc:1434] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.005s
I20260709 13:00:21.989809  8494 tablet_bootstrap.cc:492] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:21.964232  7575 catalog_manager.cc:5697] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 1 to 3, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:22.022555  8548 raft_consensus.cc:3060] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.023826  8494 tablet_bootstrap.cc:492] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.025749  8494 tablet_bootstrap.cc:492] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.026955  8494 ts_tablet_manager.cc:1403] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.005s
I20260709 13:00:22.032405  8494 raft_consensus.cc:359] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.033284  8494 raft_consensus.cc:740] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.034117  8494 consensus_queue.cc:260] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.035918  8494 ts_tablet_manager.cc:1434] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:00:22.036933  8494 tablet_bootstrap.cc:492] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.042239  8542 raft_consensus.cc:3060] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.089926  8494 tablet_bootstrap.cc:492] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.091501  8494 tablet_bootstrap.cc:492] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.093441  8494 ts_tablet_manager.cc:1403] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.057s	user 0.029s	sys 0.023s
I20260709 13:00:22.096437  8494 raft_consensus.cc:359] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.097294  8494 raft_consensus.cc:740] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.098160  8494 consensus_queue.cc:260] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.100795  8494 ts_tablet_manager.cc:1434] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:22.102856  8494 tablet_bootstrap.cc:492] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.121479  8494 tablet_bootstrap.cc:492] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.122478  8494 tablet_bootstrap.cc:492] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.123234  8494 ts_tablet_manager.cc:1403] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:00:22.125989  8494 raft_consensus.cc:359] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.126760  8494 raft_consensus.cc:740] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.127542  8494 consensus_queue.cc:260] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.131289  8494 ts_tablet_manager.cc:1434] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:00:22.134420  8494 tablet_bootstrap.cc:492] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.150291  8494 tablet_bootstrap.cc:492] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.151212  8494 tablet_bootstrap.cc:492] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.151903  8494 ts_tablet_manager.cc:1403] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:00:22.154455  8494 raft_consensus.cc:359] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.155133  8494 raft_consensus.cc:740] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.155761  8494 consensus_queue.cc:260] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.158459  8494 ts_tablet_manager.cc:1434] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.001s
I20260709 13:00:22.162851  8494 tablet_bootstrap.cc:492] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.183470  8494 tablet_bootstrap.cc:492] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.184473  8494 tablet_bootstrap.cc:492] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.185180  8494 ts_tablet_manager.cc:1403] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 13:00:22.187834  8494 raft_consensus.cc:359] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.188541  8494 raft_consensus.cc:740] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.189270  8494 consensus_queue.cc:260] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.191669  8494 ts_tablet_manager.cc:1434] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:00:22.192550  8494 tablet_bootstrap.cc:492] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.215112  8494 tablet_bootstrap.cc:492] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.216064  8494 tablet_bootstrap.cc:492] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.216823  8494 ts_tablet_manager.cc:1403] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 13:00:22.219280  8494 raft_consensus.cc:359] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.219986  8494 raft_consensus.cc:740] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.220754  8494 consensus_queue.cc:260] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.223204  8494 ts_tablet_manager.cc:1434] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:22.224052  8494 tablet_bootstrap.cc:492] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.231019  7750 raft_consensus.cc:1275] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:22.233675  8553 consensus_queue.cc:1048] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.247154  8494 tablet_bootstrap.cc:492] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.248442  8494 tablet_bootstrap.cc:492] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.240855  8542 raft_consensus.cc:3060] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.249305  8494 ts_tablet_manager.cc:1403] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 13:00:22.252357  8494 raft_consensus.cc:359] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.253064  8494 raft_consensus.cc:740] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.253770  8494 consensus_queue.cc:260] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.256168  8494 ts_tablet_manager.cc:1434] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:22.257015  8494 tablet_bootstrap.cc:492] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.284602  8494 tablet_bootstrap.cc:492] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.285655  8494 tablet_bootstrap.cc:492] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.286329  8494 ts_tablet_manager.cc:1403] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.014s
I20260709 13:00:22.290472  8494 raft_consensus.cc:359] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.291111  8494 raft_consensus.cc:740] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.291756  8494 consensus_queue.cc:260] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.293864  8494 ts_tablet_manager.cc:1434] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:00:22.294674  8494 tablet_bootstrap.cc:492] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.317196  8494 tablet_bootstrap.cc:492] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.318150  8494 tablet_bootstrap.cc:492] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.318801  8494 ts_tablet_manager.cc:1403] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.001s
I20260709 13:00:22.321358  8494 raft_consensus.cc:359] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.322822  8494 raft_consensus.cc:740] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.323632  8494 consensus_queue.cc:260] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.325415  8494 ts_tablet_manager.cc:1434] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:00:22.326202  8494 tablet_bootstrap.cc:492] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.343140  8542 raft_consensus.cc:1275] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:22.348246  8494 tablet_bootstrap.cc:492] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.349246  8494 tablet_bootstrap.cc:492] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.349901  8494 ts_tablet_manager.cc:1403] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 13:00:22.352471  8494 raft_consensus.cc:359] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.353276  8494 raft_consensus.cc:740] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.353935  8494 consensus_queue.cc:260] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.355733  8494 ts_tablet_manager.cc:1434] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:22.359089  8544 raft_consensus.cc:3060] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.360291  8494 tablet_bootstrap.cc:492] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.419049  8545 raft_consensus.cc:3060] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.423308  8403 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.423962  8403 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.427417  8403 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:22.435314  8546 raft_consensus.cc:3060] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.446174  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:22.446923  8543 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 1.
I20260709 13:00:22.449558  8702 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.450124  8702 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.455924  7823 raft_consensus.cc:1275] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:22.467923  7793 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:22.468699  8576 raft_consensus.cc:2804] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:22.469074  8576 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.469410  8576 raft_consensus.cc:3060] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.475673  8706 consensus_queue.cc:1048] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.499586  8637 consensus_queue.cc:1048] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.502887  7898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7" is_pre_election: true
I20260709 13:00:22.503855  7898 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 2.
I20260709 13:00:22.519909  8702 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:22.528471  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff" is_pre_election: true
I20260709 13:00:22.533007  8494 tablet_bootstrap.cc:492] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.534086  8494 tablet_bootstrap.cc:492] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.534775  8494 ts_tablet_manager.cc:1403] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.175s	user 0.064s	sys 0.107s
I20260709 13:00:22.537281  8494 raft_consensus.cc:359] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.537978  8494 raft_consensus.cc:740] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.538793  8494 consensus_queue.cc:260] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:22.540702  8494 ts_tablet_manager.cc:1434] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:00:22.541601  8494 tablet_bootstrap.cc:492] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.557102  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544" is_pre_election: true
I20260709 13:00:22.557863  8543 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 1.
I20260709 13:00:22.562763  8494 tablet_bootstrap.cc:492] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.563815  8494 tablet_bootstrap.cc:492] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.564487  8494 ts_tablet_manager.cc:1403] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:00:22.567209  8494 raft_consensus.cc:359] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.567896  8494 raft_consensus.cc:740] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.568799  8494 consensus_queue.cc:260] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.570374  8494 ts_tablet_manager.cc:1434] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:22.571300  8494 tablet_bootstrap.cc:492] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap starting.
I20260709 13:00:22.592939  8494 tablet_bootstrap.cc:492] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.593923  8494 tablet_bootstrap.cc:492] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: Bootstrap complete.
I20260709 13:00:22.594666  8494 ts_tablet_manager.cc:1403] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:00:22.597327  8494 raft_consensus.cc:359] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.598049  8494 raft_consensus.cc:740] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Initialized, Role: FOLLOWER
I20260709 13:00:22.598860  8494 consensus_queue.cc:260] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:22.600732  8494 ts_tablet_manager.cc:1434] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:00:22.609314  8546 raft_consensus.cc:1275] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:22.619009  7867 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:22.540504  8576 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.630733  7826 raft_consensus.cc:2393] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b07c9e416d4e32a62431b41b1fefa7 in current term 3: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:22.631668  8576 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 3 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:22.634706  8637 raft_consensus.cc:2804] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:22.635146  8637 raft_consensus.cc:493] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.635478  8637 raft_consensus.cc:3060] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.642459  8637 raft_consensus.cc:515] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.644572  8637 leader_election.cc:290] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:22.645082  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:22.645829  8542 raft_consensus.cc:3060] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.651149  8706 consensus_queue.cc:1048] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.652297  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:22.653167  7827 raft_consensus.cc:2393] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b07c9e416d4e32a62431b41b1fefa7 in current term 3: Already voted for candidate cbfd6094b47e463383f6b206c98e52ff in this term.
I20260709 13:00:22.653733  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "cbfd6094b47e463383f6b206c98e52ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:22.654525  7894 raft_consensus.cc:2393] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cbfd6094b47e463383f6b206c98e52ff in current term 3: Already voted for candidate 98b07c9e416d4e32a62431b41b1fefa7 in this term.
I20260709 13:00:22.654381  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feda7e24f274421e9a91a2b5331aba65" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
I20260709 13:00:22.662797  8542 raft_consensus.cc:2468] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfd6094b47e463383f6b206c98e52ff in term 3.
I20260709 13:00:22.664057  7793 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:22.664909  8576 raft_consensus.cc:2804] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:22.665426  8576 raft_consensus.cc:697] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 3 LEADER]: Becoming Leader. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:22.666348  8576 consensus_queue.cc:237] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:22.674170  7867 leader_election.cc:304] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:22.676759  8637 raft_consensus.cc:2749] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:22.694784  7576 catalog_manager.cc:5697] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff reported cstate change: term changed from 1 to 3, leader changed from f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193) to cbfd6094b47e463383f6b206c98e52ff (127.0.107.195). New cstate: current_term: 3 leader_uuid: "cbfd6094b47e463383f6b206c98e52ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:22.892951  8542 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.060670  8542 raft_consensus.cc:1275] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:23.062239  8711 consensus_queue.cc:1048] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.075554  7894 raft_consensus.cc:1275] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Refusing update from remote peer cbfd6094b47e463383f6b206c98e52ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:23.077757  8576 consensus_queue.cc:1048] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:26.380402  8642 debug-util.cc:398] Leaking SignalData structure 0x7b08001db780 after lost signal to thread 434
W20260709 13:00:26.381685  8642 debug-util.cc:398] Leaking SignalData structure 0x7b08003ad9c0 after lost signal to thread 7612
W20260709 13:00:26.382978  8642 debug-util.cc:398] Leaking SignalData structure 0x7b080018eb80 after lost signal to thread 7779
W20260709 13:00:26.384186  8642 debug-util.cc:398] Leaking SignalData structure 0x7b0800320da0 after lost signal to thread 7853
W20260709 13:00:26.385633  8642 debug-util.cc:398] Leaking SignalData structure 0x7b0800361b80 after lost signal to thread 7927
W20260709 13:00:26.386955  8642 debug-util.cc:398] Leaking SignalData structure 0x7b08002c1160 after lost signal to thread 8658
W20260709 13:00:29.908620  7720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 88292.2us
W20260709 13:00:30.904408  7850 debug-util.cc:398] Leaking SignalData structure 0x7b080015d600 after lost signal to thread 434
W20260709 13:00:30.905578  7850 debug-util.cc:398] Leaking SignalData structure 0x7b08001df420 after lost signal to thread 7612
W20260709 13:00:30.906926  7850 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd800 after lost signal to thread 7779
W20260709 13:00:30.908049  7850 debug-util.cc:398] Leaking SignalData structure 0x7b0800082c00 after lost signal to thread 7853
W20260709 13:00:30.909104  7850 debug-util.cc:398] Leaking SignalData structure 0x7b0800188c20 after lost signal to thread 7927
W20260709 13:00:30.910321  7850 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7ca0 after lost signal to thread 8658
I20260709 13:00:31.791018   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:31.880467  7752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2"
dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:37174
I20260709 13:00:31.881569  7752 raft_consensus.cc:606] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:31.885248  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1"
dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:37174
I20260709 13:00:31.886181  7750 raft_consensus.cc:606] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:31.890069  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339"
dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
mode: GRACEFUL
new_leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
 from {username='slave'} at 127.0.0.1:37174
I20260709 13:00:31.890533  7750 raft_consensus.cc:606] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Received request to transfer leadership to TS 98b07c9e416d4e32a62431b41b1fefa7
I20260709 13:00:31.892904  7750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97f866326dd042c1811e3d405f50634b"
dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:37174
I20260709 13:00:31.893492  7750 raft_consensus.cc:606] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:31.908500  7823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2"
dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:00:31.909150  7823 raft_consensus.cc:606] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:31.933205  7902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7"
dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:50612
I20260709 13:00:31.933802  7902 raft_consensus.cc:606] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:31.937487   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:31.939352   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:32.020390  8755 raft_consensus.cc:993] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.021111  8752 raft_consensus.cc:1081] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.022754  8542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46402
I20260709 13:00:32.023255  8542 raft_consensus.cc:493] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.023581  8542 raft_consensus.cc:3060] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.031286  8542 raft_consensus.cc:515] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:32.033565  8542 leader_election.cc:290] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:32.034448  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:32.035773  7750 raft_consensus.cc:3055] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:32.036149  7750 raft_consensus.cc:740] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:32.037281  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a24936f9a894fadb0be3deef42997e1" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:32.037923  7902 raft_consensus.cc:3060] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.048887  7902 raft_consensus.cc:2468] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:32.050309  8490 leader_election.cc:304] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:32.037212  7750 consensus_queue.cc:260] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:32.056447  7750 raft_consensus.cc:3060] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.071213  8769 raft_consensus.cc:2804] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:32.099407  7750 raft_consensus.cc:2468] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:32.098938  8637 raft_consensus.cc:993] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.111614  8637 raft_consensus.cc:1081] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.110832  8769 raft_consensus.cc:697] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:32.113870  8769 consensus_queue.cc:237] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:32.114735  8542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:00:32.115298  8542 raft_consensus.cc:493] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.115655  8542 raft_consensus.cc:3060] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.127902  8542 raft_consensus.cc:515] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:32.132109  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:32.132736  7902 raft_consensus.cc:3055] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:32.133018  7902 raft_consensus.cc:740] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:32.133116  8542 leader_election.cc:290] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:32.133709  7902 consensus_queue.cc:260] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:32.135035  7902 raft_consensus.cc:3060] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.137115  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50b5a78809f4611b59010e0e3e9fcc7" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:32.137907  7750 raft_consensus.cc:3060] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.141513  8763 raft_consensus.cc:993] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.142068  8763 raft_consensus.cc:1081] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.144315  8546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:00:32.144887  8546 raft_consensus.cc:493] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.145272  8546 raft_consensus.cc:3060] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.148519  7750 raft_consensus.cc:2468] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:32.152225  8546 raft_consensus.cc:515] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:32.154197  8546 leader_election.cc:290] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:32.155148  7902 raft_consensus.cc:2468] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:32.156972  8490 leader_election.cc:304] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:32.159893  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:32.160506  7823 raft_consensus.cc:3055] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:32.160848  7823 raft_consensus.cc:740] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:32.161695  7823 consensus_queue.cc:260] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:32.163074  7823 raft_consensus.cc:3060] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.170516  7575 catalog_manager.cc:5697] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 1 to 2, leader changed from 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.174000  8769 raft_consensus.cc:2804] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.175420  8769 raft_consensus.cc:697] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:32.175179  7823 raft_consensus.cc:2468] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:32.176527  8769 consensus_queue.cc:237] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:32.177881  8488 leader_election.cc:304] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:32.178936  8771 raft_consensus.cc:2804] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:32.174755  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b437ec0fc3684ebaacd5c0eb28c4adc2" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:32.180197  7750 raft_consensus.cc:3060] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.187831  8771 raft_consensus.cc:697] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:32.189008  8771 consensus_queue.cc:237] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:32.193024  7750 raft_consensus.cc:2468] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:32.212255  8752 raft_consensus.cc:993] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.212779  8752 raft_consensus.cc:1081] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.223286  7575 catalog_manager.cc:5697] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 2 to 3, leader changed from 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.225222  8542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46402
I20260709 13:00:32.225963  8542 raft_consensus.cc:493] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.226346  8542 raft_consensus.cc:3060] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.226222  7575 catalog_manager.cc:5697] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 1 to 2, leader changed from cbfd6094b47e463383f6b206c98e52ff (127.0.107.195) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.234479  8542 raft_consensus.cc:515] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:32.237471  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:32.238054  7752 raft_consensus.cc:3055] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:32.238332  7752 raft_consensus.cc:740] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:32.239189  7752 consensus_queue.cc:260] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:32.240373  7752 raft_consensus.cc:3060] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.241569  8542 leader_election.cc:290] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:32.242440  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1955a60137904c4f90cee6f71b4fbcf2" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:32.243017  7823 raft_consensus.cc:3060] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.248907  7752 raft_consensus.cc:2468] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:32.250423  8491 leader_election.cc:304] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:32.251977  8769 raft_consensus.cc:2804] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.252455  8769 raft_consensus.cc:697] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:32.253479  8769 consensus_queue.cc:237] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:32.254383  7823 raft_consensus.cc:2468] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:32.272336  8770 raft_consensus.cc:993] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730: : Instructing follower 98b07c9e416d4e32a62431b41b1fefa7 to start an election
I20260709 13:00:32.272891  8770 raft_consensus.cc:1081] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Signalling peer 98b07c9e416d4e32a62431b41b1fefa7 to start an election
I20260709 13:00:32.275300  7902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339"
dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
 from {username='slave'} at 127.0.0.1:54812
I20260709 13:00:32.275830  7902 raft_consensus.cc:493] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.276185  7902 raft_consensus.cc:3060] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.285205  7902 raft_consensus.cc:515] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:32.287637  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:32.287747  7902 leader_election.cc:290] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:32.288300  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ada82aa0d64b199d3b12025f296339" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:32.288851  7752 raft_consensus.cc:3055] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:32.289084  7823 raft_consensus.cc:3060] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.289415  7752 raft_consensus.cc:740] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:32.289541  7575 catalog_manager.cc:5697] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 2 to 3, leader changed from 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.290335  7752 consensus_queue.cc:260] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:32.291836  7752 raft_consensus.cc:3060] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.299458  7823 raft_consensus.cc:2468] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:32.300806  7866 leader_election.cc:304] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:32.301797  8773 raft_consensus.cc:2804] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:32.302254  8773 raft_consensus.cc:697] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:32.303013  8773 consensus_queue.cc:237] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:32.306294  7752 raft_consensus.cc:2468] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:32.318081  7575 catalog_manager.cc:5697] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 1 to 2, leader changed from 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194) to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.459499  8755 raft_consensus.cc:993] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.460135  8783 raft_consensus.cc:1081] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:32.461694  8542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97f866326dd042c1811e3d405f50634b"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46402
I20260709 13:00:32.462126  8542 raft_consensus.cc:493] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.462397  8542 raft_consensus.cc:3060] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.469985  8542 raft_consensus.cc:515] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:32.472654  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:32.473208  7750 raft_consensus.cc:3055] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:32.473483  7750 raft_consensus.cc:740] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99e4e009f2884c8d9f7239b5375ab730, State: Running, Role: LEADER
I20260709 13:00:32.474260  7750 consensus_queue.cc:260] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:32.474823  8542 leader_election.cc:290] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:32.475354  7750 raft_consensus.cc:3060] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.476686  7823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f866326dd042c1811e3d405f50634b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:32.477253  7823 raft_consensus.cc:3060] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.482296  7750 raft_consensus.cc:2468] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:32.483464  8491 leader_election.cc:304] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:32.484509  8769 raft_consensus.cc:2804] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:32.485155  8769 raft_consensus.cc:697] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:32.485982  8769 consensus_queue.cc:237] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:32.486383  7823 raft_consensus.cc:2468] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:32.508841  7575 catalog_manager.cc:5697] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 1 to 2, leader changed from 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.580233  7895 raft_consensus.cc:1275] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.581611  8769 consensus_queue.cc:1048] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:32.601356  7750 raft_consensus.cc:1275] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.613322  7750 raft_consensus.cc:1275] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:32.603034  8771 consensus_queue.cc:1048] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:00:32.616767  8769 consensus_queue.cc:1048] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:32.633561  7895 raft_consensus.cc:1275] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:32.635223  8771 consensus_queue.cc:1048] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:32.742918  7752 raft_consensus.cc:1275] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:32.744164  8775 consensus_queue.cc:1048] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:32.761682  7822 raft_consensus.cc:1275] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:32.763492  8771 consensus_queue.cc:1048] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:32.775413  7822 raft_consensus.cc:1275] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:32.781001  8637 consensus_queue.cc:1048] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:32.782960  7822 raft_consensus.cc:1275] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.789382  8771 consensus_queue.cc:1048] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:32.803761  7750 raft_consensus.cc:1275] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.807164  8769 consensus_queue.cc:1048] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.870709  7750 raft_consensus.cc:1275] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:32.873032  8772 consensus_queue.cc:1048] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:32.940423   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:32.982491   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:33.004276  7752 raft_consensus.cc:1275] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:33.006388  7826 raft_consensus.cc:1275] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:33.009243  8769 consensus_queue.cc:1048] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.016275  8769 consensus_queue.cc:1048] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.031765  7902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b"
dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:50612
I20260709 13:00:33.032371  7902 raft_consensus.cc:606] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:33.037818  7826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876"
dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:00:33.038463  7826 raft_consensus.cc:606] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:33.055537  7826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5044700a374657af7e31d32683ba45"
dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:00:33.058549  7826 raft_consensus.cc:606] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:33.075610  7826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d"
dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:00:33.083282  7826 raft_consensus.cc:606] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:33.091180  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5"
dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
mode: GRACEFUL
new_leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:00:33.091820  7822 raft_consensus.cc:606] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Received request to transfer leadership to TS 98b07c9e416d4e32a62431b41b1fefa7
I20260709 13:00:33.093369   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:33.097540   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:33.166360  8735 raft_consensus.cc:993] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:33.166937  8735 raft_consensus.cc:1081] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:33.172778  8541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a5044700a374657af7e31d32683ba45"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:00:33.178654  8541 raft_consensus.cc:493] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:33.179176  8541 raft_consensus.cc:3060] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.192065  8541 raft_consensus.cc:515] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:33.196478  8541 leader_election.cc:290] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:33.196550  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:33.197305  7826 raft_consensus.cc:3055] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:33.197605  7826 raft_consensus.cc:740] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:33.198313  7826 consensus_queue.cc:260] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:33.199523  7826 raft_consensus.cc:3060] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.200815  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5044700a374657af7e31d32683ba45" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:33.201488  7902 raft_consensus.cc:3060] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.206868  7826 raft_consensus.cc:2468] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:33.208523  8488 leader_election.cc:304] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:33.209542  8769 raft_consensus.cc:2804] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:33.210033  8769 raft_consensus.cc:697] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:33.211001  8769 consensus_queue.cc:237] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:33.208532  7902 raft_consensus.cc:2468] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:33.244810  7575 catalog_manager.cc:5697] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 2 to 3, leader changed from cbfd6094b47e463383f6b206c98e52ff (127.0.107.195) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:33.287349  8772 raft_consensus.cc:993] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:33.287819  8637 raft_consensus.cc:1081] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:33.289379  8541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:00:33.289897  8541 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:33.290216  8541 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.295946  8541 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:33.297600  8541 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 4 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:33.298506  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:33.298568  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095f1c671ae348299e6195bec053dc9b" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:33.299342  7752 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.299294  7895 raft_consensus.cc:3055] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:33.299917  7895 raft_consensus.cc:740] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:33.300768  7895 consensus_queue.cc:260] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:33.304294  7895 raft_consensus.cc:3060] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.306605  7752 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 4.
I20260709 13:00:33.315760  8491 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:33.316433  7895 raft_consensus.cc:2468] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 4.
I20260709 13:00:33.316591  8771 raft_consensus.cc:2804] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:33.317479  8771 raft_consensus.cc:697] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 4 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:33.318392  8771 consensus_queue.cc:237] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:33.335316  7575 catalog_manager.cc:5697] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 3 to 4, leader changed from 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:33.345470  8763 raft_consensus.cc:993] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:33.345973  8763 raft_consensus.cc:1081] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:33.347388  8542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:00:33.347908  8542 raft_consensus.cc:493] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:33.348223  8542 raft_consensus.cc:3060] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.360083  8542 raft_consensus.cc:515] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:33.365031  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:33.365655  7754 raft_consensus.cc:3060] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.370113  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "434f38d50a1543e8b5e019baf56d4876" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:33.370285  8542 leader_election.cc:290] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:33.370738  7826 raft_consensus.cc:3055] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:33.371063  7826 raft_consensus.cc:740] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:33.371830  7826 consensus_queue.cc:260] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:33.372769  7826 raft_consensus.cc:3060] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.373497  7754 raft_consensus.cc:2468] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:33.374784  8491 leader_election.cc:304] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:33.375599  8771 raft_consensus.cc:2804] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:33.379766  7826 raft_consensus.cc:2468] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:33.382174  8771 raft_consensus.cc:697] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:33.384343  8771 consensus_queue.cc:237] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:33.393196  8735 raft_consensus.cc:993] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff: : Instructing follower 98b07c9e416d4e32a62431b41b1fefa7 to start an election
I20260709 13:00:33.393677  8763 raft_consensus.cc:1081] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Signalling peer 98b07c9e416d4e32a62431b41b1fefa7 to start an election
I20260709 13:00:33.395272  7895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5"
dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
 from {username='slave'} at 127.0.0.1:54806
I20260709 13:00:33.395372  7575 catalog_manager.cc:5697] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 2 to 3, leader changed from cbfd6094b47e463383f6b206c98e52ff (127.0.107.195) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:33.395910  7895 raft_consensus.cc:493] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:33.396426  7895 raft_consensus.cc:3060] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.406394  7895 raft_consensus.cc:515] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:33.408444  7895 leader_election.cc:290] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:33.409338  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:33.410034  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baec15a5574f308ac368ed350280d5" candidate_uuid: "98b07c9e416d4e32a62431b41b1fefa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:33.410040  7754 raft_consensus.cc:3060] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.410709  7826 raft_consensus.cc:3055] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:33.411058  7826 raft_consensus.cc:740] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:33.411716  7826 consensus_queue.cc:260] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:33.412716  7826 raft_consensus.cc:3060] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.418179  7826 raft_consensus.cc:2468] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:33.418696  7754 raft_consensus.cc:2468] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b07c9e416d4e32a62431b41b1fefa7 in term 2.
I20260709 13:00:33.419508  7866 leader_election.cc:304] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, cbfd6094b47e463383f6b206c98e52ff; no voters: 
I20260709 13:00:33.420339  8637 raft_consensus.cc:2804] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:33.420843  8637 raft_consensus.cc:697] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Becoming Leader. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:33.421669  8637 consensus_queue.cc:237] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } }
I20260709 13:00:33.432003  7575 catalog_manager.cc:5697] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 reported cstate change: term changed from 1 to 2, leader changed from cbfd6094b47e463383f6b206c98e52ff (127.0.107.195) to 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "98b07c9e416d4e32a62431b41b1fefa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:33.529214  8796 raft_consensus.cc:993] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:33.529695  8796 raft_consensus.cc:1081] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:33.535712  8541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:00:33.536374  8541 raft_consensus.cc:493] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:33.537154  8541 raft_consensus.cc:3060] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.543905  8541 raft_consensus.cc:515] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:33.546113  8541 leader_election.cc:290] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:33.546562  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:33.546392  7752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50b91b1378a4f62a5d2fe31fb381a7d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:33.547189  7826 raft_consensus.cc:3055] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:33.547294  7752 raft_consensus.cc:3060] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.547554  7826 raft_consensus.cc:740] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:33.548409  7826 consensus_queue.cc:260] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:33.549450  7826 raft_consensus.cc:3060] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.553886  7826 raft_consensus.cc:2468] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:33.554800  8488 leader_election.cc:304] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:33.554932  7752 raft_consensus.cc:2468] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:33.555533  8771 raft_consensus.cc:2804] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:33.556073  8771 raft_consensus.cc:697] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:33.557367  8771 consensus_queue.cc:237] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:33.570631  7575 catalog_manager.cc:5697] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 2 to 3, leader changed from cbfd6094b47e463383f6b206c98e52ff (127.0.107.195) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:33.677662  7902 raft_consensus.cc:1275] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:33.678826  8771 consensus_queue.cc:1048] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:33.696796  7826 raft_consensus.cc:1275] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:33.699496  8771 consensus_queue.cc:1048] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:33.740803  7752 raft_consensus.cc:1275] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 4 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:33.743458  8771 consensus_queue.cc:1048] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:33.756705  7902 raft_consensus.cc:1275] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 4 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:33.758219  8771 consensus_queue.cc:1048] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:33.952879  7826 raft_consensus.cc:1275] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:33.954198  8775 consensus_queue.cc:1048] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:33.966082  7752 raft_consensus.cc:1275] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:33.970587  7752 raft_consensus.cc:1275] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:33.971536  8771 consensus_queue.cc:1048] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:33.975704  8637 consensus_queue.cc:1048] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.999308  7822 raft_consensus.cc:1275] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Refusing update from remote peer 98b07c9e416d4e32a62431b41b1fefa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:34.005764  7752 raft_consensus.cc:1275] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:34.005898  8773 consensus_queue.cc:1048] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:34.008049  8771 consensus_queue.cc:1048] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:34.057344  7826 raft_consensus.cc:1275] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:34.061368  8775 consensus_queue.cc:1048] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:34.099478   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:34.156261   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:34.198892  7895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285"
dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:50612
I20260709 13:00:34.199496  7895 raft_consensus.cc:606] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:34.201954  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73e52f0728d04896bff6d3356508b794"
dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:00:34.202571  7822 raft_consensus.cc:606] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:34.204842  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "804a5720142a4f2685b079160048e38f"
dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:00:34.205230  7822 raft_consensus.cc:606] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:34.207309  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9"
dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:00:34.207757  7822 raft_consensus.cc:606] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:34.209794  7822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d"
dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
mode: GRACEFUL
new_leader_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:00:34.210181  7822 raft_consensus.cc:606] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Received request to transfer leadership to TS f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:34.211133   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:34.212260   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:34.456931  8827 raft_consensus.cc:993] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.458127  8827 raft_consensus.cc:1081] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.467672  8544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "804a5720142a4f2685b079160048e38f"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:00:34.468835  8544 raft_consensus.cc:493] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.469439  8544 raft_consensus.cc:3060] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.471640  8811 raft_consensus.cc:993] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.477432  8811 raft_consensus.cc:1081] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.532881  8541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:00:34.533664  8541 raft_consensus.cc:493] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.534132  8541 raft_consensus.cc:3060] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.544750  8544 raft_consensus.cc:515] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:34.555433  8763 raft_consensus.cc:993] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.560407  8763 raft_consensus.cc:1081] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.557190  8772 raft_consensus.cc:993] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.562326  8772 raft_consensus.cc:1081] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.564450  8541 raft_consensus.cc:515] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:34.564865  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:34.565310  7822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804a5720142a4f2685b079160048e38f" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:34.566094  8544 leader_election.cc:290] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:34.572158  7822 raft_consensus.cc:3055] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:34.566469  8542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:00:34.572515  7822 raft_consensus.cc:740] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:34.572860  8542 raft_consensus.cc:493] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.573324  8542 raft_consensus.cc:3060] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.574468  7754 raft_consensus.cc:3060] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.574594  7822 consensus_queue.cc:260] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:34.576515  7822 raft_consensus.cc:3060] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.581255  8543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:00:34.582099  8543 raft_consensus.cc:493] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.585624  8543 raft_consensus.cc:3060] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.554910  8811 raft_consensus.cc:993] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff: : Instructing follower f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.592466  8811 raft_consensus.cc:1081] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Signalling peer f91d8d830a474ea7a101fc5b6f920544 to start an election
I20260709 13:00:34.594954  7754 raft_consensus.cc:2468] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:34.597517  8491 leader_election.cc:304] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:34.598115  8541 leader_election.cc:290] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:34.598459  8771 raft_consensus.cc:2804] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:34.598822  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:34.599366  8771 raft_consensus.cc:697] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:34.599423  7826 raft_consensus.cc:3055] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:34.599570  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1600216f6ee426ab10349caff0a0d4d" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:34.599982  7826 raft_consensus.cc:740] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:34.600230  7895 raft_consensus.cc:3060] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.600992  7826 consensus_queue.cc:260] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:34.604066  7822 raft_consensus.cc:2468] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:34.605430  8771 consensus_queue.cc:237] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:34.606083  7826 raft_consensus.cc:3060] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.616518  8543 raft_consensus.cc:515] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:34.620014  7754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:34.603986  8542 raft_consensus.cc:515] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:34.620857  7902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687dfedf0b514fb4bc4a0e696a32c285" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:34.623175  7902 raft_consensus.cc:3055] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:34.623469  7902 raft_consensus.cc:740] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98b07c9e416d4e32a62431b41b1fefa7, State: Running, Role: LEADER
I20260709 13:00:34.624050  8542 leader_election.cc:290] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Requested vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101)
I20260709 13:00:34.624426  7902 consensus_queue.cc:260] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:34.626166  7902 raft_consensus.cc:3060] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.625816  7826 raft_consensus.cc:2468] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:34.631223  7750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99e4e009f2884c8d9f7239b5375ab730"
I20260709 13:00:34.632030  7750 raft_consensus.cc:3060] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.636021  8543 leader_election.cc:290] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Requested vote from peers 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:34.636812  7827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9076d349f7904683af049c46eb2c99e9" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:34.637459  7827 raft_consensus.cc:3055] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:34.637844  7827 raft_consensus.cc:740] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:34.638731  7827 consensus_queue.cc:260] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:34.640234  7827 raft_consensus.cc:3060] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.637241  8488 leader_election.cc:304] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:34.642233  8771 raft_consensus.cc:2804] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:34.648510  8771 raft_consensus.cc:697] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:34.649670  8771 consensus_queue.cc:237] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:34.653491  7576 catalog_manager.cc:5697] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 2 to 3, leader changed from cbfd6094b47e463383f6b206c98e52ff (127.0.107.195) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.656057  7827 raft_consensus.cc:2468] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:34.657248  8488 leader_election.cc:304] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:34.658481  8769 raft_consensus.cc:2804] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:34.658995  8769 raft_consensus.cc:697] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:34.659930  8769 consensus_queue.cc:237] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } }
I20260709 13:00:34.620855  7754 raft_consensus.cc:3060] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.618927  8541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73e52f0728d04896bff6d3356508b794"
dest_uuid: "f91d8d830a474ea7a101fc5b6f920544"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:00:34.672823  8541 raft_consensus.cc:493] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.674459  8541 raft_consensus.cc:3060] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.675467  7750 raft_consensus.cc:2468] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:34.680984  7902 raft_consensus.cc:2468] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:34.687095  8490 leader_election.cc:304] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:34.687302  7754 raft_consensus.cc:2468] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:34.688330  7895 raft_consensus.cc:2468] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 2.
I20260709 13:00:34.692767  8769 raft_consensus.cc:2804] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:34.693766  8769 raft_consensus.cc:697] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:34.694875  8769 consensus_queue.cc:237] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:34.696965  8541 raft_consensus.cc:515] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:34.700415  7826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbfd6094b47e463383f6b206c98e52ff"
I20260709 13:00:34.701189  7826 raft_consensus.cc:3055] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:34.701541  7826 raft_consensus.cc:740] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbfd6094b47e463383f6b206c98e52ff, State: Running, Role: LEADER
I20260709 13:00:34.702574  7826 consensus_queue.cc:260] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:34.703903  7826 raft_consensus.cc:3060] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.714730  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e52f0728d04896bff6d3356508b794" candidate_uuid: "f91d8d830a474ea7a101fc5b6f920544" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98b07c9e416d4e32a62431b41b1fefa7"
I20260709 13:00:34.715569  7895 raft_consensus.cc:3060] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.719643  8541 leader_election.cc:290] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Requested vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196:38843)
I20260709 13:00:34.722283  7826 raft_consensus.cc:2468] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:34.724390  8488 leader_election.cc:304] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544; no voters: 
I20260709 13:00:34.727212  7895 raft_consensus.cc:2468] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f91d8d830a474ea7a101fc5b6f920544 in term 3.
I20260709 13:00:34.730152  8769 raft_consensus.cc:2804] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:34.731597  8769 raft_consensus.cc:697] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Becoming Leader. State: Replica: f91d8d830a474ea7a101fc5b6f920544, State: Running, Role: LEADER
I20260709 13:00:34.732528  8769 consensus_queue.cc:237] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:34.735709  7576 catalog_manager.cc:5697] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 1 to 2, leader changed from cbfd6094b47e463383f6b206c98e52ff (127.0.107.195) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:34.737692  7576 catalog_manager.cc:5697] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 1 to 2, leader changed from cbfd6094b47e463383f6b206c98e52ff (127.0.107.195) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.739331  7576 catalog_manager.cc:5697] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 2 to 3, leader changed from 98b07c9e416d4e32a62431b41b1fefa7 (127.0.107.196) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.763314  7576 catalog_manager.cc:5697] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 reported cstate change: term changed from 2 to 3, leader changed from cbfd6094b47e463383f6b206c98e52ff (127.0.107.195) to f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "f91d8d830a474ea7a101fc5b6f920544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:35.064936  7754 raft_consensus.cc:1275] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.066563  8769 consensus_queue.cc:1048] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:35.083351  7826 raft_consensus.cc:1275] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:35.088860  8771 consensus_queue.cc:1048] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:35.090157  7826 raft_consensus.cc:1275] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.096009  8769 consensus_queue.cc:1048] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:35.132889  7827 raft_consensus.cc:1275] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:35.135428  7902 raft_consensus.cc:1275] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.146669  8775 consensus_queue.cc:1048] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:35.163089  8769 consensus_queue.cc:1048] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:35.167989  7895 raft_consensus.cc:1275] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:35.189621  8771 consensus_queue.cc:1048] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:00:35.198722  7718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38101, user_credentials={real_user=slave}} blocked reactor thread for 53307.7us
I20260709 13:00:35.213377   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:35.214668  7754 raft_consensus.cc:1275] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:35.221875  8769 consensus_queue.cc:1048] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:35.224769  7826 raft_consensus.cc:1275] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.227828  8850 consensus_queue.cc:1048] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:35.269908  8490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38843, user_credentials={real_user=slave}} blocked reactor thread for 66340us
I20260709 13:00:35.277627  7754 raft_consensus.cc:1275] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.285750  8855 consensus_queue.cc:1048] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:35.350776  7902 raft_consensus.cc:1275] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Refusing update from remote peer f91d8d830a474ea7a101fc5b6f920544: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.376004  8850 consensus_queue.cc:1048] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:35.447122   431 tablet_server.cc:179] TabletServer@127.0.107.193:43363 shutting down...
W20260709 13:00:35.474680  7793 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 223 similar messages]
W20260709 13:00:35.496114  7793 consensus_peers.cc:597] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.496939  7793 consensus_peers.cc:597] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.513414   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:00:35.513684  7793 consensus_peers.cc:597] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.514515   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.515791   431 raft_consensus.cc:2243] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.516367   431 raft_consensus.cc:2272] T 98f368c04a174168bd99e224010f9d92 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.519882   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:00:35.519764  7793 consensus_peers.cc:597] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.521071   431 raft_consensus.cc:2243] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.521656   431 raft_consensus.cc:2272] T 95450b5e9cc54eb6a0799a88a3e01b37 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.525274   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.526418   431 raft_consensus.cc:2243] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.527701   431 raft_consensus.cc:2272] T 4a24936f9a894fadb0be3deef42997e1 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:35.531654  7793 consensus_peers.cc:597] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.543215   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.544450   431 raft_consensus.cc:2243] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.545077   431 raft_consensus.cc:2272] T f5511f1a9fff49799b1a7d65756ffe56 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.551299   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.552376   431 raft_consensus.cc:2243] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.553519   431 raft_consensus.cc:2272] T 1955a60137904c4f90cee6f71b4fbcf2 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.556914   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.557860   431 raft_consensus.cc:2243] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.558405   431 raft_consensus.cc:2272] T dbaecfc17e784f2eb1bced30c22e86f8 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:35.559629  7867 consensus_peers.cc:597] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.561913   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:00:35.562390  7867 consensus_peers.cc:597] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.563196  7867 consensus_peers.cc:597] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.563247   431 raft_consensus.cc:2243] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.564006   431 raft_consensus.cc:2272] T be2165e65cf64b5daf805ec2f2fe5002 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.567327   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.568286   431 raft_consensus.cc:2243] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.568832   431 raft_consensus.cc:2272] T 541510a88d1f44cdb6156324aa747e96 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.571821   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.572780   431 raft_consensus.cc:2243] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.573412   431 raft_consensus.cc:2272] T feda7e24f274421e9a91a2b5331aba65 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.576913   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.577745   431 raft_consensus.cc:2243] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.578292   431 raft_consensus.cc:2272] T def02c9a73c348d1a63a3b334f54f400 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.582401   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.583573   431 raft_consensus.cc:2243] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.585060   431 raft_consensus.cc:2272] T b437ec0fc3684ebaacd5c0eb28c4adc2 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.589087   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.590325   431 raft_consensus.cc:2243] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.591697   431 raft_consensus.cc:2272] T 73e52f0728d04896bff6d3356508b794 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.598188   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.599082   431 raft_consensus.cc:2243] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.600315   431 raft_consensus.cc:2272] T 095f1c671ae348299e6195bec053dc9b P f91d8d830a474ea7a101fc5b6f920544 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.605460   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.606535   431 raft_consensus.cc:2243] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.607215   431 raft_consensus.cc:2272] T 76db30f9818e4e4cb3825f84ad8e9223 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.610400   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.611639   431 raft_consensus.cc:2243] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.612212   431 raft_consensus.cc:2272] T 52fe505815234b019c30d15aac38e187 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:35.607813  7719 consensus_peers.cc:597] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.618189   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.619341   431 raft_consensus.cc:2243] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.619921   431 raft_consensus.cc:2272] T 36e8786bbce6485a8f5293b40587c372 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.623144   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.624013   431 raft_consensus.cc:2243] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.624590   431 raft_consensus.cc:2272] T 5e8e6791febb41058f3dd1950131a939 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:35.626400  7793 consensus_peers.cc:597] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.627095  7719 consensus_peers.cc:597] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.627907   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.628588   431 raft_consensus.cc:2243] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.629161   431 raft_consensus.cc:2272] T 8acef6aca57b4db8a13916f345d24f12 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.631963   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.632805   431 raft_consensus.cc:2243] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.633329   431 raft_consensus.cc:2272] T 090001da1c8d4285a0a8beaeaf3e76c6 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.636271   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.637130   431 raft_consensus.cc:2243] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.637660   431 raft_consensus.cc:2272] T 9fade69c67ff4012b5e46a32966edb24 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.642522   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.643375   431 raft_consensus.cc:2243] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.644423   431 raft_consensus.cc:2272] T 97f866326dd042c1811e3d405f50634b P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.647408   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.648278   431 raft_consensus.cc:2243] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.648968   431 raft_consensus.cc:2272] T d33aed1bca5e4615a453a14181ce357d P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:35.650090  7867 consensus_peers.cc:597] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.651754   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.652685   431 raft_consensus.cc:2243] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.653231   431 raft_consensus.cc:2272] T 4953a51e627b477992fa1569ba01e121 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.658516   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.659132   431 raft_consensus.cc:2243] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.659673   431 raft_consensus.cc:2272] T ea3aa569bb2f4c58bc92f779a43caad0 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.662609   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.663513   431 raft_consensus.cc:2243] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.664060   431 raft_consensus.cc:2272] T b1104646f70f4ff4bae122a61937a61c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.667408   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.671830   431 raft_consensus.cc:2243] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.672503   431 raft_consensus.cc:2272] T 595e433cb28c45c1891f471d7d5e3493 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.675577   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:00:35.675567  7719 consensus_peers.cc:597] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.677026   431 raft_consensus.cc:2243] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.677630   431 raft_consensus.cc:2272] T f4c0ccc08b9c4764be5e221aa04d31ef P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.687966   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.689090   431 raft_consensus.cc:2243] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.689646   431 raft_consensus.cc:2272] T 92c33f71c6ae44e09fc992b5197545c5 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.692950   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.693852   431 raft_consensus.cc:2243] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.694360   431 raft_consensus.cc:2272] T 9411be3e9dce40b3bb27db670ad0ac4f P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.698042   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:00:35.698630  7867 consensus_peers.cc:597] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.698807   431 raft_consensus.cc:2243] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.699502   431 raft_consensus.cc:2272] T a838c80f5aa84e38ae70747f05808e0d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.702301   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.703094   431 raft_consensus.cc:2243] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.704099   431 raft_consensus.cc:2272] T d50b5a78809f4611b59010e0e3e9fcc7 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:35.704506  7793 consensus_peers.cc:597] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.706313   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.707096   431 raft_consensus.cc:2243] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.707544   431 raft_consensus.cc:2272] T cfcc74c073a446fdb54d5af775d46abc P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.710294   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.711104   431 raft_consensus.cc:2243] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.712160   431 raft_consensus.cc:2272] T 9076d349f7904683af049c46eb2c99e9 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.715596   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.716217   431 raft_consensus.cc:2243] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.716706   431 raft_consensus.cc:2272] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.719168   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.719727   431 raft_consensus.cc:2243] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.720446   431 raft_consensus.cc:2272] T 804a5720142a4f2685b079160048e38f P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.722853   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.723595   431 raft_consensus.cc:2243] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.724637   431 raft_consensus.cc:2272] T 5a5044700a374657af7e31d32683ba45 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.727120   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:00:35.727226  7719 consensus_peers.cc:597] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.727842   431 raft_consensus.cc:2243] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.728303   431 raft_consensus.cc:2272] T 9708521c863f4f02b5ea46f35013e91c P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.731182   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.731982   431 raft_consensus.cc:2243] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:00:35.732532  7719 consensus_peers.cc:597] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.732591   431 raft_consensus.cc:2272] T c00647e852184fb281c21a8e4739e9e4 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.735109   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.735713   431 raft_consensus.cc:2243] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.736088   431 raft_consensus.cc:2272] T a2e478963dd04f1f8913edd2870132d1 P f91d8d830a474ea7a101fc5b6f920544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.738345   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.738865   431 raft_consensus.cc:2243] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.739650   431 raft_consensus.cc:2272] T 687dfedf0b514fb4bc4a0e696a32c285 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.742377   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.743120   431 raft_consensus.cc:2243] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.743930   431 raft_consensus.cc:2272] T a1600216f6ee426ab10349caff0a0d4d P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.746361   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.746852   431 raft_consensus.cc:2243] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.747666   431 raft_consensus.cc:2272] T b50b91b1378a4f62a5d2fe31fb381a7d P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.749789   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.750454   431 raft_consensus.cc:2243] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:35.751514   431 raft_consensus.cc:2272] T 434f38d50a1543e8b5e019baf56d4876 P f91d8d830a474ea7a101fc5b6f920544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.754372   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.755160   431 raft_consensus.cc:2243] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.755695   431 raft_consensus.cc:2272] T 7d5de0dffe634306bdeb7131e6d0d43c P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:35.758131  7793 consensus_peers.cc:597] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.758800   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:35.759593   431 raft_consensus.cc:2243] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.760169   431 raft_consensus.cc:2272] T ce0d5877ad7a44398c02291a8cbf65d7 P f91d8d830a474ea7a101fc5b6f920544 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:35.762120  7719 consensus_peers.cc:597] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.776309  7793 consensus_peers.cc:597] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.795706  7793 consensus_peers.cc:597] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.819420  7719 consensus_peers.cc:597] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.821025  7793 consensus_peers.cc:597] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.830396  7793 consensus_peers.cc:597] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.860083  7867 consensus_peers.cc:597] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:35.876072   431 tablet_server.cc:196] TabletServer@127.0.107.193:43363 shutdown complete.
W20260709 13:00:35.886139  7867 consensus_peers.cc:597] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.914202  7867 consensus_peers.cc:597] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.931609  7719 consensus_peers.cc:597] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.945839  7793 consensus_peers.cc:597] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.972997  7719 consensus_peers.cc:597] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:35.987625  7793 consensus_peers.cc:597] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff -> Peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Couldn't send request to peer f91d8d830a474ea7a101fc5b6f920544. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.002441   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:00:36.016157  7869 consensus_peers.cc:597] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:36.018137  7869 consensus_peers.cc:597] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:36.054338  7869 consensus_peers.cc:597] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:36.102816  7795 consensus_peers.cc:597] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:36.119786  7869 consensus_peers.cc:597] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:36.138259  7795 consensus_peers.cc:597] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.141856   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:36.142974   431 tablet_replica.cc:333] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.144093   431 raft_consensus.cc:2243] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.145417   431 raft_consensus.cc:2272] T d50b5a78809f4611b59010e0e3e9fcc7 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.146036  7795 consensus_peers.cc:597] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.148301   431 tablet_replica.cc:333] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.149273   431 raft_consensus.cc:2243] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.149884   431 raft_consensus.cc:2272] T b437ec0fc3684ebaacd5c0eb28c4adc2 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.152120   431 tablet_replica.cc:333] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.152866   431 raft_consensus.cc:2243] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.153354   431 raft_consensus.cc:2272] T 87ada82aa0d64b199d3b12025f296339 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.160259   431 tablet_replica.cc:333] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.161150   431 raft_consensus.cc:2243] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.161872   431 raft_consensus.cc:2272] T def02c9a73c348d1a63a3b334f54f400 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.164613   431 tablet_replica.cc:333] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.165416   431 raft_consensus.cc:2243] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.168838   431 raft_consensus.cc:2272] T a2e478963dd04f1f8913edd2870132d1 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.171612   431 tablet_replica.cc:333] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.172397   431 raft_consensus.cc:2243] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.173492   431 raft_consensus.cc:2272] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.175851   431 tablet_replica.cc:333] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.176471   431 raft_consensus.cc:2243] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.177479   431 raft_consensus.cc:2272] T dbaecfc17e784f2eb1bced30c22e86f8 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.180088   431 tablet_replica.cc:333] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.180800   431 raft_consensus.cc:2243] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.181330   431 raft_consensus.cc:2272] T 687dfedf0b514fb4bc4a0e696a32c285 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.186717   431 tablet_replica.cc:333] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
W20260709 13:00:36.186753  7869 consensus_peers.cc:597] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.187855   431 raft_consensus.cc:2243] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:00:36.188433  7869 consensus_peers.cc:597] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.189728   431 raft_consensus.cc:2272] T 36e8786bbce6485a8f5293b40587c372 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.196707   431 tablet_replica.cc:333] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.197561   431 raft_consensus.cc:2243] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.198668   431 raft_consensus.cc:2272] T 52fe505815234b019c30d15aac38e187 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.201818   431 tablet_replica.cc:333] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.202786   431 raft_consensus.cc:2243] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.203904   431 raft_consensus.cc:2272] T f5511f1a9fff49799b1a7d65756ffe56 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.205935  7869 consensus_peers.cc:597] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.207036   431 tablet_replica.cc:333] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.207861   431 raft_consensus.cc:2243] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.208324   431 raft_consensus.cc:2272] T 694bf015fc134546a01f1750539a8cf8 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.211232   431 tablet_replica.cc:333] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.212108   431 raft_consensus.cc:2243] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.212636   431 raft_consensus.cc:2272] T 1955a60137904c4f90cee6f71b4fbcf2 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.215054   431 tablet_replica.cc:333] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.215960   431 raft_consensus.cc:2243] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.217106   431 raft_consensus.cc:2272] T b97f988382674008a12a0b6392cf7197 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.219036   431 tablet_replica.cc:333] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.219599   431 raft_consensus.cc:2243] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.220021   431 raft_consensus.cc:2272] T 095f1c671ae348299e6195bec053dc9b P 99e4e009f2884c8d9f7239b5375ab730 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.222361   431 tablet_replica.cc:333] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.223169   431 raft_consensus.cc:2243] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.223776   431 raft_consensus.cc:2272] T 434f38d50a1543e8b5e019baf56d4876 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.226644   431 tablet_replica.cc:333] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
W20260709 13:00:36.226967  7869 consensus_peers.cc:597] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.227524   431 raft_consensus.cc:2243] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.228130   431 raft_consensus.cc:2272] T 74faeec2e32f4c079635c385977c8ebf P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.231009   431 tablet_replica.cc:333] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.231882   431 raft_consensus.cc:2243] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.232496   431 raft_consensus.cc:2272] T b50b91b1378a4f62a5d2fe31fb381a7d P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.232882  7795 consensus_peers.cc:597] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.234912   431 tablet_replica.cc:333] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.235904   431 raft_consensus.cc:2243] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.236423   431 raft_consensus.cc:2272] T 7f64552f3c8f4af381c7ea6596d7f3ff P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.239279   431 tablet_replica.cc:333] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.240135   431 raft_consensus.cc:2243] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.241214   431 raft_consensus.cc:2272] T 1f2d428ca5f74d97b4fc1fa713b19994 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.244021   431 tablet_replica.cc:333] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.244810   431 raft_consensus.cc:2243] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.245949   431 raft_consensus.cc:2272] T 445db6ed81c14979a6b26e0045cf7c13 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.248598   431 tablet_replica.cc:333] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.249328   431 raft_consensus.cc:2243] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.249878   431 raft_consensus.cc:2272] T ea3aa569bb2f4c58bc92f779a43caad0 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.252539   431 tablet_replica.cc:333] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.253331   431 raft_consensus.cc:2243] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.253873   431 raft_consensus.cc:2272] T 541510a88d1f44cdb6156324aa747e96 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.256250   431 tablet_replica.cc:333] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.256954   431 raft_consensus.cc:2243] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.257826   431 raft_consensus.cc:2272] T b26cd919cc164a29a97c54622f534945 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.260128   431 tablet_replica.cc:333] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.260764   431 raft_consensus.cc:2243] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.261184   431 raft_consensus.cc:2272] T 9708521c863f4f02b5ea46f35013e91c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.263370   431 tablet_replica.cc:333] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.263902   431 raft_consensus.cc:2243] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.264360   431 raft_consensus.cc:2272] T 9076d349f7904683af049c46eb2c99e9 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.266855   431 tablet_replica.cc:333] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.267541   431 raft_consensus.cc:2243] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.268549   431 raft_consensus.cc:2272] T cfcc74c073a446fdb54d5af775d46abc P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.270548   431 tablet_replica.cc:333] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.271097   431 raft_consensus.cc:2243] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.271543   431 raft_consensus.cc:2272] T 98f368c04a174168bd99e224010f9d92 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.273679   431 tablet_replica.cc:333] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.274171   431 raft_consensus.cc:2243] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.274560   431 raft_consensus.cc:2272] T 97f866326dd042c1811e3d405f50634b P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.276697   431 tablet_replica.cc:333] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.277220   431 raft_consensus.cc:2243] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.277629   431 raft_consensus.cc:2272] T aafc690b8cda48dbaa3b21cfe522712b P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.280249   431 tablet_replica.cc:333] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.280797   431 raft_consensus.cc:2243] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.281248   431 raft_consensus.cc:2272] T 8acef6aca57b4db8a13916f345d24f12 P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.283221   431 tablet_replica.cc:333] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.283711   431 raft_consensus.cc:2243] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.284107   431 raft_consensus.cc:2272] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.286934   431 tablet_replica.cc:333] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.287619   431 raft_consensus.cc:2243] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.288132   431 raft_consensus.cc:2272] T 804a5720142a4f2685b079160048e38f P 99e4e009f2884c8d9f7239b5375ab730 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.290616   431 tablet_replica.cc:333] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.291378   431 raft_consensus.cc:2243] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.291908   431 raft_consensus.cc:2272] T 0915d2c188d14ddabd92c69242f68829 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.294426   431 tablet_replica.cc:333] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.294942   431 raft_consensus.cc:2243] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.295396   431 raft_consensus.cc:2272] T 728e396427a94afb9ff27339bbec3235 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.297709   431 tablet_replica.cc:333] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.298436   431 raft_consensus.cc:2243] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.299469   431 raft_consensus.cc:2272] T ccf003a44a8d49479fbe48301e5681b5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.301644   431 tablet_replica.cc:333] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.302141   431 raft_consensus.cc:2243] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.302943   431 raft_consensus.cc:2272] T 9411be3e9dce40b3bb27db670ad0ac4f P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.305264   431 tablet_replica.cc:333] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.305920   431 raft_consensus.cc:2243] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.306982   431 raft_consensus.cc:2272] T 92c33f71c6ae44e09fc992b5197545c5 P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.309525   431 tablet_replica.cc:333] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.310235   431 raft_consensus.cc:2243] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.310755   431 raft_consensus.cc:2272] T 4a24936f9a894fadb0be3deef42997e1 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.313167   431 tablet_replica.cc:333] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.313886   431 raft_consensus.cc:2243] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.314426   431 raft_consensus.cc:2272] T 7d5de0dffe634306bdeb7131e6d0d43c P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.315014  7869 consensus_peers.cc:597] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:36.316212  7869 consensus_peers.cc:597] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.317261   431 tablet_replica.cc:333] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.318111   431 raft_consensus.cc:2243] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.318701   431 raft_consensus.cc:2272] T ce0d5877ad7a44398c02291a8cbf65d7 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.319959  7869 consensus_peers.cc:597] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.321683   431 tablet_replica.cc:333] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.322446   431 raft_consensus.cc:2243] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.323477   431 raft_consensus.cc:2272] T b1104646f70f4ff4bae122a61937a61c P 99e4e009f2884c8d9f7239b5375ab730 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.324218  7795 consensus_peers.cc:597] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.326617   431 tablet_replica.cc:333] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.327451   431 raft_consensus.cc:2243] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.327960   431 raft_consensus.cc:2272] T 595e433cb28c45c1891f471d7d5e3493 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.331359   431 tablet_replica.cc:333] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730: stopping tablet replica
I20260709 13:00:36.332020   431 raft_consensus.cc:2243] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.332574   431 raft_consensus.cc:2272] T c5baec15a5574f308ac368ed350280d5 P 99e4e009f2884c8d9f7239b5375ab730 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.387979  7869 consensus_peers.cc:597] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:36.394349  7795 consensus_peers.cc:597] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff -> Peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Couldn't send request to peer 99e4e009f2884c8d9f7239b5375ab730. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.441376   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:00:36.533198   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:00:36.582429  7866 consensus_peers.cc:597] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.590534   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:36.591600   431 tablet_replica.cc:333] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.592541   431 raft_consensus.cc:2243] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:00:36.592607  7866 consensus_peers.cc:597] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.593582   431 raft_consensus.cc:2272] T be2165e65cf64b5daf805ec2f2fe5002 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.595813   431 tablet_replica.cc:333] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.596447   431 raft_consensus.cc:2243] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.596899   431 raft_consensus.cc:2272] T b437ec0fc3684ebaacd5c0eb28c4adc2 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.598949   431 tablet_replica.cc:333] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.599527   431 raft_consensus.cc:2243] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.600581   431 raft_consensus.cc:2272] T 95450b5e9cc54eb6a0799a88a3e01b37 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.603156   431 tablet_replica.cc:333] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.603871   431 raft_consensus.cc:2243] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.604383   431 raft_consensus.cc:2272] T 87ada82aa0d64b199d3b12025f296339 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.606580   431 tablet_replica.cc:333] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.607151   431 raft_consensus.cc:2243] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.607882   431 raft_consensus.cc:2272] T a838c80f5aa84e38ae70747f05808e0d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.609791   431 tablet_replica.cc:333] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.610368   431 raft_consensus.cc:2243] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.611123   431 raft_consensus.cc:2272] T 5e8e6791febb41058f3dd1950131a939 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.613114   431 tablet_replica.cc:333] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.613662   431 raft_consensus.cc:2243] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.614091   431 raft_consensus.cc:2272] T f5511f1a9fff49799b1a7d65756ffe56 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.616072   431 tablet_replica.cc:333] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.616775   431 raft_consensus.cc:2243] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.617200   431 raft_consensus.cc:2272] T 694bf015fc134546a01f1750539a8cf8 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.619199   431 tablet_replica.cc:333] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.619750   431 raft_consensus.cc:2243] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.620187   431 raft_consensus.cc:2272] T 7f64552f3c8f4af381c7ea6596d7f3ff P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.622298   431 tablet_replica.cc:333] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.622967   431 raft_consensus.cc:2243] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.623538   431 raft_consensus.cc:2272] T 1955a60137904c4f90cee6f71b4fbcf2 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.626056  7866 consensus_peers.cc:597] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.626336   431 tablet_replica.cc:333] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.627305   431 raft_consensus.cc:2243] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.627825   431 raft_consensus.cc:2272] T a1600216f6ee426ab10349caff0a0d4d P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.630245   431 tablet_replica.cc:333] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.631011   431 raft_consensus.cc:2243] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.631513   431 raft_consensus.cc:2272] T 434f38d50a1543e8b5e019baf56d4876 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.633519  7866 consensus_peers.cc:597] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.634110   431 tablet_replica.cc:333] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.634718   431 raft_consensus.cc:2243] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.635155   431 raft_consensus.cc:2272] T 74faeec2e32f4c079635c385977c8ebf P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.637115   431 tablet_replica.cc:333] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.637650   431 raft_consensus.cc:2243] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.638082   431 raft_consensus.cc:2272] T b50b91b1378a4f62a5d2fe31fb381a7d P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.640177   431 tablet_replica.cc:333] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.640786   431 raft_consensus.cc:2243] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.641224   431 raft_consensus.cc:2272] T 1f2d428ca5f74d97b4fc1fa713b19994 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.643610   431 tablet_replica.cc:333] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.644377   431 raft_consensus.cc:2243] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.644941   431 raft_consensus.cc:2272] T 445db6ed81c14979a6b26e0045cf7c13 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.647341   431 tablet_replica.cc:333] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.647850   431 raft_consensus.cc:2243] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.648299   431 raft_consensus.cc:2272] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.650218   431 tablet_replica.cc:333] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.650728   431 raft_consensus.cc:2243] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.651125   431 raft_consensus.cc:2272] T 9fade69c67ff4012b5e46a32966edb24 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.653311   431 tablet_replica.cc:333] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.653970   431 raft_consensus.cc:2243] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.654479   431 raft_consensus.cc:2272] T 5a5044700a374657af7e31d32683ba45 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.656314  7866 consensus_peers.cc:597] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.656833   431 tablet_replica.cc:333] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.657430   431 raft_consensus.cc:2243] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.657863   431 raft_consensus.cc:2272] T 728e396427a94afb9ff27339bbec3235 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.659853   431 tablet_replica.cc:333] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.660418   431 raft_consensus.cc:2243] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.660923   431 raft_consensus.cc:2272] T ccf003a44a8d49479fbe48301e5681b5 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.663429   431 tablet_replica.cc:333] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.664204   431 raft_consensus.cc:2243] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.664734   431 raft_consensus.cc:2272] T c00647e852184fb281c21a8e4739e9e4 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.667457   431 tablet_replica.cc:333] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.668201   431 raft_consensus.cc:2243] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.668742   431 raft_consensus.cc:2272] T b26cd919cc164a29a97c54622f534945 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.671336   431 tablet_replica.cc:333] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.672071   431 raft_consensus.cc:2243] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.673084   431 raft_consensus.cc:2272] T 090001da1c8d4285a0a8beaeaf3e76c6 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.675748   431 tablet_replica.cc:333] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.676415   431 raft_consensus.cc:2243] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.677253   431 raft_consensus.cc:2272] T def02c9a73c348d1a63a3b334f54f400 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.679910   431 tablet_replica.cc:333] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.680547   431 raft_consensus.cc:2243] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:00:36.681232  7792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.681378   431 raft_consensus.cc:2272] T feda7e24f274421e9a91a2b5331aba65 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.684043   431 tablet_replica.cc:333] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.684854   431 raft_consensus.cc:2243] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.685390   431 raft_consensus.cc:2272] T 804a5720142a4f2685b079160048e38f P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.687927   431 tablet_replica.cc:333] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.688514   431 raft_consensus.cc:2243] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.688999   431 raft_consensus.cc:2272] T 0915d2c188d14ddabd92c69242f68829 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.690948   431 tablet_replica.cc:333] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.691471   431 raft_consensus.cc:2243] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.691895   431 raft_consensus.cc:2272] T b1104646f70f4ff4bae122a61937a61c P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.693874   431 tablet_replica.cc:333] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.694520   431 raft_consensus.cc:2243] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.695482   431 raft_consensus.cc:2272] T 595e433cb28c45c1891f471d7d5e3493 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.698101   431 tablet_replica.cc:333] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.698666   431 raft_consensus.cc:2243] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.699075   431 raft_consensus.cc:2272] T 9076d349f7904683af049c46eb2c99e9 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.701114   431 tablet_replica.cc:333] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.701635   431 raft_consensus.cc:2243] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.702059   431 raft_consensus.cc:2272] T cfcc74c073a446fdb54d5af775d46abc P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.703841   431 tablet_replica.cc:333] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.704326   431 raft_consensus.cc:2243] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.705094   431 raft_consensus.cc:2272] T 98f368c04a174168bd99e224010f9d92 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.706915   431 tablet_replica.cc:333] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.707479   431 raft_consensus.cc:2243] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.708386   431 raft_consensus.cc:2272] T 4953a51e627b477992fa1569ba01e121 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.710682   431 tablet_replica.cc:333] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.711273   431 raft_consensus.cc:2243] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.711635   431 raft_consensus.cc:2272] T 97f866326dd042c1811e3d405f50634b P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.713508   431 tablet_replica.cc:333] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.714260   431 raft_consensus.cc:2243] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.714727   431 raft_consensus.cc:2272] T d33aed1bca5e4615a453a14181ce357d P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.717168   431 tablet_replica.cc:333] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.717907   431 raft_consensus.cc:2243] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.718886   431 raft_consensus.cc:2272] T aafc690b8cda48dbaa3b21cfe522712b P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.721624   431 tablet_replica.cc:333] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.722327   431 raft_consensus.cc:2243] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.722795   431 raft_consensus.cc:2272] T 73e52f0728d04896bff6d3356508b794 P cbfd6094b47e463383f6b206c98e52ff [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.723142  7866 consensus_peers.cc:597] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.725636   431 tablet_replica.cc:333] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.726559   431 raft_consensus.cc:2243] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.727495   431 raft_consensus.cc:2272] T f4c0ccc08b9c4764be5e221aa04d31ef P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.727864  7866 consensus_peers.cc:597] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.729491   431 tablet_replica.cc:333] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.730086   431 raft_consensus.cc:2243] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.730587   431 raft_consensus.cc:2272] T b97f988382674008a12a0b6392cf7197 P cbfd6094b47e463383f6b206c98e52ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.733166   431 tablet_replica.cc:333] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.733829   431 raft_consensus.cc:2243] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.734812   431 raft_consensus.cc:2272] T 76db30f9818e4e4cb3825f84ad8e9223 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.736681   431 tablet_replica.cc:333] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.737110   431 raft_consensus.cc:2243] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.737753   431 raft_consensus.cc:2272] T 7d5de0dffe634306bdeb7131e6d0d43c P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.739405   431 tablet_replica.cc:333] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.739805   431 raft_consensus.cc:2243] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.740473   431 raft_consensus.cc:2272] T ce0d5877ad7a44398c02291a8cbf65d7 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.742192   431 tablet_replica.cc:333] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff: stopping tablet replica
I20260709 13:00:36.742564   431 raft_consensus.cc:2243] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.742919   431 raft_consensus.cc:2272] T c5baec15a5574f308ac368ed350280d5 P cbfd6094b47e463383f6b206c98e52ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.835409  8773 raft_consensus.cc:493] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:36.835870  8773 raft_consensus.cc:515] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:36.837760  8773 leader_election.cc:290] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
I20260709 13:00:36.840862   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:00:36.841781  7867 leader_election.cc:336] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:36.841871  8773 raft_consensus.cc:493] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
W20260709 13:00:36.842387  7869 leader_election.cc:336] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35833: connect: Connection refused (error 111)
I20260709 13:00:36.842495  8773 raft_consensus.cc:515] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
I20260709 13:00:36.842836  7869 leader_election.cc:304] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:36.843647  8870 raft_consensus.cc:2749] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.852771  8773 leader_election.cc:290] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
W20260709 13:00:36.856045  7866 leader_election.cc:336] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38101: connect: Connection refused (error 111)
W20260709 13:00:36.856554  7867 leader_election.cc:336] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:36.857026  7867 leader_election.cc:304] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:36.857695  8773 raft_consensus.cc:2749] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.879884  8773 raft_consensus.cc:493] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:36.880472  8773 raft_consensus.cc:515] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfd6094b47e463383f6b206c98e52ff" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38101 } } peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } }
W20260709 13:00:36.881553  7866 consensus_peers.cc:597] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.882931  8773 leader_election.cc:290] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101), f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363)
W20260709 13:00:36.887159  7866 leader_election.cc:336] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38101: connect: Connection refused (error 111)
W20260709 13:00:36.887629  7867 leader_election.cc:336] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:36.887974  7867 leader_election.cc:304] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: cbfd6094b47e463383f6b206c98e52ff, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:36.888556  8773 raft_consensus.cc:2749] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.916370   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:00:36.923681  8773 raft_consensus.cc:493] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:36.924180  8773 raft_consensus.cc:515] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:36.924963  8870 raft_consensus.cc:493] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:36.925559  8870 raft_consensus.cc:515] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:36.926101  8773 leader_election.cc:290] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:36.928110  8870 leader_election.cc:290] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
W20260709 13:00:36.932396  7869 leader_election.cc:336] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35833: connect: Connection refused (error 111)
W20260709 13:00:36.932910  7869 leader_election.cc:336] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35833: connect: Connection refused (error 111)
W20260709 13:00:36.934084  7867 leader_election.cc:336] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:36.934473  7867 leader_election.cc:304] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:36.935289  8773 raft_consensus.cc:2749] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:36.935362  7867 leader_election.cc:336] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:36.936744  7867 leader_election.cc:304] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:36.937417  8773 raft_consensus.cc:2749] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.964092   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:36.964835   431 tablet_replica.cc:333] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.965493   431 raft_consensus.cc:2243] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.965962   431 raft_consensus.cc:2272] T 95450b5e9cc54eb6a0799a88a3e01b37 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.967913   431 tablet_replica.cc:333] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.968495   431 raft_consensus.cc:2243] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.968907   431 raft_consensus.cc:2272] T d50b5a78809f4611b59010e0e3e9fcc7 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.970773   431 tablet_replica.cc:333] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.971305   431 raft_consensus.cc:2243] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.972071   431 raft_consensus.cc:2272] T 87ada82aa0d64b199d3b12025f296339 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.974246   431 tablet_replica.cc:333] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.974831   431 raft_consensus.cc:2243] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.975396   431 raft_consensus.cc:2272] T a838c80f5aa84e38ae70747f05808e0d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.977139  7866 consensus_peers.cc:597] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 -> Peer cbfd6094b47e463383f6b206c98e52ff (127.0.107.195:38101): Couldn't send request to peer cbfd6094b47e463383f6b206c98e52ff. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:38101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.977618   431 tablet_replica.cc:333] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.978214   431 raft_consensus.cc:2243] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.978598   431 raft_consensus.cc:2272] T be2165e65cf64b5daf805ec2f2fe5002 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.980453   431 tablet_replica.cc:333] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.980993   431 raft_consensus.cc:2243] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.981360   431 raft_consensus.cc:2272] T dbaecfc17e784f2eb1bced30c22e86f8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.983163   431 tablet_replica.cc:333] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.983687   431 raft_consensus.cc:2243] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.984375  8870 raft_consensus.cc:493] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f91d8d830a474ea7a101fc5b6f920544)
I20260709 13:00:36.984459   431 raft_consensus.cc:2272] T 694bf015fc134546a01f1750539a8cf8 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.984920  8870 raft_consensus.cc:515] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b07c9e416d4e32a62431b41b1fefa7" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38843 } } peers { permanent_uuid: "f91d8d830a474ea7a101fc5b6f920544" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43363 } } peers { permanent_uuid: "99e4e009f2884c8d9f7239b5375ab730" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35833 } }
I20260709 13:00:36.986938  8870 leader_election.cc:290] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363), 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833)
I20260709 13:00:36.987246   431 tablet_replica.cc:333] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.988131   431 raft_consensus.cc:2243] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.988665   431 raft_consensus.cc:2272] T 687dfedf0b514fb4bc4a0e696a32c285 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.990705  7869 leader_election.cc:336] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 99e4e009f2884c8d9f7239b5375ab730 (127.0.107.194:35833): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35833: connect: Connection refused (error 111)
I20260709 13:00:36.991235   431 tablet_replica.cc:333] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.991940   431 raft_consensus.cc:2243] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:00:36.991971  7867 leader_election.cc:336] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f91d8d830a474ea7a101fc5b6f920544 (127.0.107.193:43363): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43363: connect: Connection refused (error 111)
I20260709 13:00:36.992570  7867 leader_election.cc:304] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b07c9e416d4e32a62431b41b1fefa7; no voters: 99e4e009f2884c8d9f7239b5375ab730, f91d8d830a474ea7a101fc5b6f920544
I20260709 13:00:36.992749   431 raft_consensus.cc:2272] T a1600216f6ee426ab10349caff0a0d4d P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.993268  8870 raft_consensus.cc:2749] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:36.994855   431 tablet_replica.cc:333] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.995407   431 raft_consensus.cc:2243] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.996160   431 raft_consensus.cc:2272] T 7f64552f3c8f4af381c7ea6596d7f3ff P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.998009   431 tablet_replica.cc:333] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:36.998482   431 raft_consensus.cc:2243] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.998829   431 raft_consensus.cc:2272] T 5e8e6791febb41058f3dd1950131a939 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.000597   431 tablet_replica.cc:333] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.001153   431 raft_consensus.cc:2243] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.001506   431 raft_consensus.cc:2272] T 36e8786bbce6485a8f5293b40587c372 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.003211   431 tablet_replica.cc:333] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.003690   431 raft_consensus.cc:2243] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.004014   431 raft_consensus.cc:2272] T 52fe505815234b019c30d15aac38e187 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.005831   431 tablet_replica.cc:333] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.006307   431 raft_consensus.cc:2243] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.006649   431 raft_consensus.cc:2272] T 1f2d428ca5f74d97b4fc1fa713b19994 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.008458   431 tablet_replica.cc:333] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.008984   431 raft_consensus.cc:2243] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.009387   431 raft_consensus.cc:2272] T 445db6ed81c14979a6b26e0045cf7c13 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.011603   431 tablet_replica.cc:333] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.012354   431 raft_consensus.cc:2243] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.012849   431 raft_consensus.cc:2272] T b97f988382674008a12a0b6392cf7197 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.014997   431 tablet_replica.cc:333] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.015671   431 raft_consensus.cc:2243] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.016122   431 raft_consensus.cc:2272] T 76db30f9818e4e4cb3825f84ad8e9223 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.018602   431 tablet_replica.cc:333] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.019222   431 raft_consensus.cc:2243] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.019659   431 raft_consensus.cc:2272] T 095f1c671ae348299e6195bec053dc9b P 98b07c9e416d4e32a62431b41b1fefa7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.022095   431 tablet_replica.cc:333] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.022779   431 raft_consensus.cc:2243] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.023669   431 raft_consensus.cc:2272] T ea3aa569bb2f4c58bc92f779a43caad0 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.025596   431 tablet_replica.cc:333] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.026113   431 raft_consensus.cc:2243] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.026494   431 raft_consensus.cc:2272] T 41ba344081ac4a8fabd3c2ab0d9e71a6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.028169   431 tablet_replica.cc:333] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.028703   431 raft_consensus.cc:2243] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.029446   431 raft_consensus.cc:2272] T 9fade69c67ff4012b5e46a32966edb24 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.031167   431 tablet_replica.cc:333] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.031674   431 raft_consensus.cc:2243] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.032423   431 raft_consensus.cc:2272] T 74faeec2e32f4c079635c385977c8ebf P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.034251   431 tablet_replica.cc:333] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.034785   431 raft_consensus.cc:2243] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.035169   431 raft_consensus.cc:2272] T b26cd919cc164a29a97c54622f534945 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.036926   431 tablet_replica.cc:333] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.037508   431 raft_consensus.cc:2243] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.038236   431 raft_consensus.cc:2272] T 541510a88d1f44cdb6156324aa747e96 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.039942   431 tablet_replica.cc:333] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.040458   431 raft_consensus.cc:2243] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.041201   431 raft_consensus.cc:2272] T 8acef6aca57b4db8a13916f345d24f12 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.042953   431 tablet_replica.cc:333] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.043473   431 raft_consensus.cc:2243] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.043874   431 raft_consensus.cc:2272] T 090001da1c8d4285a0a8beaeaf3e76c6 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.045660   431 tablet_replica.cc:333] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.046149   431 raft_consensus.cc:2243] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.046542   431 raft_consensus.cc:2272] T feda7e24f274421e9a91a2b5331aba65 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.048261   431 tablet_replica.cc:333] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.048834   431 raft_consensus.cc:2243] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.049217   431 raft_consensus.cc:2272] T a2e478963dd04f1f8913edd2870132d1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.050930   431 tablet_replica.cc:333] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.051440   431 raft_consensus.cc:2243] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.052153   431 raft_consensus.cc:2272] T c00647e852184fb281c21a8e4739e9e4 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.053915   431 tablet_replica.cc:333] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.054418   431 raft_consensus.cc:2243] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.055136   431 raft_consensus.cc:2272] T 9708521c863f4f02b5ea46f35013e91c P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.056964   431 tablet_replica.cc:333] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.057464   431 raft_consensus.cc:2243] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.058171   431 raft_consensus.cc:2272] T 0915d2c188d14ddabd92c69242f68829 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.059944   431 tablet_replica.cc:333] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.060429   431 raft_consensus.cc:2243] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.060881   431 raft_consensus.cc:2272] T 5a5044700a374657af7e31d32683ba45 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.062608   431 tablet_replica.cc:333] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.063100   431 raft_consensus.cc:2243] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.063833   431 raft_consensus.cc:2272] T 728e396427a94afb9ff27339bbec3235 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.065750   431 tablet_replica.cc:333] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.066268   431 raft_consensus.cc:2243] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.066677   431 raft_consensus.cc:2272] T ccf003a44a8d49479fbe48301e5681b5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.068372   431 tablet_replica.cc:333] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.068907   431 raft_consensus.cc:2243] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.069295   431 raft_consensus.cc:2272] T 9411be3e9dce40b3bb27db670ad0ac4f P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.071007   431 tablet_replica.cc:333] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.071498   431 raft_consensus.cc:2243] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.071893   431 raft_consensus.cc:2272] T 92c33f71c6ae44e09fc992b5197545c5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.073758   431 tablet_replica.cc:333] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.074245   431 raft_consensus.cc:2243] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.074970   431 raft_consensus.cc:2272] T c5baec15a5574f308ac368ed350280d5 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.076743   431 tablet_replica.cc:333] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.077207   431 raft_consensus.cc:2243] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.077582   431 raft_consensus.cc:2272] T 73e52f0728d04896bff6d3356508b794 P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.079321   431 tablet_replica.cc:333] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.079784   431 raft_consensus.cc:2243] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.080222   431 raft_consensus.cc:2272] T 4953a51e627b477992fa1569ba01e121 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.081954   431 tablet_replica.cc:333] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.082484   431 raft_consensus.cc:2243] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.083254   431 raft_consensus.cc:2272] T d33aed1bca5e4615a453a14181ce357d P 98b07c9e416d4e32a62431b41b1fefa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.085021   431 tablet_replica.cc:333] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.085494   431 raft_consensus.cc:2243] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.085887   431 raft_consensus.cc:2272] T aafc690b8cda48dbaa3b21cfe522712b P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.087702   431 tablet_replica.cc:333] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.088171   431 raft_consensus.cc:2243] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.088568   431 raft_consensus.cc:2272] T f4c0ccc08b9c4764be5e221aa04d31ef P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.090380   431 tablet_replica.cc:333] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.090759   431 raft_consensus.cc:2243] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:37.091133   431 raft_consensus.cc:2272] T 4a24936f9a894fadb0be3deef42997e1 P 98b07c9e416d4e32a62431b41b1fefa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.092888   431 tablet_replica.cc:333] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7: stopping tablet replica
I20260709 13:00:37.093269   431 raft_consensus.cc:2243] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.093968   431 raft_consensus.cc:2272] T 0aa4c60ae43f4aa6b7c0fcc69c763999 P 98b07c9e416d4e32a62431b41b1fefa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.161511   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:00:37.224365   431 master.cc:562] Master@127.0.107.254:43053 shutting down...
I20260709 13:00:37.248349   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:37.248957   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:37.249307   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P a0da72817da647b58428e2c39868f6ba: stopping tablet replica
I20260709 13:00:37.270541   431 master.cc:584] Master@127.0.107.254:43053 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32888 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:00:37.357028   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37477
I20260709 13:00:37.358321   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:37.364298  8881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:37.364935  8880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:37.365813  8883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:37.366278   431 server_base.cc:1061] running on GCE node
I20260709 13:00:37.367367   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:37.367573   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:37.367726   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602037367709 us; error 0 us; skew 500 ppm
I20260709 13:00:37.368263   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:37.370579   431 webserver.cc:533] Webserver started at http://127.0.107.254:41685/ using document root <none> and password file <none>
I20260709 13:00:37.371080   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:37.371285   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:37.371556   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:37.372635   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/master-0-root/instance:
uuid: "46f149a686664b66b4b234b6fa74ade1"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-73vh"
I20260709 13:00:37.377959   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:00:37.381318  8888 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.382066   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:37.382371   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/master-0-root
uuid: "46f149a686664b66b4b234b6fa74ade1"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-73vh"
I20260709 13:00:37.382668   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:37.399871   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:37.401161   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:37.441386   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37477
I20260709 13:00:37.441493  8939 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37477 every 8 connection(s)
I20260709 13:00:37.445376  8940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.455736  8940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1: Bootstrap starting.
I20260709 13:00:37.460539  8940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:37.464964  8940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1: No bootstrap required, opened a new log
I20260709 13:00:37.467248  8940 raft_consensus.cc:359] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f149a686664b66b4b234b6fa74ade1" member_type: VOTER }
I20260709 13:00:37.467676  8940 raft_consensus.cc:385] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:37.467906  8940 raft_consensus.cc:740] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f149a686664b66b4b234b6fa74ade1, State: Initialized, Role: FOLLOWER
I20260709 13:00:37.468538  8940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f149a686664b66b4b234b6fa74ade1" member_type: VOTER }
I20260709 13:00:37.469028  8940 raft_consensus.cc:399] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:37.469270  8940 raft_consensus.cc:493] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:37.469527  8940 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:37.474236  8940 raft_consensus.cc:515] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f149a686664b66b4b234b6fa74ade1" member_type: VOTER }
I20260709 13:00:37.474776  8940 leader_election.cc:304] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46f149a686664b66b4b234b6fa74ade1; no voters: 
I20260709 13:00:37.475934  8940 leader_election.cc:290] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:37.476387  8943 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:37.477900  8943 raft_consensus.cc:697] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 1 LEADER]: Becoming Leader. State: Replica: 46f149a686664b66b4b234b6fa74ade1, State: Running, Role: LEADER
I20260709 13:00:37.478559  8943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f149a686664b66b4b234b6fa74ade1" member_type: VOTER }
I20260709 13:00:37.479010  8940 sys_catalog.cc:565] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:37.483716  8945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46f149a686664b66b4b234b6fa74ade1. Latest consensus state: current_term: 1 leader_uuid: "46f149a686664b66b4b234b6fa74ade1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f149a686664b66b4b234b6fa74ade1" member_type: VOTER } }
I20260709 13:00:37.484474  8945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:37.486776  8944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46f149a686664b66b4b234b6fa74ade1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f149a686664b66b4b234b6fa74ade1" member_type: VOTER } }
I20260709 13:00:37.487493  8944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:37.491053  8952 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:37.497115  8952 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:37.498310   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:37.505841  8952 catalog_manager.cc:1383] Generated new cluster ID: a286d5008587477cb7283e194b246c63
I20260709 13:00:37.506085  8952 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:37.525005  8952 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:37.526234  8952 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:37.541105  8952 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1: Generated new TSK 0
I20260709 13:00:37.541702  8952 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:37.565307   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:37.571818  8961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:37.573544  8962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:37.579137  8964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:37.579970   431 server_base.cc:1061] running on GCE node
I20260709 13:00:37.583307   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:37.583493   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:37.583614   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602037583604 us; error 0 us; skew 500 ppm
I20260709 13:00:37.584115   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:37.586704   431 webserver.cc:533] Webserver started at http://127.0.107.193:40929/ using document root <none> and password file <none>
I20260709 13:00:37.587189   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:37.587342   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:37.587553   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:37.588557   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-0-root/instance:
uuid: "01b224f1c8d44ba7901c399f572c68f9"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-73vh"
I20260709 13:00:37.593114   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:00:37.596278  8969 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.597059   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:37.597308   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "01b224f1c8d44ba7901c399f572c68f9"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-73vh"
I20260709 13:00:37.597561   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:37.630163   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:37.631398   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:37.632920   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:37.635216   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:37.635397   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.635668   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:37.635860   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.677937   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43333
I20260709 13:00:37.678053  9031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43333 every 8 connection(s)
I20260709 13:00:37.682998   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:37.690817  9036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:37.692049  9037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:37.695832   431 server_base.cc:1061] running on GCE node
W20260709 13:00:37.696192  9039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:37.697223   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:37.697420   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:37.697620   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602037697601 us; error 0 us; skew 500 ppm
I20260709 13:00:37.698115   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:37.701002   431 webserver.cc:533] Webserver started at http://127.0.107.194:44461/ using document root <none> and password file <none>
I20260709 13:00:37.701612   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:37.701798   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:37.702078   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:37.702680  9032 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37477
I20260709 13:00:37.703076  9032 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:37.703231   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-1-root/instance:
uuid: "e91887cfb03c4eea9dd840fd8e745f84"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-73vh"
I20260709 13:00:37.703873  9032 heartbeater.cc:507] Master 127.0.107.254:37477 requested a full tablet report, sending...
I20260709 13:00:37.706048  8905 ts_manager.cc:194] Registered new tserver with Master: 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333)
I20260709 13:00:37.708228  8905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59812
I20260709 13:00:37.708321   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.005s
I20260709 13:00:37.711867  9044 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.712731   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:37.713024   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-1-root
uuid: "e91887cfb03c4eea9dd840fd8e745f84"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-73vh"
I20260709 13:00:37.713323   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:37.723380   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:37.724568   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:37.726073   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:37.728273   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:37.728489   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.728746   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:37.728919   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.769205   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36091
I20260709 13:00:37.769325  9106 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36091 every 8 connection(s)
I20260709 13:00:37.774046   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:37.781217  9110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:37.781941  9111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:37.784113  9113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:37.785393   431 server_base.cc:1061] running on GCE node
I20260709 13:00:37.786381   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:37.786600   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:37.786778   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602037786745 us; error 0 us; skew 500 ppm
I20260709 13:00:37.787197  9107 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37477
I20260709 13:00:37.787416   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:37.787668  9107 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:37.788722  9107 heartbeater.cc:507] Master 127.0.107.254:37477 requested a full tablet report, sending...
I20260709 13:00:37.790385   431 webserver.cc:533] Webserver started at http://127.0.107.195:39573/ using document root <none> and password file <none>
I20260709 13:00:37.791004   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:37.790913  8905 ts_manager.cc:194] Registered new tserver with Master: e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:37.791381   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:37.791687   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:37.792506  8905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59824
I20260709 13:00:37.792892   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-2-root/instance:
uuid: "98544cace1ab4d84bb7940ffd240fd47"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-73vh"
I20260709 13:00:37.798565   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:00:37.801833  9118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.802541   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:37.802834   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-2-root
uuid: "98544cace1ab4d84bb7940ffd240fd47"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-73vh"
I20260709 13:00:37.803099   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:37.819193   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:37.820395   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:37.821897   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:37.824052   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:37.824252   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.824502   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:37.824671   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.864456   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39873
I20260709 13:00:37.864559  9180 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39873 every 8 connection(s)
I20260709 13:00:37.877924  9181 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37477
I20260709 13:00:37.878404  9181 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:37.879125  9181 heartbeater.cc:507] Master 127.0.107.254:37477 requested a full tablet report, sending...
I20260709 13:00:37.881486  8905 ts_manager.cc:194] Registered new tserver with Master: 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:37.882211   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014518016s
I20260709 13:00:37.884057  8905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59832
I20260709 13:00:37.908056  8905 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59844:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:37.910970  8905 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:37.989898  9146 tablet_service.cc:1511] Processing CreateTablet for tablet a08e089be2c549a79ee0842418f856fa (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:37.990375  9145 tablet_service.cc:1511] Processing CreateTablet for tablet d9c7607c3c8749dbbcfef7eb72c84e40 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:37.991452  9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08e089be2c549a79ee0842418f856fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.992812  8997 tablet_service.cc:1511] Processing CreateTablet for tablet a08e089be2c549a79ee0842418f856fa (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:37.994220  8997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08e089be2c549a79ee0842418f856fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.995383  8996 tablet_service.cc:1511] Processing CreateTablet for tablet d9c7607c3c8749dbbcfef7eb72c84e40 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:37.995707  9142 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3c665832434c87abefd254a50e7668 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:37.996740  8996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c7607c3c8749dbbcfef7eb72c84e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.997088  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3c665832434c87abefd254a50e7668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.000294  9141 tablet_service.cc:1511] Processing CreateTablet for tablet 55cf6b4dc7c143cbb4739be5a5fe50e7 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:38.001688  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cf6b4dc7c143cbb4739be5a5fe50e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.001820  8994 tablet_service.cc:1511] Processing CreateTablet for tablet 262f2b0fe84048ecb51905469e86c16f (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:38.003113  8994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262f2b0fe84048ecb51905469e86c16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.003163  9072 tablet_service.cc:1511] Processing CreateTablet for tablet a08e089be2c549a79ee0842418f856fa (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:38.004590  9072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08e089be2c549a79ee0842418f856fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.005016  9067 tablet_service.cc:1511] Processing CreateTablet for tablet 55cf6b4dc7c143cbb4739be5a5fe50e7 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:38.005779  8993 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3c665832434c87abefd254a50e7668 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:38.006364  9071 tablet_service.cc:1511] Processing CreateTablet for tablet d9c7607c3c8749dbbcfef7eb72c84e40 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:38.007105  8993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3c665832434c87abefd254a50e7668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.006390  9067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cf6b4dc7c143cbb4739be5a5fe50e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.008737  9069 tablet_service.cc:1511] Processing CreateTablet for tablet 262f2b0fe84048ecb51905469e86c16f (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:38.010084  9069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262f2b0fe84048ecb51905469e86c16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.009930  8992 tablet_service.cc:1511] Processing CreateTablet for tablet 55cf6b4dc7c143cbb4739be5a5fe50e7 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:38.011255  8992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cf6b4dc7c143cbb4739be5a5fe50e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.007472  9068 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3c665832434c87abefd254a50e7668 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:38.015457  9143 tablet_service.cc:1511] Processing CreateTablet for tablet 262f2b0fe84048ecb51905469e86c16f (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:38.016667  9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c7607c3c8749dbbcfef7eb72c84e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.017486  9070 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec5edc423b243d4a7dc2a17a0580e40 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:38.014104  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3c665832434c87abefd254a50e7668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.993848  8995 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec5edc423b243d4a7dc2a17a0580e40 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:38.022653  8995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec5edc423b243d4a7dc2a17a0580e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.993839  9144 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec5edc423b243d4a7dc2a17a0580e40 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:38.024225  9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262f2b0fe84048ecb51905469e86c16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.025969  9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec5edc423b243d4a7dc2a17a0580e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.027108  9070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec5edc423b243d4a7dc2a17a0580e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.028982  9071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c7607c3c8749dbbcfef7eb72c84e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.054953  8997 tablet_service.cc:1511] Processing CreateTablet for tablet 27ef21d002a741daa1c56c59fdf5db52 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:38.056442  8997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef21d002a741daa1c56c59fdf5db52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.061300  9196 tablet_bootstrap.cc:492] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.082363  9066 tablet_service.cc:1511] Processing CreateTablet for tablet 27ef21d002a741daa1c56c59fdf5db52 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:38.084635  9066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef21d002a741daa1c56c59fdf5db52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.099817  9197 tablet_bootstrap.cc:492] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
I20260709 13:00:38.100677  9145 tablet_service.cc:1511] Processing CreateTablet for tablet 27ef21d002a741daa1c56c59fdf5db52 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:38.102094  9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef21d002a741daa1c56c59fdf5db52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.103780  8991 tablet_service.cc:1511] Processing CreateTablet for tablet 9910df027fcf4af3b51ef6f95b8d2108 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:38.106971  8991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9910df027fcf4af3b51ef6f95b8d2108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.115435  9198 tablet_bootstrap.cc:492] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
I20260709 13:00:38.116602  9196 tablet_bootstrap.cc:654] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.122773  9197 tablet_bootstrap.cc:654] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.148355  9198 tablet_bootstrap.cc:654] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.153623  9196 tablet_bootstrap.cc:492] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.163043  9196 ts_tablet_manager.cc:1403] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.102s	user 0.008s	sys 0.011s
I20260709 13:00:38.156913  9197 tablet_bootstrap.cc:492] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.158511  9143 tablet_service.cc:1511] Processing CreateTablet for tablet 9910df027fcf4af3b51ef6f95b8d2108 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:38.168992  9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9910df027fcf4af3b51ef6f95b8d2108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.172983  9197 ts_tablet_manager.cc:1403] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.007s
I20260709 13:00:38.178128  9070 tablet_service.cc:1511] Processing CreateTablet for tablet 79bdf4ef53884c4e95785fe9c99fec15 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:38.178440  8992 tablet_service.cc:1511] Processing CreateTablet for tablet 7645164283334af18edfa7b7602e786a (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:38.179303  9070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bdf4ef53884c4e95785fe9c99fec15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.180029  8992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7645164283334af18edfa7b7602e786a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.181772  9069 tablet_service.cc:1511] Processing CreateTablet for tablet 9910df027fcf4af3b51ef6f95b8d2108 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:38.183151  9069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9910df027fcf4af3b51ef6f95b8d2108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.176362  9196 raft_consensus.cc:359] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:38.185361  9196 raft_consensus.cc:385] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.185702  9196 raft_consensus.cc:740] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.186146  8991 tablet_service.cc:1511] Processing CreateTablet for tablet 79bdf4ef53884c4e95785fe9c99fec15 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:38.188589  9141 tablet_service.cc:1511] Processing CreateTablet for tablet 7645164283334af18edfa7b7602e786a (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:38.186789  9142 tablet_service.cc:1511] Processing CreateTablet for tablet 79bdf4ef53884c4e95785fe9c99fec15 (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:38.188928  9197 raft_consensus.cc:359] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.189805  8991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bdf4ef53884c4e95785fe9c99fec15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.187724  9196 consensus_queue.cc:260] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:38.189760  9197 raft_consensus.cc:385] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.194666  9197 raft_consensus.cc:740] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.190109  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7645164283334af18edfa7b7602e786a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.195631  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bdf4ef53884c4e95785fe9c99fec15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.195720  9197 consensus_queue.cc:260] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.197090  9072 tablet_service.cc:1511] Processing CreateTablet for tablet 7645164283334af18edfa7b7602e786a (DEFAULT_TABLE table=test-workload [id=6f64636c29c4499487a22c38df140098]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:38.198633  9072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7645164283334af18edfa7b7602e786a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.199858  9198 tablet_bootstrap.cc:492] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.200412  9198 ts_tablet_manager.cc:1403] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.085s	user 0.003s	sys 0.014s
I20260709 13:00:38.211344  9107 heartbeater.cc:499] Master 127.0.107.254:37477 was elected leader, sending a full tablet report...
I20260709 13:00:38.229926  9197 ts_tablet_manager.cc:1434] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.001s
I20260709 13:00:38.231148  9197 tablet_bootstrap.cc:492] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
I20260709 13:00:38.236380  9032 heartbeater.cc:499] Master 127.0.107.254:37477 was elected leader, sending a full tablet report...
I20260709 13:00:38.240170  9198 raft_consensus.cc:359] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.251022  9198 raft_consensus.cc:385] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.251425  9198 raft_consensus.cc:740] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.252215  9198 consensus_queue.cc:260] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.256754  9197 tablet_bootstrap.cc:654] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.260938  9181 heartbeater.cc:499] Master 127.0.107.254:37477 was elected leader, sending a full tablet report...
I20260709 13:00:38.265280  9196 ts_tablet_manager.cc:1434] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.102s	user 0.026s	sys 0.017s
I20260709 13:00:38.266021  9198 ts_tablet_manager.cc:1434] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.002s
I20260709 13:00:38.266383  9196 tablet_bootstrap.cc:492] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.267159  9198 tablet_bootstrap.cc:492] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
I20260709 13:00:38.269964  9197 tablet_bootstrap.cc:492] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.270532  9197 ts_tablet_manager.cc:1403] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.001s
W20260709 13:00:38.273790  9108 tablet.cc:2406] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:38.273893  9197 raft_consensus.cc:359] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.274853  9197 raft_consensus.cc:385] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.275190  9197 raft_consensus.cc:740] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.276407  9198 tablet_bootstrap.cc:654] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.276937  9197 consensus_queue.cc:260] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.282558  9197 ts_tablet_manager.cc:1434] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:00:38.283962  9196 tablet_bootstrap.cc:654] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.284554  9197 tablet_bootstrap.cc:492] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
I20260709 13:00:38.299405  9198 tablet_bootstrap.cc:492] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.300104  9198 ts_tablet_manager.cc:1403] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.021s
I20260709 13:00:38.301880  9197 tablet_bootstrap.cc:654] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.303354  9196 tablet_bootstrap.cc:492] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.303905  9196 ts_tablet_manager.cc:1403] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.003s
I20260709 13:00:38.303773  9198 raft_consensus.cc:359] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.304736  9198 raft_consensus.cc:385] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.305145  9198 raft_consensus.cc:740] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.306038  9198 consensus_queue.cc:260] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.307281  9197 tablet_bootstrap.cc:492] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.307792  9197 ts_tablet_manager.cc:1403] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.004s
I20260709 13:00:38.307520  9196 raft_consensus.cc:359] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.308370  9196 raft_consensus.cc:385] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.308493  9198 ts_tablet_manager.cc:1434] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:38.308758  9196 raft_consensus.cc:740] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.309777  9198 tablet_bootstrap.cc:492] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
I20260709 13:00:38.309928  9196 consensus_queue.cc:260] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.311051  9197 raft_consensus.cc:359] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.311781  9197 raft_consensus.cc:385] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.312090  9197 raft_consensus.cc:740] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.313001  9197 consensus_queue.cc:260] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.320438  9198 tablet_bootstrap.cc:654] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.321128  9196 ts_tablet_manager.cc:1434] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.007s
I20260709 13:00:38.322263  9196 tablet_bootstrap.cc:492] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.329664  9196 tablet_bootstrap.cc:654] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.330775  9197 ts_tablet_manager.cc:1434] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.007s
I20260709 13:00:38.332742  9198 tablet_bootstrap.cc:492] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.333339  9198 ts_tablet_manager.cc:1403] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 13:00:38.334349  9197 tablet_bootstrap.cc:492] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
I20260709 13:00:38.336544  9198 raft_consensus.cc:359] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.337488  9198 raft_consensus.cc:385] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.337865  9198 raft_consensus.cc:740] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.338792  9198 consensus_queue.cc:260] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.341562  9197 tablet_bootstrap.cc:654] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.342304  9203 raft_consensus.cc:493] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.342805  9203 raft_consensus.cc:515] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.343225  9198 ts_tablet_manager.cc:1434] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:00:38.344388  9198 tablet_bootstrap.cc:492] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
I20260709 13:00:38.345517  9203 leader_election.cc:290] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.352177  9198 tablet_bootstrap.cc:654] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.355374  9196 tablet_bootstrap.cc:492] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.356562  9196 ts_tablet_manager.cc:1403] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.020s
I20260709 13:00:38.359079  9197 tablet_bootstrap.cc:492] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.359650  9197 ts_tablet_manager.cc:1403] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.026s	user 0.002s	sys 0.009s
I20260709 13:00:38.360111  9196 raft_consensus.cc:359] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.361009  9196 raft_consensus.cc:385] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.361351  9196 raft_consensus.cc:740] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.362299  9196 consensus_queue.cc:260] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.363085  9197 raft_consensus.cc:359] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.363932  9197 raft_consensus.cc:385] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.364277  9197 raft_consensus.cc:740] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.369304  9197 consensus_queue.cc:260] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.371609  9203 raft_consensus.cc:493] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.372157  9203 raft_consensus.cc:515] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.374325  9203 leader_election.cc:290] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.371723  9197 ts_tablet_manager.cc:1434] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.005s
I20260709 13:00:38.366993  9196 ts_tablet_manager.cc:1434] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:00:38.375926  9196 tablet_bootstrap.cc:492] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.376775  9197 tablet_bootstrap.cc:492] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
I20260709 13:00:38.378656  9204 raft_consensus.cc:493] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.379208  9204 raft_consensus.cc:515] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.382836  9196 tablet_bootstrap.cc:654] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.375872  9198 tablet_bootstrap.cc:492] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.383482  9204 leader_election.cc:290] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.383929  9198 ts_tablet_manager.cc:1403] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.008s
I20260709 13:00:38.388146  9198 raft_consensus.cc:359] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:38.393657  9198 raft_consensus.cc:385] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.393954  9198 raft_consensus.cc:740] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.394410  9197 tablet_bootstrap.cc:654] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.394673  9198 consensus_queue.cc:260] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:38.394490  9007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3c665832434c87abefd254a50e7668" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.394842  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.397248  9198 ts_tablet_manager.cc:1434] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
W20260709 13:00:38.398046  9048 leader_election.cc:343] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.398305  9198 tablet_bootstrap.cc:492] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
W20260709 13:00:38.398790  9048 leader_election.cc:343] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.413931  9198 tablet_bootstrap.cc:654] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.421900  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3c665832434c87abefd254a50e7668" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47" is_pre_election: true
I20260709 13:00:38.423892  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47" is_pre_election: true
W20260709 13:00:38.428222  9048 leader_election.cc:343] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.428905  9048 leader_election.cc:304] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e91887cfb03c4eea9dd840fd8e745f84; no voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47
I20260709 13:00:38.429490  9198 tablet_bootstrap.cc:492] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.429889  9203 raft_consensus.cc:2749] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:38.430226  9198 ts_tablet_manager.cc:1403] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.005s
W20260709 13:00:38.430310  9048 leader_election.cc:343] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.431092  9048 leader_election.cc:304] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e91887cfb03c4eea9dd840fd8e745f84; no voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47
I20260709 13:00:38.432061  9203 raft_consensus.cc:2749] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:38.436447  9196 tablet_bootstrap.cc:492] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.437074  9196 ts_tablet_manager.cc:1403] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.018s
I20260709 13:00:38.438441  9203 raft_consensus.cc:493] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.439000  9203 raft_consensus.cc:515] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.440100  9196 raft_consensus.cc:359] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.440712  9196 raft_consensus.cc:385] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.441006  9196 raft_consensus.cc:740] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.441124  9203 leader_election.cc:290] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.441768  9196 consensus_queue.cc:260] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.442233  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.442867  9197 tablet_bootstrap.cc:492] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.443375  9197 ts_tablet_manager.cc:1403] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.022s
W20260709 13:00:38.443759  9048 leader_election.cc:343] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.444124  9196 ts_tablet_manager.cc:1434] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:00:38.445122  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47" is_pre_election: true
I20260709 13:00:38.445786  9156 raft_consensus.cc:2468] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 0.
I20260709 13:00:38.446655  9196 tablet_bootstrap.cc:492] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.446421  9197 raft_consensus.cc:359] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.447190  9197 raft_consensus.cc:385] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.447211  9048 leader_election.cc:304] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98544cace1ab4d84bb7940ffd240fd47, e91887cfb03c4eea9dd840fd8e745f84; no voters: 01b224f1c8d44ba7901c399f572c68f9
I20260709 13:00:38.447623  9197 raft_consensus.cc:740] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.448321  9203 raft_consensus.cc:2804] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.448705  9203 raft_consensus.cc:493] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.448573  9197 consensus_queue.cc:260] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.449154  9203 raft_consensus.cc:3060] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.451970  9197 ts_tablet_manager.cc:1434] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:38.453255  9196 tablet_bootstrap.cc:654] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.452945  9197 tablet_bootstrap.cc:492] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
I20260709 13:00:38.445494  9198 raft_consensus.cc:359] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.456262  9198 raft_consensus.cc:385] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.456563  9198 raft_consensus.cc:740] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.457780  9198 consensus_queue.cc:260] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.460762  9198 ts_tablet_manager.cc:1434] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.006s
I20260709 13:00:38.461797  9198 tablet_bootstrap.cc:492] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
I20260709 13:00:38.461836  9197 tablet_bootstrap.cc:654] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.469280  9198 tablet_bootstrap.cc:654] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.473765  9203 raft_consensus.cc:515] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.477489  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
W20260709 13:00:38.479130  9048 leader_election.cc:343] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.481387  9082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262f2b0fe84048ecb51905469e86c16f" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84" is_pre_election: true
I20260709 13:00:38.481383  9198 tablet_bootstrap.cc:492] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.482676  9198 ts_tablet_manager.cc:1403] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 13:00:38.482303  9082 raft_consensus.cc:2468] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.484807  9122 leader_election.cc:304] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98544cace1ab4d84bb7940ffd240fd47, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.485698  9203 leader_election.cc:290] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.486229  9204 raft_consensus.cc:2804] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.486644  9204 raft_consensus.cc:493] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.487005  9204 raft_consensus.cc:3060] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.487557  9198 raft_consensus.cc:359] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.488341  9198 raft_consensus.cc:385] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.488627  9198 raft_consensus.cc:740] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.489517  9197 tablet_bootstrap.cc:492] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.489758  9196 tablet_bootstrap.cc:492] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.489590  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:38.490192  9197 ts_tablet_manager.cc:1403] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.015s
I20260709 13:00:38.490376  9196 ts_tablet_manager.cc:1403] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.003s
I20260709 13:00:38.490422  9156 raft_consensus.cc:3060] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:38.491322  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:38.491760  9198 consensus_queue.cc:260] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.493314  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262f2b0fe84048ecb51905469e86c16f" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.493474  9197 raft_consensus.cc:359] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:38.494148  9197 raft_consensus.cc:385] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.494437  9197 raft_consensus.cc:740] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.495314  9197 consensus_queue.cc:260] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:38.497820  9197 ts_tablet_manager.cc:1434] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:38.498826  9197 tablet_bootstrap.cc:492] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
I20260709 13:00:38.505318  9197 tablet_bootstrap.cc:654] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.507123  9204 raft_consensus.cc:515] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.502903  9156 raft_consensus.cc:2468] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 1.
I20260709 13:00:38.511514  9226 raft_consensus.cc:493] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.511703  9196 raft_consensus.cc:359] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.512626  9198 ts_tablet_manager.cc:1434] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.021s
I20260709 13:00:38.512099  9226 raft_consensus.cc:515] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:38.518222  9196 raft_consensus.cc:385] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.516343  9197 tablet_bootstrap.cc:492] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.518602  9048 leader_election.cc:304] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98544cace1ab4d84bb7940ffd240fd47, e91887cfb03c4eea9dd840fd8e745f84; no voters: 01b224f1c8d44ba7901c399f572c68f9
I20260709 13:00:38.519007  9197 ts_tablet_manager.cc:1403] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:00:38.519145  9198 tablet_bootstrap.cc:492] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
I20260709 13:00:38.509622  9204 leader_election.cc:290] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.519865  9203 raft_consensus.cc:2804] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.520377  9226 leader_election.cc:290] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.520383  9203 raft_consensus.cc:697] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:38.522039  9203 consensus_queue.cc:237] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.522446  9197 raft_consensus.cc:359] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.523203  9197 raft_consensus.cc:385] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.517675  9082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262f2b0fe84048ecb51905469e86c16f" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:38.523659  9197 raft_consensus.cc:740] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.515018  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262f2b0fe84048ecb51905469e86c16f" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:38.524242  9082 raft_consensus.cc:3060] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.524678  9197 consensus_queue.cc:260] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.526049  9198 tablet_bootstrap.cc:654] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.526716  9197 ts_tablet_manager.cc:1434] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:38.527838  9197 tablet_bootstrap.cc:492] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
W20260709 13:00:38.531761  9122 leader_election.cc:343] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.535089  9197 tablet_bootstrap.cc:654] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.536108  9081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08e089be2c549a79ee0842418f856fa" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84" is_pre_election: true
I20260709 13:00:38.537194  9081 raft_consensus.cc:2468] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.518602  9196 raft_consensus.cc:740] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.539625  9196 consensus_queue.cc:260] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.543035  9007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08e089be2c549a79ee0842418f856fa" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.543743  9007 raft_consensus.cc:2468] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.542881  8903 catalog_manager.cc:5697] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.544303  9197 tablet_bootstrap.cc:492] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.544852  9197 ts_tablet_manager.cc:1403] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.004s
I20260709 13:00:38.544862  9204 raft_consensus.cc:493] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.545503  9204 raft_consensus.cc:515] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.546007  9082 raft_consensus.cc:2468] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.547808  9204 leader_election.cc:290] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.542354  9006 raft_consensus.cc:3060] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.548125  9197 raft_consensus.cc:359] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.541369  9198 tablet_bootstrap.cc:492] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.548971  9197 raft_consensus.cc:385] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.549283  9198 ts_tablet_manager.cc:1403] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.006s
I20260709 13:00:38.549304  9197 raft_consensus.cc:740] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.550405  9197 consensus_queue.cc:260] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.552837  9197 ts_tablet_manager.cc:1434] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:38.552803  9198 raft_consensus.cc:359] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.553779  9198 raft_consensus.cc:385] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.541707  9226 raft_consensus.cc:493] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.554101  9197 tablet_bootstrap.cc:492] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
I20260709 13:00:38.554639  9226 raft_consensus.cc:515] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.557139  9226 leader_election.cc:290] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.554087  9198 raft_consensus.cc:740] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.558624  9198 consensus_queue.cc:260] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.558964  9006 raft_consensus.cc:2468] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.561079  9197 tablet_bootstrap.cc:654] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.561553  9198 ts_tablet_manager.cc:1434] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.008s
I20260709 13:00:38.562844  9198 tablet_bootstrap.cc:492] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
I20260709 13:00:38.572367  9198 tablet_bootstrap.cc:654] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.541086  9122 leader_election.cc:304] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98544cace1ab4d84bb7940ffd240fd47, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.575045  9196 ts_tablet_manager.cc:1434] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.084s	user 0.010s	sys 0.000s
I20260709 13:00:38.576159  9196 tablet_bootstrap.cc:492] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.576037  9122 leader_election.cc:304] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:38.577380  9204 raft_consensus.cc:2804] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.577867  9204 raft_consensus.cc:493] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.578276  9204 raft_consensus.cc:3060] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.579061  9007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3c665832434c87abefd254a50e7668" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.579794  9007 raft_consensus.cc:2468] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.580909  9226 raft_consensus.cc:2804] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.581060  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5edc423b243d4a7dc2a17a0580e40" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.581668  9226 raft_consensus.cc:697] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:38.581876  9005 raft_consensus.cc:2468] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.582978  9082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3c665832434c87abefd254a50e7668" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84" is_pre_election: true
I20260709 13:00:38.583357  9196 tablet_bootstrap.cc:654] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.583659  9082 raft_consensus.cc:2468] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.583424  9226 consensus_queue.cc:237] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.586615  9197 tablet_bootstrap.cc:492] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.584820  9081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5edc423b243d4a7dc2a17a0580e40" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84" is_pre_election: true
I20260709 13:00:38.588109  9122 leader_election.cc:304] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98544cace1ab4d84bb7940ffd240fd47, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.588748  9081 raft_consensus.cc:2468] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.587158  9197 ts_tablet_manager.cc:1403] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.033s	user 0.026s	sys 0.006s
I20260709 13:00:38.590131  9203 raft_consensus.cc:493] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.590245  9225 raft_consensus.cc:2804] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.590649  9203 raft_consensus.cc:515] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.590873  9122 leader_election.cc:304] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:38.591239  9204 raft_consensus.cc:515] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:38.590684  9225 raft_consensus.cc:493] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.592592  9197 raft_consensus.cc:359] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.593189  9225 raft_consensus.cc:3060] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.594089  9204 leader_election.cc:290] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.594817  9204 raft_consensus.cc:2804] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.595227  9204 raft_consensus.cc:493] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.595793  9204 raft_consensus.cc:3060] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.593323  9197 raft_consensus.cc:385] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.601353  9197 raft_consensus.cc:740] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.604772  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef21d002a741daa1c56c59fdf5db52" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.604967  9204 raft_consensus.cc:515] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.605576  9005 raft_consensus.cc:2468] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 0.
I20260709 13:00:38.608891  9197 consensus_queue.cc:260] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.610277  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08e089be2c549a79ee0842418f856fa" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:38.610922  9005 raft_consensus.cc:3060] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.611131  9197 ts_tablet_manager.cc:1434] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.003s
I20260709 13:00:38.611208  9081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08e089be2c549a79ee0842418f856fa" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:38.611879  9081 raft_consensus.cc:3060] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.612260  9197 tablet_bootstrap.cc:492] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84: Bootstrap starting.
I20260709 13:00:38.612707  9048 leader_election.cc:304] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.617774  9203 leader_election.cc:290] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.618434  9221 raft_consensus.cc:2804] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.618607  9197 tablet_bootstrap.cc:654] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.618919  9221 raft_consensus.cc:493] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.619313  9221 raft_consensus.cc:3060] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.622876  9081 raft_consensus.cc:2468] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.626748  9005 raft_consensus.cc:2468] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.627292  9221 raft_consensus.cc:515] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.627964  9204 leader_election.cc:290] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.629493  9221 leader_election.cc:290] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.629629  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5edc423b243d4a7dc2a17a0580e40" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:38.629906  9122 leader_election.cc:304] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:38.630352  9006 raft_consensus.cc:3060] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.631278  9196 tablet_bootstrap.cc:492] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.631675  9204 raft_consensus.cc:2804] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.631825  9196 ts_tablet_manager.cc:1403] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.012s
I20260709 13:00:38.632210  9204 raft_consensus.cc:697] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:38.633119  9204 consensus_queue.cc:237] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:38.633659  9007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef21d002a741daa1c56c59fdf5db52" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:38.634466  9007 raft_consensus.cc:3060] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.622676  9225 raft_consensus.cc:515] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.635104  9196 raft_consensus.cc:359] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.635840  9196 raft_consensus.cc:385] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.636139  9196 raft_consensus.cc:740] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.637140  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef21d002a741daa1c56c59fdf5db52" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47" is_pre_election: true
I20260709 13:00:38.636933  9196 consensus_queue.cc:260] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.637784  9156 raft_consensus.cc:2468] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 0.
I20260709 13:00:38.639243  9196 ts_tablet_manager.cc:1434] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:00:38.640409  9196 tablet_bootstrap.cc:492] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.641441  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef21d002a741daa1c56c59fdf5db52" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:38.642031  9156 raft_consensus.cc:3060] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.646941  9196 tablet_bootstrap.cc:654] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.649811  9156 raft_consensus.cc:2468] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 1.
I20260709 13:00:38.636521  9225 leader_election.cc:290] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.657302  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3c665832434c87abefd254a50e7668" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:38.658164  9004 raft_consensus.cc:3060] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.670413  9082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3c665832434c87abefd254a50e7668" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:38.671149  9221 raft_consensus.cc:493] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.671672  9221 raft_consensus.cc:515] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.673334  9007 raft_consensus.cc:2468] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 1.
I20260709 13:00:38.673820  9221 leader_election.cc:290] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.671173  9082 raft_consensus.cc:3060] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.678318  8902 catalog_manager.cc:5697] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.673363  9048 leader_election.cc:304] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98544cace1ab4d84bb7940ffd240fd47, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.683024  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47" is_pre_election: true
I20260709 13:00:38.683809  9221 raft_consensus.cc:2804] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:00:38.684597  9048 leader_election.cc:343] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.685650  9004 raft_consensus.cc:2468] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.687240  9122 leader_election.cc:304] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:38.688478  9236 raft_consensus.cc:2804] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.689172  9236 raft_consensus.cc:697] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:38.690380  9236 consensus_queue.cc:237] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.671202  9081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5edc423b243d4a7dc2a17a0580e40" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:38.684443  9221 raft_consensus.cc:697] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:38.692962  9221 consensus_queue.cc:237] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.697188  9081 raft_consensus.cc:3060] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.698971  9196 tablet_bootstrap.cc:492] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.699501  9196 ts_tablet_manager.cc:1403] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.021s
I20260709 13:00:38.702620  9196 raft_consensus.cc:359] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.703310  9196 raft_consensus.cc:385] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.703589  9196 raft_consensus.cc:740] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.703908  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.704427  9196 consensus_queue.cc:260] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
W20260709 13:00:38.705693  9048 leader_election.cc:343] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.706252  9048 leader_election.cc:304] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e91887cfb03c4eea9dd840fd8e745f84; no voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47
I20260709 13:00:38.707149  9203 raft_consensus.cc:2749] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:38.664549  9006 raft_consensus.cc:2468] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.707850  9196 ts_tablet_manager.cc:1434] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:00:38.708842  9122 leader_election.cc:304] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:38.709738  9225 raft_consensus.cc:2804] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.710239  9225 raft_consensus.cc:697] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:38.711053  9225 consensus_queue.cc:237] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.713294  9196 tablet_bootstrap.cc:492] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.718951  9082 raft_consensus.cc:2468] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.725317  8905 catalog_manager.cc:5697] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.729311  9081 raft_consensus.cc:2468] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.729838  9198 tablet_bootstrap.cc:492] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.730361  9198 ts_tablet_manager.cc:1403] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.168s	user 0.030s	sys 0.027s
I20260709 13:00:38.732764  9196 tablet_bootstrap.cc:654] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.732781  9198 raft_consensus.cc:359] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.733697  9198 raft_consensus.cc:385] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.734009  9198 raft_consensus.cc:740] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.734179  8903 catalog_manager.cc:5697] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.734835  9198 consensus_queue.cc:260] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.736850  9198 ts_tablet_manager.cc:1434] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:00:38.737848  9198 tablet_bootstrap.cc:492] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
I20260709 13:00:38.738653  9196 tablet_bootstrap.cc:492] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.739112  9196 ts_tablet_manager.cc:1403] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:00:38.736163  8903 catalog_manager.cc:5697] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.741781  9196 raft_consensus.cc:359] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.742421  9196 raft_consensus.cc:385] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.742655  9196 raft_consensus.cc:740] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.743235  9198 tablet_bootstrap.cc:654] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.743611  9197 tablet_bootstrap.cc:492] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84: No bootstrap required, opened a new log
I20260709 13:00:38.743351  9196 consensus_queue.cc:260] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.745445  9196 ts_tablet_manager.cc:1434] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:00:38.746744  9196 tablet_bootstrap.cc:492] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.744074  9197 ts_tablet_manager.cc:1403] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84: Time spent bootstrapping tablet: real 0.132s	user 0.032s	sys 0.026s
I20260709 13:00:38.752065  9197 raft_consensus.cc:359] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.752743  9197 raft_consensus.cc:385] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.753011  9197 raft_consensus.cc:740] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.753782  9197 consensus_queue.cc:260] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.754631  9196 tablet_bootstrap.cc:654] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.759459  8902 catalog_manager.cc:5697] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.759974  9198 tablet_bootstrap.cc:492] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.760715  9198 ts_tablet_manager.cc:1403] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.010s
I20260709 13:00:38.764350  9198 raft_consensus.cc:359] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.765054  9198 raft_consensus.cc:385] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.765332  9198 raft_consensus.cc:740] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.766075  9198 consensus_queue.cc:260] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.767494  9197 ts_tablet_manager.cc:1434] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:00:38.768923  9198 ts_tablet_manager.cc:1434] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:38.770187  9198 tablet_bootstrap.cc:492] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47: Bootstrap starting.
I20260709 13:00:38.774958  9196 tablet_bootstrap.cc:492] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.775394  9196 ts_tablet_manager.cc:1403] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.011s
I20260709 13:00:38.777545  9196 raft_consensus.cc:359] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.780572  9198 tablet_bootstrap.cc:654] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.778262  9196 raft_consensus.cc:385] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.782807  9196 raft_consensus.cc:740] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.783728  9196 consensus_queue.cc:260] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.785697  9196 ts_tablet_manager.cc:1434] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:38.786157  9198 tablet_bootstrap.cc:492] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47: No bootstrap required, opened a new log
I20260709 13:00:38.786613  9196 tablet_bootstrap.cc:492] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:38.786770  9198 ts_tablet_manager.cc:1403] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:00:38.789510  9198 raft_consensus.cc:359] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.790093  9198 raft_consensus.cc:385] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.790369  9198 raft_consensus.cc:740] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.791077  9198 consensus_queue.cc:260] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.792959  9196 tablet_bootstrap.cc:654] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.793161  9198 ts_tablet_manager.cc:1434] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:38.798547  9196 tablet_bootstrap.cc:492] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: No bootstrap required, opened a new log
I20260709 13:00:38.799049  9196 ts_tablet_manager.cc:1403] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 13:00:38.801656  9196 raft_consensus.cc:359] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.802290  9196 raft_consensus.cc:385] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.802556  9196 raft_consensus.cc:740] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.803208  9196 consensus_queue.cc:260] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.805056  9196 ts_tablet_manager.cc:1434] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:38.834190  9221 raft_consensus.cc:493] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.834751  9221 raft_consensus.cc:515] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.836423  9221 leader_election.cc:290] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.837311  9007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9910df027fcf4af3b51ef6f95b8d2108" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.837540  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9910df027fcf4af3b51ef6f95b8d2108" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47" is_pre_election: true
I20260709 13:00:38.837977  9007 raft_consensus.cc:2468] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 0.
I20260709 13:00:38.838246  9156 raft_consensus.cc:2468] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 0.
I20260709 13:00:38.839010  9048 leader_election.cc:304] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.839658  9221 raft_consensus.cc:2804] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.839960  9221 raft_consensus.cc:493] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.840308  9221 raft_consensus.cc:3060] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.850435  9221 raft_consensus.cc:515] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.853065  9221 leader_election.cc:290] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.854326  9007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9910df027fcf4af3b51ef6f95b8d2108" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:38.854216  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9910df027fcf4af3b51ef6f95b8d2108" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:38.855185  9156 raft_consensus.cc:3060] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.855000  9007 raft_consensus.cc:3060] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.858443  9236 raft_consensus.cc:493] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.859037  9236 raft_consensus.cc:515] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.861485  9236 leader_election.cc:290] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.863220  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.864094  9006 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.863220  9081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84" is_pre_election: true
I20260709 13:00:38.864341  9007 raft_consensus.cc:2468] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 1.
I20260709 13:00:38.865005  9081 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.865353  9122 leader_election.cc:304] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:38.866312  9048 leader_election.cc:304] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.866824  9236 raft_consensus.cc:2804] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.865314  9156 raft_consensus.cc:2468] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 1.
I20260709 13:00:38.867214  9221 raft_consensus.cc:2804] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.868182  9221 raft_consensus.cc:697] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:38.867254  9236 raft_consensus.cc:493] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.869249  9236 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.869205  9221 consensus_queue.cc:237] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.872109  9203 raft_consensus.cc:493] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.872602  9203 raft_consensus.cc:515] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.873193  9225 raft_consensus.cc:493] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.873800  9225 raft_consensus.cc:515] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.874689  9203 leader_election.cc:290] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.875856  9225 leader_election.cc:290] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.877851  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7645164283334af18edfa7b7602e786a" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.877707  9236 raft_consensus.cc:515] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.877710  9081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84" is_pre_election: true
I20260709 13:00:38.878842  9006 raft_consensus.cc:2468] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 0.
I20260709 13:00:38.879057  9081 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.880134  9236 leader_election.cc:290] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.881183  9007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9" is_pre_election: true
I20260709 13:00:38.881651  9048 leader_election.cc:304] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.881851  9007 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 0.
I20260709 13:00:38.882040  9081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:38.882591  9081 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.882992  9221 raft_consensus.cc:2804] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.883509  9221 raft_consensus.cc:493] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.883912  9221 raft_consensus.cc:3060] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.891109  9221 raft_consensus.cc:515] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.893025  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:38.893584  9221 leader_election.cc:290] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:38.893666  9006 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.895363  8903 catalog_manager.cc:5697] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.896214  9081 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.897038  9007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7645164283334af18edfa7b7602e786a" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:38.897627  9122 leader_election.cc:304] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98544cace1ab4d84bb7940ffd240fd47, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.898744  9236 raft_consensus.cc:2804] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.899334  9236 raft_consensus.cc:493] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.899675  9236 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.900348  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7645164283334af18edfa7b7602e786a" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47" is_pre_election: true
I20260709 13:00:38.900707  9006 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.901290  9156 raft_consensus.cc:2468] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 0.
I20260709 13:00:38.902803  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7645164283334af18edfa7b7602e786a" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:38.903331  9156 raft_consensus.cc:3060] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.907025  9236 raft_consensus.cc:515] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.897635  9007 raft_consensus.cc:3060] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.909775  9236 leader_election.cc:290] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:38.910450  9122 leader_election.cc:304] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98544cace1ab4d84bb7940ffd240fd47, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.913184  9006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:38.913910  9081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:38.914050  9006 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.914539  9081 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.915652  9007 raft_consensus.cc:2468] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 1.
I20260709 13:00:38.916745  9048 leader_election.cc:304] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:38.917572  9203 raft_consensus.cc:2804] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.918085  9203 raft_consensus.cc:697] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:38.918920  9203 consensus_queue.cc:237] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.919919  9006 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.920866  9122 leader_election.cc:304] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:38.921473  9081 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 1.
I20260709 13:00:38.921859  9225 raft_consensus.cc:2804] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.922402  9236 raft_consensus.cc:2804] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.922996  9236 raft_consensus.cc:697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:38.913154  9156 raft_consensus.cc:2468] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 1.
I20260709 13:00:38.922437  9225 raft_consensus.cc:697] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:38.923811  9236 consensus_queue.cc:237] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.924811  9225 consensus_queue.cc:237] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.931509  8903 catalog_manager.cc:5697] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 0 to 1, leader changed from <none> to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.943405  8902 catalog_manager.cc:5697] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.945031  8902 catalog_manager.cc:5697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.989620  9202 raft_consensus.cc:493] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.990190  9202 raft_consensus.cc:515] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:38.992161  9202 leader_election.cc:290] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:39.000489  9006 raft_consensus.cc:3060] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.002820  9081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "01b224f1c8d44ba7901c399f572c68f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84" is_pre_election: true
I20260709 13:00:39.005061  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "01b224f1c8d44ba7901c399f572c68f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98544cace1ab4d84bb7940ffd240fd47" is_pre_election: true
I20260709 13:00:39.005693  9156 raft_consensus.cc:2393] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01b224f1c8d44ba7901c399f572c68f9 in current term 1: Already voted for candidate e91887cfb03c4eea9dd840fd8e745f84 in this term.
I20260709 13:00:39.006630  8973 leader_election.cc:304] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9; no voters: 98544cace1ab4d84bb7940ffd240fd47, e91887cfb03c4eea9dd840fd8e745f84
I20260709 13:00:39.008162  9202 raft_consensus.cc:2749] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:39.009191  9203 consensus_queue.cc:1048] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.020838  9203 consensus_queue.cc:1048] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.070870  9225 consensus_queue.cc:1048] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.082620  9225 consensus_queue.cc:1048] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.084033  9203 consensus_queue.cc:1048] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:39.098141  9203 consensus_queue.cc:1048] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.105734  9236 consensus_queue.cc:1048] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.107148  9236 consensus_queue.cc:1048] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.119305  9225 consensus_queue.cc:1048] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:39.134897  9226 consensus_queue.cc:1048] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.143705  9225 consensus_queue.cc:1048] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.147114  9272 consensus_queue.cc:1048] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:39.170639   431 ts_manager.cc:295] Set tserver state for 01b224f1c8d44ba7901c399f572c68f9 to MAINTENANCE_MODE
I20260709 13:00:39.171666   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:00:39.210805   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:39.211588   431 tablet_replica.cc:333] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.212531   431 raft_consensus.cc:2243] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.212988   431 raft_consensus.cc:2272] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.214748   431 tablet_replica.cc:333] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.215328   431 raft_consensus.cc:2243] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.215670   431 raft_consensus.cc:2272] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.217324   431 tablet_replica.cc:333] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.217808   431 raft_consensus.cc:2243] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.218154   431 raft_consensus.cc:2272] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.220077   431 tablet_replica.cc:333] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.220539   431 raft_consensus.cc:2243] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.220942   431 raft_consensus.cc:2272] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.222842   431 tablet_replica.cc:333] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.223313   431 raft_consensus.cc:2243] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.223615   431 raft_consensus.cc:2272] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.225355   431 tablet_replica.cc:333] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.225831   431 raft_consensus.cc:2243] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.226219   431 raft_consensus.cc:2272] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.228595   431 tablet_replica.cc:333] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.229244   431 raft_consensus.cc:2243] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.229705   431 raft_consensus.cc:2272] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.231750   431 tablet_replica.cc:333] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.232265   431 raft_consensus.cc:2243] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.232621   431 raft_consensus.cc:2272] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.234458   431 tablet_replica.cc:333] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.234963   431 raft_consensus.cc:2243] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.235342   431 raft_consensus.cc:2272] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.237725   431 tablet_replica.cc:333] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: stopping tablet replica
I20260709 13:00:39.238190   431 raft_consensus.cc:2243] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:39.238579   431 raft_consensus.cc:2272] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.268263   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:00:39.276183  9048 consensus_peers.cc:597] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:39.295764  9203 consensus_queue.cc:1048] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.349388  9203 consensus_queue.cc:1048] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:39.350831  9122 consensus_peers.cc:597] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:39.361871  9048 consensus_peers.cc:597] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:39.397444  9048 consensus_peers.cc:597] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:39.425284  9122 consensus_peers.cc:597] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:39.456583  9204 consensus_queue.cc:1048] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:39.492252  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:00:39.505959  9204 consensus_queue.cc:1048] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:39.518744  9048 consensus_peers.cc:597] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:39.583762  9122 consensus_peers.cc:597] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:39.618326  9122 consensus_peers.cc:597] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:39.649520  9122 consensus_peers.cc:597] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:39.651311  9122 consensus_peers.cc:597] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:40.493216  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:00:40.538162  9048 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111) [suppressed 154 similar messages]
W20260709 13:00:41.494298  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:00:41.627523  9048 consensus_peers.cc:597] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:41.725978  9048 consensus_peers.cc:597] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:41.826725  9048 consensus_peers.cc:597] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:41.925082  9122 consensus_peers.cc:597] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:41.951284  9122 consensus_peers.cc:597] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:42.114840  9048 consensus_peers.cc:597] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:42.148156  9122 consensus_peers.cc:597] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:42.257097  9122 consensus_peers.cc:597] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:42.411597  9122 consensus_peers.cc:597] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:42.420194  9122 consensus_peers.cc:597] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:42.495370  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:00:43.496368  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:00:44.070814  9122 consensus_peers.cc:597] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:44.136561  9048 consensus_peers.cc:597] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:44.177929  9048 consensus_peers.cc:597] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:44.252348  9048 consensus_peers.cc:597] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43333: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:44.287376   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:44.293627  9291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:44.294834  9292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:44.295732  9294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:44.298177   431 server_base.cc:1061] running on GCE node
I20260709 13:00:44.300273   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:44.300469   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:44.300607   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602044300596 us; error 0 us; skew 500 ppm
I20260709 13:00:44.301162   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:44.303509   431 webserver.cc:533] Webserver started at http://127.0.107.193:40929/ using document root <none> and password file <none>
I20260709 13:00:44.304023   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:44.304199   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:00:44.307739   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:00:44.311498  9299 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:44.312264   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:44.312580   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "01b224f1c8d44ba7901c399f572c68f9"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-73vh"
I20260709 13:00:44.312968   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:44.332624   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:44.333810   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:44.335249   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:44.338654  9306 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:00:44.388825   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:00:44.389091   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.051s	user 0.002s	sys 0.000s
I20260709 13:00:44.389310   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:00:44.393630  9306 tablet_bootstrap.cc:492] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.407083  9306 tablet_bootstrap.cc:492] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.407902  9306 tablet_bootstrap.cc:492] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.408680  9306 ts_tablet_manager.cc:1403] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:00:44.411933  9306 raft_consensus.cc:359] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.412678  9306 raft_consensus.cc:740] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.413655  9306 consensus_queue.cc:260] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.454298  9306 ts_tablet_manager.cc:1434] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:00:44.457705  9306 tablet_bootstrap.cc:492] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.473893  9306 tablet_bootstrap.cc:492] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.474700  9306 tablet_bootstrap.cc:492] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.475293  9306 ts_tablet_manager.cc:1403] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 13:00:44.478008  9306 raft_consensus.cc:359] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.478912  9306 raft_consensus.cc:740] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.479729  9306 consensus_queue.cc:260] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.481693  9306 ts_tablet_manager.cc:1434] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:00:44.482533  9306 tablet_bootstrap.cc:492] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.488240   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:00:44.488564   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.099s	user 0.041s	sys 0.019s
I20260709 13:00:44.497430  9306 tablet_bootstrap.cc:492] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:00:44.498126  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:00:44.498646  9306 tablet_bootstrap.cc:492] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.499404  9306 ts_tablet_manager.cc:1403] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:00:44.503062  9306 raft_consensus.cc:359] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.503733  9306 raft_consensus.cc:740] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.504449  9306 consensus_queue.cc:260] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.506477  9306 ts_tablet_manager.cc:1434] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:44.507375  9306 tablet_bootstrap.cc:492] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.520313  9306 tablet_bootstrap.cc:492] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.521195  9306 tablet_bootstrap.cc:492] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.521878  9306 ts_tablet_manager.cc:1403] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:00:44.523841  9306 raft_consensus.cc:359] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.524538  9306 raft_consensus.cc:740] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.525357  9306 consensus_queue.cc:260] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.527442  9306 ts_tablet_manager.cc:1434] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:44.528179  9306 tablet_bootstrap.cc:492] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.540891  9306 tablet_bootstrap.cc:492] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.541981  9306 tablet_bootstrap.cc:492] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.543076  9306 ts_tablet_manager.cc:1403] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:00:44.547956  9306 raft_consensus.cc:359] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.548825  9306 raft_consensus.cc:740] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.549907  9306 consensus_queue.cc:260] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.552994  9306 ts_tablet_manager.cc:1434] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:00:44.554100  9306 tablet_bootstrap.cc:492] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.574321  9306 tablet_bootstrap.cc:492] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.575090  9306 tablet_bootstrap.cc:492] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.575711  9306 ts_tablet_manager.cc:1403] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:00:44.578397  9306 raft_consensus.cc:359] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.579258  9306 raft_consensus.cc:740] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.580111  9306 consensus_queue.cc:260] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.582326  9306 ts_tablet_manager.cc:1434] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:44.582840   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43333
I20260709 13:00:44.583081  9372 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43333 every 8 connection(s)
I20260709 13:00:44.583328  9306 tablet_bootstrap.cc:492] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.594760   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:44.613114  9306 tablet_bootstrap.cc:492] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.614310  9306 tablet_bootstrap.cc:492] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.615163  9306 ts_tablet_manager.cc:1403] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.007s
I20260709 13:00:44.621992  9306 raft_consensus.cc:359] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.622550  9306 raft_consensus.cc:740] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.623162  9306 consensus_queue.cc:260] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.625150  9306 ts_tablet_manager.cc:1434] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:00:44.626248  9306 tablet_bootstrap.cc:492] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.636044  9374 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37477
I20260709 13:00:44.636559  9374 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:44.637473  9374 heartbeater.cc:507] Master 127.0.107.254:37477 requested a full tablet report, sending...
I20260709 13:00:44.643666  9156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
mode: GRACEFUL
new_leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:52306
I20260709 13:00:44.644435  9156 raft_consensus.cc:606] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Received request to transfer leadership to TS e91887cfb03c4eea9dd840fd8e745f84
I20260709 13:00:44.645776  8905 ts_manager.cc:194] Re-registered known tserver with Master: 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333)
I20260709 13:00:44.646844  9306 tablet_bootstrap.cc:492] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.647979  9306 tablet_bootstrap.cc:492] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.648027  9156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
mode: GRACEFUL
new_leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:52306
I20260709 13:00:44.648761  9306 ts_tablet_manager.cc:1403] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:00:44.648780  9156 raft_consensus.cc:606] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Received request to transfer leadership to TS e91887cfb03c4eea9dd840fd8e745f84
I20260709 13:00:44.651340   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:44.652031   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:44.651842  9306 raft_consensus.cc:359] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.652658  9306 raft_consensus.cc:740] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.652901   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:44.653663  9306 consensus_queue.cc:260] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.655474  9306 ts_tablet_manager.cc:1434] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:44.656080  9306 tablet_bootstrap.cc:492] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.658895  8905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38326
I20260709 13:00:44.662961  9374 heartbeater.cc:499] Master 127.0.107.254:37477 was elected leader, sending a full tablet report...
I20260709 13:00:44.669380  9306 tablet_bootstrap.cc:492] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.670151  9306 tablet_bootstrap.cc:492] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.670687  9306 ts_tablet_manager.cc:1403] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:00:44.673266  9306 raft_consensus.cc:359] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:44.673806  9306 raft_consensus.cc:740] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.674484  9306 consensus_queue.cc:260] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } } peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } }
I20260709 13:00:44.676357  9306 ts_tablet_manager.cc:1434] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:44.677227  9306 tablet_bootstrap.cc:492] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap starting.
I20260709 13:00:44.689054  9306 tablet_bootstrap.cc:492] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.689677  9306 tablet_bootstrap.cc:492] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: Bootstrap complete.
I20260709 13:00:44.690222  9306 ts_tablet_manager.cc:1403] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:00:44.692083  9306 raft_consensus.cc:359] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.692540  9306 raft_consensus.cc:740] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b224f1c8d44ba7901c399f572c68f9, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.693130  9306 consensus_queue.cc:260] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:44.694902  9306 ts_tablet_manager.cc:1434] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:45.028054  9288 raft_consensus.cc:993] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47: : Instructing follower e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:45.028745  9358 raft_consensus.cc:1081] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Signalling peer e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:45.030223  9082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:60852
I20260709 13:00:45.030740  9082 raft_consensus.cc:493] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.031085  9082 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.038312  9082 raft_consensus.cc:515] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:45.040298  9082 leader_election.cc:290] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 2 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:45.041046  9344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:45.041293  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:45.042304  9344 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.042331  9156 raft_consensus.cc:3055] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:45.042845  9156 raft_consensus.cc:740] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:45.043907  9156 consensus_queue.cc:260] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:45.045583  9156 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.052006  9344 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 2.
I20260709 13:00:45.053397  9048 leader_election.cc:304] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:45.053892  9156 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 2.
I20260709 13:00:45.054196  9221 raft_consensus.cc:2804] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:45.055364  9221 raft_consensus.cc:697] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:45.056237  9221 consensus_queue.cc:237] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:45.063838  8905 catalog_manager.cc:5697] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 1 to 2, leader changed from 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195) to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.083411  9288 raft_consensus.cc:993] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47: : Instructing follower e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:45.083845  9358 raft_consensus.cc:1081] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Signalling peer e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:45.085354  9082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:60852
I20260709 13:00:45.085860  9082 raft_consensus.cc:493] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.086180  9082 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.091781  9082 raft_consensus.cc:515] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:45.093356  9082 leader_election.cc:290] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 2 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:45.094089  9344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:45.094394  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:45.094667  9344 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.094990  9156 raft_consensus.cc:3055] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:45.095293  9156 raft_consensus.cc:740] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:45.096230  9156 consensus_queue.cc:260] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:45.097427  9156 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.100278  9344 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 2.
I20260709 13:00:45.101385  9048 leader_election.cc:304] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:45.102041  9221 raft_consensus.cc:2804] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:45.102440  9221 raft_consensus.cc:697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:45.103102  9156 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 2.
I20260709 13:00:45.103363  9221 consensus_queue.cc:237] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:45.113641  8905 catalog_manager.cc:5697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 1 to 2, leader changed from 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195) to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:45.499251  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:00:45.601956  9156 raft_consensus.cc:1275] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.603304  9388 consensus_queue.cc:1048] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:45.615605  9344 raft_consensus.cc:1275] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.617978  9221 consensus_queue.cc:1048] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:45.623603  9345 raft_consensus.cc:1275] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.625340  9221 consensus_queue.cc:1048] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:45.629522  9156 raft_consensus.cc:1275] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.632339  9221 consensus_queue.cc:1048] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:45.663431   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:45.679809  9082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
mode: GRACEFUL
new_leader_uuid: "98544cace1ab4d84bb7940ffd240fd47"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:00:45.680362  9082 raft_consensus.cc:606] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Received request to transfer leadership to TS 98544cace1ab4d84bb7940ffd240fd47
I20260709 13:00:45.682693  9082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
mode: GRACEFUL
new_leader_uuid: "98544cace1ab4d84bb7940ffd240fd47"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:00:45.683153  9082 raft_consensus.cc:606] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Received request to transfer leadership to TS 98544cace1ab4d84bb7940ffd240fd47
I20260709 13:00:45.684144   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:45.684724   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:45.685304   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:46.028205  9221 raft_consensus.cc:993] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84: : Instructing follower 98544cace1ab4d84bb7940ffd240fd47 to start an election
I20260709 13:00:46.028702  9396 raft_consensus.cc:1081] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Signalling peer 98544cace1ab4d84bb7940ffd240fd47 to start an election
I20260709 13:00:46.030153  9156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
 from {username='slave'} at 127.0.0.1:41150
I20260709 13:00:46.030627  9156 raft_consensus.cc:493] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:46.030929  9156 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.036010  9156 raft_consensus.cc:515] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:46.037528  9156 leader_election.cc:290] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 3 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:46.038247  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:46.038530  9082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:46.038959  9345 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.039113  9082 raft_consensus.cc:3055] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:46.039505  9082 raft_consensus.cc:740] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:46.040354  9082 consensus_queue.cc:260] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:46.041730  9082 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.047036  9345 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 3.
I20260709 13:00:46.048241  9122 leader_election.cc:304] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:46.048985  9358 raft_consensus.cc:2804] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:46.048996  9082 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 3.
I20260709 13:00:46.050403  9358 raft_consensus.cc:697] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:46.051183  9358 consensus_queue.cc:237] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:46.052853  9221 raft_consensus.cc:993] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84: : Instructing follower 98544cace1ab4d84bb7940ffd240fd47 to start an election
I20260709 13:00:46.053479  9396 raft_consensus.cc:1081] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Signalling peer 98544cace1ab4d84bb7940ffd240fd47 to start an election
I20260709 13:00:46.055091  9156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
 from {username='slave'} at 127.0.0.1:41150
I20260709 13:00:46.055626  9156 raft_consensus.cc:493] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:46.056030  9156 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.059294  8905 catalog_manager.cc:5697] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 2 to 3, leader changed from e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194) to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.062233  9156 raft_consensus.cc:515] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:46.063767  9156 leader_election.cc:290] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 3 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:46.064452  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:46.064679  9082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:46.065150  9345 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.065308  9082 raft_consensus.cc:3055] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:46.065734  9082 raft_consensus.cc:740] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:46.066499  9082 consensus_queue.cc:260] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:46.067961  9082 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.073139  9345 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 3.
I20260709 13:00:46.073630  9082 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 3.
I20260709 13:00:46.074146  9122 leader_election.cc:304] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:46.074987  9358 raft_consensus.cc:2804] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:46.075412  9358 raft_consensus.cc:697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:46.076122  9358 consensus_queue.cc:237] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:46.081656  8905 catalog_manager.cc:5697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 2 to 3, leader changed from e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194) to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.447742  9082 raft_consensus.cc:1275] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Refusing update from remote peer 98544cace1ab4d84bb7940ffd240fd47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:46.449120  9358 consensus_queue.cc:1048] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:46.457175  9345 raft_consensus.cc:1275] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Refusing update from remote peer 98544cace1ab4d84bb7940ffd240fd47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:46.460026  9358 consensus_queue.cc:1048] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:46.500300  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:00:46.589720  9080 raft_consensus.cc:1275] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Refusing update from remote peer 98544cace1ab4d84bb7940ffd240fd47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:46.591156  9406 consensus_queue.cc:1048] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:46.601641  9345 raft_consensus.cc:1275] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Refusing update from remote peer 98544cace1ab4d84bb7940ffd240fd47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:46.603322  9415 consensus_queue.cc:1048] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:46.691565   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:46.698617  9156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
mode: GRACEFUL
new_leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:52306
I20260709 13:00:46.699136  9156 raft_consensus.cc:606] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Received request to transfer leadership to TS e91887cfb03c4eea9dd840fd8e745f84
I20260709 13:00:46.701617  9156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
mode: GRACEFUL
new_leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:52306
I20260709 13:00:46.702066  9156 raft_consensus.cc:606] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Received request to transfer leadership to TS e91887cfb03c4eea9dd840fd8e745f84
I20260709 13:00:46.703106   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:46.703584   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:46.704133   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:46.894981  9358 raft_consensus.cc:993] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47: : Instructing follower e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:46.895479  9415 raft_consensus.cc:1081] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Signalling peer e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:46.896904  9080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:60852
I20260709 13:00:46.897400  9080 raft_consensus.cc:493] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:46.897701  9080 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.903537  9080 raft_consensus.cc:515] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:46.905201  9080 leader_election.cc:290] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 4 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:46.906150  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:46.905979  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bdf4ef53884c4e95785fe9c99fec15" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:46.906745  9156 raft_consensus.cc:3055] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:46.906874  9345 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.907015  9156 raft_consensus.cc:740] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:46.907785  9156 consensus_queue.cc:260] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:46.908705  9156 raft_consensus.cc:3060] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.912788  9345 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 4.
I20260709 13:00:46.913205  9156 raft_consensus.cc:2468] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 4.
I20260709 13:00:46.914023  9048 leader_election.cc:304] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:46.915023  9221 raft_consensus.cc:2804] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:46.916038  9221 raft_consensus.cc:697] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:46.916775  9221 consensus_queue.cc:237] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:46.922269  8905 catalog_manager.cc:5697] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 3 to 4, leader changed from 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195) to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.134824  9358 raft_consensus.cc:993] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47: : Instructing follower e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:47.135449  9415 raft_consensus.cc:1081] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Signalling peer e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:47.137163  9080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:60852
I20260709 13:00:47.137667  9080 raft_consensus.cc:493] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.137974  9080 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.143415  9080 raft_consensus.cc:515] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:47.145216  9080 leader_election.cc:290] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 4 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:47.145805  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:47.146528  9345 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.146694  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:47.147404  9156 raft_consensus.cc:3055] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:47.147791  9156 raft_consensus.cc:740] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:47.148746  9156 consensus_queue.cc:260] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:47.150081  9156 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.154114  9345 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 4.
I20260709 13:00:47.154893  9344 raft_consensus.cc:1240] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 4 FOLLOWER]: Rejecting Update request from peer 98544cace1ab4d84bb7940ffd240fd47 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.155184  9048 leader_election.cc:304] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:47.155956  9221 raft_consensus.cc:2804] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:47.156424  9221 raft_consensus.cc:697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:47.157330  9156 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 4.
I20260709 13:00:47.157645  9221 consensus_queue.cc:237] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:47.164752  8903 catalog_manager.cc:5697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 3 to 4, leader changed from 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195) to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.362090  9156 raft_consensus.cc:1275] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 4 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:47.363250  9221 consensus_queue.cc:1048] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:47.372002  9344 raft_consensus.cc:1275] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 4 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:47.374086  9423 consensus_queue.cc:1048] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:00:47.501256  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:00:47.564697  9344 raft_consensus.cc:1275] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 4 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:47.566013  9423 consensus_queue.cc:1048] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:47.573813  9156 raft_consensus.cc:1275] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 4 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:47.575675  9416 consensus_queue.cc:1048] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:47.710933   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:47.718420  9080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
mode: GRACEFUL
new_leader_uuid: "98544cace1ab4d84bb7940ffd240fd47"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:00:47.718925  9080 raft_consensus.cc:606] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 LEADER]: Received request to transfer leadership to TS 98544cace1ab4d84bb7940ffd240fd47
I20260709 13:00:47.721143  9080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
mode: GRACEFUL
new_leader_uuid: "98544cace1ab4d84bb7940ffd240fd47"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:00:47.721563  9080 raft_consensus.cc:606] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Received request to transfer leadership to TS 98544cace1ab4d84bb7940ffd240fd47
I20260709 13:00:47.722637   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:47.723179   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:47.723793   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:47.725670  9221 raft_consensus.cc:993] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84: : Instructing follower 98544cace1ab4d84bb7940ffd240fd47 to start an election
I20260709 13:00:47.726186  9416 raft_consensus.cc:1081] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Signalling peer 98544cace1ab4d84bb7940ffd240fd47 to start an election
I20260709 13:00:47.727694  9156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
 from {username='slave'} at 127.0.0.1:41150
I20260709 13:00:47.728175  9156 raft_consensus.cc:493] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.728528  9156 raft_consensus.cc:3060] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.734396  9156 raft_consensus.cc:515] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:47.735848  9156 leader_election.cc:290] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 2 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:47.736531  9344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:47.736781  9080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:47.737233  9344 raft_consensus.cc:3060] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.737409  9080 raft_consensus.cc:3055] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.737823  9080 raft_consensus.cc:740] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:47.738547  9080 consensus_queue.cc:260] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:47.739585  9080 raft_consensus.cc:3060] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.742442  9344 raft_consensus.cc:2468] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 2.
I20260709 13:00:47.743453  9122 leader_election.cc:304] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:47.744231  9358 raft_consensus.cc:2804] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:47.744632  9358 raft_consensus.cc:697] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:47.745179  9080 raft_consensus.cc:2468] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 2.
I20260709 13:00:47.745452  9358 consensus_queue.cc:237] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:47.752606  8903 catalog_manager.cc:5697] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 1 to 2, leader changed from e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194) to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.043831  9221 raft_consensus.cc:993] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84: : Instructing follower 98544cace1ab4d84bb7940ffd240fd47 to start an election
I20260709 13:00:48.044312  9416 raft_consensus.cc:1081] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 LEADER]: Signalling peer 98544cace1ab4d84bb7940ffd240fd47 to start an election
I20260709 13:00:48.045722  9156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
 from {username='slave'} at 127.0.0.1:41150
I20260709 13:00:48.046195  9156 raft_consensus.cc:493] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.046546  9156 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.052222  9156 raft_consensus.cc:515] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:48.053799  9156 leader_election.cc:290] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 5 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091)
I20260709 13:00:48.054304  9344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:48.054689  9080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf6b4dc7c143cbb4739be5a5fe50e7" candidate_uuid: "98544cace1ab4d84bb7940ffd240fd47" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
I20260709 13:00:48.055002  9344 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.055323  9080 raft_consensus.cc:3055] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:48.055642  9080 raft_consensus.cc:740] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:48.056444  9080 consensus_queue.cc:260] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:48.057726  9080 raft_consensus.cc:3060] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.062206  9344 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 5.
I20260709 13:00:48.063477  9122 leader_election.cc:304] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, 98544cace1ab4d84bb7940ffd240fd47; no voters: 
I20260709 13:00:48.064133  9358 raft_consensus.cc:2804] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:48.064615  9358 raft_consensus.cc:697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 5 LEADER]: Becoming Leader. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:48.064986  9080 raft_consensus.cc:2468] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98544cace1ab4d84bb7940ffd240fd47 in term 5.
I20260709 13:00:48.065493  9358 consensus_queue.cc:237] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:48.071585  8903 catalog_manager.cc:5697] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 reported cstate change: term changed from 4 to 5, leader changed from e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194) to 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "98544cace1ab4d84bb7940ffd240fd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.126688  9080 raft_consensus.cc:1275] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Refusing update from remote peer 98544cace1ab4d84bb7940ffd240fd47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.127977  9358 consensus_queue.cc:1048] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.137471  9344 raft_consensus.cc:1275] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Refusing update from remote peer 98544cace1ab4d84bb7940ffd240fd47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.140025  9358 consensus_queue.cc:1048] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.501451  9345 raft_consensus.cc:1275] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 5 FOLLOWER]: Refusing update from remote peer 98544cace1ab4d84bb7940ffd240fd47: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:00:48.502265  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:00:48.502750  9358 consensus_queue.cc:1048] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:48.512864  9080 raft_consensus.cc:1275] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 5 FOLLOWER]: Refusing update from remote peer 98544cace1ab4d84bb7940ffd240fd47: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:48.514509  9436 consensus_queue.cc:1048] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:48.733044   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:48.740217  9156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ec5edc423b243d4a7dc2a17a0580e40"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
mode: GRACEFUL
new_leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:52306
I20260709 13:00:48.740803  9156 raft_consensus.cc:606] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Received request to transfer leadership to TS e91887cfb03c4eea9dd840fd8e745f84
I20260709 13:00:48.743199  9156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40"
dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
mode: GRACEFUL
new_leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:52306
I20260709 13:00:48.743714  9156 raft_consensus.cc:606] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 LEADER]: Received request to transfer leadership to TS e91887cfb03c4eea9dd840fd8e745f84
I20260709 13:00:48.744666   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:48.745139   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:48.745663   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:48.814648  9420 raft_consensus.cc:993] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47: : Instructing follower e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:48.815229  9436 raft_consensus.cc:1081] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Signalling peer e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:48.816498  9080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ec5edc423b243d4a7dc2a17a0580e40"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:60852
I20260709 13:00:48.816998  9080 raft_consensus.cc:493] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.817381  9080 raft_consensus.cc:3060] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.822691  9080 raft_consensus.cc:515] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:48.824365  9080 leader_election.cc:290] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 2 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:48.825367  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5edc423b243d4a7dc2a17a0580e40" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:48.825431  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5edc423b243d4a7dc2a17a0580e40" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:48.825997  9345 raft_consensus.cc:3060] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.826141  9156 raft_consensus.cc:3055] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.826588  9156 raft_consensus.cc:740] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:48.827425  9156 consensus_queue.cc:260] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:48.828400  9156 raft_consensus.cc:3060] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.831393  9345 raft_consensus.cc:2468] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 2.
I20260709 13:00:48.832372  9048 leader_election.cc:304] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:48.833091  9156 raft_consensus.cc:2468] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 2.
I20260709 13:00:48.833205  9221 raft_consensus.cc:2804] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.833809  9221 raft_consensus.cc:697] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:48.835328  9221 consensus_queue.cc:237] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:48.841686  8903 catalog_manager.cc:5697] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 1 to 2, leader changed from 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195) to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.989185  9420 raft_consensus.cc:993] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47: : Instructing follower e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:48.989696  9436 raft_consensus.cc:1081] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 LEADER]: Signalling peer e91887cfb03c4eea9dd840fd8e745f84 to start an election
I20260709 13:00:48.991250  9080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40"
dest_uuid: "e91887cfb03c4eea9dd840fd8e745f84"
 from {username='slave'} at 127.0.0.1:60852
I20260709 13:00:48.992022  9080 raft_consensus.cc:493] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.992467  9080 raft_consensus.cc:3060] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.998464  9080 raft_consensus.cc:515] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:49.000187  9080 leader_election.cc:290] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 3 election: Requested vote from peers 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333), 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195:39873)
I20260709 13:00:49.001114  9156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98544cace1ab4d84bb7940ffd240fd47"
I20260709 13:00:49.001327  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c7607c3c8749dbbcfef7eb72c84e40" candidate_uuid: "e91887cfb03c4eea9dd840fd8e745f84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01b224f1c8d44ba7901c399f572c68f9"
I20260709 13:00:49.001695  9156 raft_consensus.cc:3055] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.001971  9345 raft_consensus.cc:3060] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.002072  9156 raft_consensus.cc:740] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98544cace1ab4d84bb7940ffd240fd47, State: Running, Role: LEADER
I20260709 13:00:49.002907  9156 consensus_queue.cc:260] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:49.004305  9156 raft_consensus.cc:3060] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.009095  9345 raft_consensus.cc:2468] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 3.
I20260709 13:00:49.010308  9048 leader_election.cc:304] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b224f1c8d44ba7901c399f572c68f9, e91887cfb03c4eea9dd840fd8e745f84; no voters: 
I20260709 13:00:49.011991  9156 raft_consensus.cc:2468] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e91887cfb03c4eea9dd840fd8e745f84 in term 3.
I20260709 13:00:49.011185  9221 raft_consensus.cc:2804] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:49.012914  9221 raft_consensus.cc:697] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 LEADER]: Becoming Leader. State: Replica: e91887cfb03c4eea9dd840fd8e745f84, State: Running, Role: LEADER
I20260709 13:00:49.015208  9221 consensus_queue.cc:237] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } }
I20260709 13:00:49.021857  8903 catalog_manager.cc:5697] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 reported cstate change: term changed from 2 to 3, leader changed from 98544cace1ab4d84bb7940ffd240fd47 (127.0.107.195) to e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e91887cfb03c4eea9dd840fd8e745f84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e91887cfb03c4eea9dd840fd8e745f84" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.232059  9156 raft_consensus.cc:1275] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.233238  9416 consensus_queue.cc:1048] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:49.242837  9345 raft_consensus.cc:1275] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.245458  9443 consensus_queue.cc:1048] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:49.503435  8953 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:00:49.569428  9345 raft_consensus.cc:1275] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:49.570775  9221 consensus_queue.cc:1048] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b224f1c8d44ba7901c399f572c68f9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.580711  9156 raft_consensus.cc:1275] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Refusing update from remote peer e91887cfb03c4eea9dd840fd8e745f84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:49.582661  9221 consensus_queue.cc:1048] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98544cace1ab4d84bb7940ffd240fd47" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.752784   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:49.782519   431 tablet_server.cc:179] TabletServer@127.0.107.193:43333 shutting down...
I20260709 13:00:49.801775   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:49.802510   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.803125   431 raft_consensus.cc:2243] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.803586   431 raft_consensus.cc:2272] T a08e089be2c549a79ee0842418f856fa P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:49.805735  9048 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 78 similar messages]
I20260709 13:00:49.806437   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.807355   431 raft_consensus.cc:2243] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.807825   431 raft_consensus.cc:2272] T 262f2b0fe84048ecb51905469e86c16f P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:49.808694  9048 consensus_peers.cc:597] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 -> Peer 01b224f1c8d44ba7901c399f572c68f9 (127.0.107.193:43333): Couldn't send request to peer 01b224f1c8d44ba7901c399f572c68f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:49.810012   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.810710   431 raft_consensus.cc:2243] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.811132   431 raft_consensus.cc:2272] T 9910df027fcf4af3b51ef6f95b8d2108 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.813174   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.813712   431 raft_consensus.cc:2243] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.814215   431 raft_consensus.cc:2272] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 01b224f1c8d44ba7901c399f572c68f9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.816277   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.816905   431 raft_consensus.cc:2243] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.817267   431 raft_consensus.cc:2272] T 8d3c665832434c87abefd254a50e7668 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.819151   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.819665   431 raft_consensus.cc:2243] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.820060   431 raft_consensus.cc:2272] T d9c7607c3c8749dbbcfef7eb72c84e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.822742   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.823295   431 raft_consensus.cc:2243] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.823706   431 raft_consensus.cc:2272] T 7645164283334af18edfa7b7602e786a P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.825765   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.826293   431 raft_consensus.cc:2243] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.826637   431 raft_consensus.cc:2272] T 27ef21d002a741daa1c56c59fdf5db52 P 01b224f1c8d44ba7901c399f572c68f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.828297   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.828799   431 raft_consensus.cc:2243] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.829205   431 raft_consensus.cc:2272] T 79bdf4ef53884c4e95785fe9c99fec15 P 01b224f1c8d44ba7901c399f572c68f9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.830904   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:00:49.831348   431 raft_consensus.cc:2243] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.831732   431 raft_consensus.cc:2272] T 0ec5edc423b243d4a7dc2a17a0580e40 P 01b224f1c8d44ba7901c399f572c68f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.862990   431 tablet_server.cc:196] TabletServer@127.0.107.193:43333 shutdown complete.
I20260709 13:00:49.883850   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:00:49.905965   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:49.906656   431 tablet_replica.cc:333] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.907436   431 raft_consensus.cc:2243] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:49.908349   431 raft_consensus.cc:2272] T 9910df027fcf4af3b51ef6f95b8d2108 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.910601   431 tablet_replica.cc:333] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.911211   431 raft_consensus.cc:2243] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.911692   431 raft_consensus.cc:2272] T a08e089be2c549a79ee0842418f856fa P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.913900   431 tablet_replica.cc:333] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.914453   431 raft_consensus.cc:2243] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.914997   431 raft_consensus.cc:2272] T 262f2b0fe84048ecb51905469e86c16f P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.917271   431 tablet_replica.cc:333] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.917917   431 raft_consensus.cc:2243] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:49.918677   431 raft_consensus.cc:2272] T 79bdf4ef53884c4e95785fe9c99fec15 P e91887cfb03c4eea9dd840fd8e745f84 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.920469   431 tablet_replica.cc:333] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.921052   431 raft_consensus.cc:2243] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:49.921806   431 raft_consensus.cc:2272] T 0ec5edc423b243d4a7dc2a17a0580e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.924301   431 tablet_replica.cc:333] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.924908   431 raft_consensus.cc:2243] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:49.925715   431 raft_consensus.cc:2272] T 7645164283334af18edfa7b7602e786a P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.927717   431 tablet_replica.cc:333] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.928202   431 raft_consensus.cc:2243] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:49.929039   431 raft_consensus.cc:2272] T 27ef21d002a741daa1c56c59fdf5db52 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.931135   431 tablet_replica.cc:333] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.931622   431 raft_consensus.cc:2243] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:49.932358   431 raft_consensus.cc:2272] T d9c7607c3c8749dbbcfef7eb72c84e40 P e91887cfb03c4eea9dd840fd8e745f84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.935554   431 tablet_replica.cc:333] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.936034   431 raft_consensus.cc:2243] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.936463   431 raft_consensus.cc:2272] T 8d3c665832434c87abefd254a50e7668 P e91887cfb03c4eea9dd840fd8e745f84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:49.938375   431 tablet_replica.cc:333] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84: stopping tablet replica
I20260709 13:00:49.938876   431 raft_consensus.cc:2243] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:49.939263   431 raft_consensus.cc:2272] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P e91887cfb03c4eea9dd840fd8e745f84 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:49.965884  9122 consensus_peers.cc:597] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 -> Peer e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091): Couldn't send request to peer e91887cfb03c4eea9dd840fd8e745f84. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:49.970449   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:00:49.994517   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:00:50.002481  9122 consensus_peers.cc:597] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 -> Peer e91887cfb03c4eea9dd840fd8e745f84 (127.0.107.194:36091): Couldn't send request to peer e91887cfb03c4eea9dd840fd8e745f84. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:50.023535   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:50.024433   431 tablet_replica.cc:333] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.025189   431 raft_consensus.cc:2243] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.025651   431 raft_consensus.cc:2272] T 9910df027fcf4af3b51ef6f95b8d2108 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.027736   431 tablet_replica.cc:333] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.028337   431 raft_consensus.cc:2243] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:00:50.029187   431 raft_consensus.cc:2272] T 55cf6b4dc7c143cbb4739be5a5fe50e7 P 98544cace1ab4d84bb7940ffd240fd47 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.031280   431 tablet_replica.cc:333] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.032048   431 raft_consensus.cc:2243] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:50.033093   431 raft_consensus.cc:2272] T 8d3c665832434c87abefd254a50e7668 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.035019   431 tablet_replica.cc:333] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.035523   431 raft_consensus.cc:2243] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:50.036285   431 raft_consensus.cc:2272] T 262f2b0fe84048ecb51905469e86c16f P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.038328   431 tablet_replica.cc:333] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.038822   431 raft_consensus.cc:2243] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.039219   431 raft_consensus.cc:2272] T 7645164283334af18edfa7b7602e786a P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.041109   431 tablet_replica.cc:333] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.041559   431 raft_consensus.cc:2243] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.041916   431 raft_consensus.cc:2272] T 27ef21d002a741daa1c56c59fdf5db52 P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.043743   431 tablet_replica.cc:333] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.044206   431 raft_consensus.cc:2243] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.044574   431 raft_consensus.cc:2272] T d9c7607c3c8749dbbcfef7eb72c84e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.047147   431 tablet_replica.cc:333] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.047631   431 raft_consensus.cc:2243] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:50.048409   431 raft_consensus.cc:2272] T a08e089be2c549a79ee0842418f856fa P 98544cace1ab4d84bb7940ffd240fd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.050503   431 tablet_replica.cc:333] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.050963   431 raft_consensus.cc:2243] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.051321   431 raft_consensus.cc:2272] T 79bdf4ef53884c4e95785fe9c99fec15 P 98544cace1ab4d84bb7940ffd240fd47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.053290   431 tablet_replica.cc:333] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47: stopping tablet replica
I20260709 13:00:50.053758   431 raft_consensus.cc:2243] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.054095   431 raft_consensus.cc:2272] T 0ec5edc423b243d4a7dc2a17a0580e40 P 98544cace1ab4d84bb7940ffd240fd47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.086850   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:00:50.110236   431 master.cc:562] Master@127.0.107.254:37477 shutting down...
I20260709 13:00:50.134343   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:50.134922   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.135270   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 46f149a686664b66b4b234b6fa74ade1: stopping tablet replica
I20260709 13:00:50.155658   431 master.cc:584] Master@127.0.107.254:37477 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12841 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:00:50.198350   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34787
I20260709 13:00:50.199451   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:50.204885  9456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.204967  9457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.206622  9459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:50.207330   431 server_base.cc:1061] running on GCE node
I20260709 13:00:50.208187   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:50.208415   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:50.208564   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602050208545 us; error 0 us; skew 500 ppm
I20260709 13:00:50.209132   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:50.211417   431 webserver.cc:533] Webserver started at http://127.0.107.254:36397/ using document root <none> and password file <none>
I20260709 13:00:50.211911   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:50.212147   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:50.212425   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:50.213572   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/master-0-root/instance:
uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-73vh"
I20260709 13:00:50.218037   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:50.221217  9464 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.222002   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:50.222287   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/master-0-root
uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-73vh"
I20260709 13:00:50.222577   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:50.239066   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:50.240296   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:50.277688   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34787
I20260709 13:00:50.277802  9515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34787 every 8 connection(s)
I20260709 13:00:50.281543  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:50.292840  9516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3: Bootstrap starting.
I20260709 13:00:50.297459  9516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.301360  9516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3: No bootstrap required, opened a new log
I20260709 13:00:50.303349  9516 raft_consensus.cc:359] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3" member_type: VOTER }
I20260709 13:00:50.303751  9516 raft_consensus.cc:385] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.303931  9516 raft_consensus.cc:740] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e7982d0cb04a7cadcbd2f6c90c1ff3, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.304391  9516 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3" member_type: VOTER }
I20260709 13:00:50.304813  9516 raft_consensus.cc:399] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:50.304999  9516 raft_consensus.cc:493] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:50.305198  9516 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.309772  9516 raft_consensus.cc:515] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3" member_type: VOTER }
I20260709 13:00:50.310241  9516 leader_election.cc:304] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6e7982d0cb04a7cadcbd2f6c90c1ff3; no voters: 
I20260709 13:00:50.311287  9516 leader_election.cc:290] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:50.311618  9519 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:50.313004  9519 raft_consensus.cc:697] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 1 LEADER]: Becoming Leader. State: Replica: d6e7982d0cb04a7cadcbd2f6c90c1ff3, State: Running, Role: LEADER
I20260709 13:00:50.313661  9519 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3" member_type: VOTER }
I20260709 13:00:50.314357  9516 sys_catalog.cc:565] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:50.318555  9520 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3" member_type: VOTER } }
I20260709 13:00:50.318819  9521 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6e7982d0cb04a7cadcbd2f6c90c1ff3. Latest consensus state: current_term: 1 leader_uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7982d0cb04a7cadcbd2f6c90c1ff3" member_type: VOTER } }
I20260709 13:00:50.319420  9520 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:50.319692  9521 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:50.322903  9526 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:50.331039  9526 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:50.333436   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:50.339973  9526 catalog_manager.cc:1383] Generated new cluster ID: 5ee2b192b1f745509692aea3dd6ecd73
I20260709 13:00:50.340256  9526 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:50.357550  9526 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:50.358832  9526 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:50.372413  9526 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3: Generated new TSK 0
I20260709 13:00:50.373045  9526 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:50.399616   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:50.405534  9537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.406876  9538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.408363  9540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:50.408586   431 server_base.cc:1061] running on GCE node
I20260709 13:00:50.409683   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:50.409901   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:50.410080   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602050410062 us; error 0 us; skew 500 ppm
I20260709 13:00:50.410630   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:50.412995   431 webserver.cc:533] Webserver started at http://127.0.107.193:33619/ using document root <none> and password file <none>
I20260709 13:00:50.413499   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:50.413803   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:50.414149   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:50.415393   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-0-root/instance:
uuid: "d31707bf87914b6685047c7646b69dea"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-73vh"
I20260709 13:00:50.420521   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:00:50.424266  9545 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.425348   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:00:50.425664   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "d31707bf87914b6685047c7646b69dea"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-73vh"
I20260709 13:00:50.426185   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:50.444988   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:50.446208   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:50.447625   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:50.449934   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:50.450136   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.450400   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:50.450562   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.490897   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:36685
I20260709 13:00:50.491006  9607 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:36685 every 8 connection(s)
I20260709 13:00:50.495963   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:50.503648  9612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.504863  9613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.508302  9615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:50.509217   431 server_base.cc:1061] running on GCE node
I20260709 13:00:50.509938  9608 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34787
I20260709 13:00:50.510290  9608 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:50.510593   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:50.510879   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:50.510950  9608 heartbeater.cc:507] Master 127.0.107.254:34787 requested a full tablet report, sending...
I20260709 13:00:50.511073   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602050511057 us; error 0 us; skew 500 ppm
I20260709 13:00:50.511826   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:50.513331  9481 ts_manager.cc:194] Registered new tserver with Master: d31707bf87914b6685047c7646b69dea (127.0.107.193:36685)
I20260709 13:00:50.515027   431 webserver.cc:533] Webserver started at http://127.0.107.194:37101/ using document root <none> and password file <none>
I20260709 13:00:50.515466  9481 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44736
I20260709 13:00:50.515790   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:50.516199   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:50.516548   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:50.517858   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-1-root/instance:
uuid: "f171b29f88104a939dec2bf6e2edcff4"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-73vh"
I20260709 13:00:50.522841   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:50.526482  9620 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.527416   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:50.527696   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-1-root
uuid: "f171b29f88104a939dec2bf6e2edcff4"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-73vh"
I20260709 13:00:50.527957   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:50.544108   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:50.545341   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:50.546759   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:50.548959   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:50.549157   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.549409   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:50.549566   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.589089   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37737
I20260709 13:00:50.589246  9682 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37737 every 8 connection(s)
I20260709 13:00:50.593943   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:50.601480  9686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.603346  9687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.604398  9689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:50.604856   431 server_base.cc:1061] running on GCE node
I20260709 13:00:50.605981   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:50.606236   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:50.606418   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602050606395 us; error 0 us; skew 500 ppm
I20260709 13:00:50.606854  9683 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34787
I20260709 13:00:50.607019   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:50.607252  9683 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:50.608114  9683 heartbeater.cc:507] Master 127.0.107.254:34787 requested a full tablet report, sending...
I20260709 13:00:50.609916   431 webserver.cc:533] Webserver started at http://127.0.107.195:46721/ using document root <none> and password file <none>
I20260709 13:00:50.610396  9481 ts_manager.cc:194] Registered new tserver with Master: f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194:37737)
I20260709 13:00:50.610585   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:50.610895   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:50.611202   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:50.612286  9481 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44742
I20260709 13:00:50.612797   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-2-root/instance:
uuid: "df444b9b90e24accb747354452e8c1b7"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-73vh"
I20260709 13:00:50.617460   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:50.620738  9694 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.621488   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:50.621788   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-2-root
uuid: "df444b9b90e24accb747354452e8c1b7"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-73vh"
I20260709 13:00:50.622084   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601766316156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:50.644572   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:50.645898   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:50.647382   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:50.649605   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:50.649843   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.650074   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:50.650250   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.691493   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39041
I20260709 13:00:50.691735  9756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39041 every 8 connection(s)
I20260709 13:00:50.706215  9757 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34787
I20260709 13:00:50.706547  9757 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:50.707207  9757 heartbeater.cc:507] Master 127.0.107.254:34787 requested a full tablet report, sending...
I20260709 13:00:50.709355  9481 ts_manager.cc:194] Registered new tserver with Master: df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:50.709981   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014935853s
I20260709 13:00:50.711117  9481 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44750
I20260709 13:00:50.736203  9481 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44754:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:50.738365  9481 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:50.785880  9573 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3d801fc8e140ee9064d50dd2fbd897 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f366e1c409a43fd92adf2f2862d95bc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:00:50.787390  9573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3d801fc8e140ee9064d50dd2fbd897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:50.790758  9572 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8f8219a84f433d9d278eb5d996e3e1 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f366e1c409a43fd92adf2f2862d95bc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:00:50.792152  9572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8f8219a84f433d9d278eb5d996e3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:50.796463  9722 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3d801fc8e140ee9064d50dd2fbd897 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f366e1c409a43fd92adf2f2862d95bc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:00:50.796911  9721 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8f8219a84f433d9d278eb5d996e3e1 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f366e1c409a43fd92adf2f2862d95bc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:00:50.797938  9722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3d801fc8e140ee9064d50dd2fbd897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:50.798573  9721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8f8219a84f433d9d278eb5d996e3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:50.817590  9772 tablet_bootstrap.cc:492] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea: Bootstrap starting.
I20260709 13:00:50.818363  9773 tablet_bootstrap.cc:492] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7: Bootstrap starting.
I20260709 13:00:50.819422  9648 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3d801fc8e140ee9064d50dd2fbd897 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f366e1c409a43fd92adf2f2862d95bc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:00:50.819730  9647 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8f8219a84f433d9d278eb5d996e3e1 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f366e1c409a43fd92adf2f2862d95bc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:00:50.820910  9648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3d801fc8e140ee9064d50dd2fbd897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:50.821507  9647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8f8219a84f433d9d278eb5d996e3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:50.828327  9772 tablet_bootstrap.cc:654] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.837339  9773 tablet_bootstrap.cc:654] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.842775  9772 tablet_bootstrap.cc:492] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea: No bootstrap required, opened a new log
I20260709 13:00:50.843489  9772 ts_tablet_manager.cc:1403] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.000s
I20260709 13:00:50.845542  9775 tablet_bootstrap.cc:492] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4: Bootstrap starting.
I20260709 13:00:50.847034  9772 raft_consensus.cc:359] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:50.847856  9772 raft_consensus.cc:385] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.848160  9772 raft_consensus.cc:740] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31707bf87914b6685047c7646b69dea, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.848663  9773 tablet_bootstrap.cc:492] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7: No bootstrap required, opened a new log
I20260709 13:00:50.849179  9773 ts_tablet_manager.cc:1403] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.004s
I20260709 13:00:50.848948  9772 consensus_queue.cc:260] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:50.851382  9608 heartbeater.cc:499] Master 127.0.107.254:34787 was elected leader, sending a full tablet report...
I20260709 13:00:50.851963  9772 ts_tablet_manager.cc:1434] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:50.852447  9773 raft_consensus.cc:359] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:50.853209  9773 raft_consensus.cc:385] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.853544  9773 raft_consensus.cc:740] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df444b9b90e24accb747354452e8c1b7, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.854168  9772 tablet_bootstrap.cc:492] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea: Bootstrap starting.
I20260709 13:00:50.855305  9775 tablet_bootstrap.cc:654] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.854498  9773 consensus_queue.cc:260] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:50.861837  9772 tablet_bootstrap.cc:654] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.876387  9757 heartbeater.cc:499] Master 127.0.107.254:34787 was elected leader, sending a full tablet report...
I20260709 13:00:50.877087  9773 ts_tablet_manager.cc:1434] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.013s
I20260709 13:00:50.878086  9773 tablet_bootstrap.cc:492] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7: Bootstrap starting.
I20260709 13:00:50.878813  9772 tablet_bootstrap.cc:492] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea: No bootstrap required, opened a new log
I20260709 13:00:50.879408  9772 ts_tablet_manager.cc:1403] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.005s
I20260709 13:00:50.882309  9775 tablet_bootstrap.cc:492] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4: No bootstrap required, opened a new log
I20260709 13:00:50.882149  9772 raft_consensus.cc:359] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:50.882921  9775 ts_tablet_manager.cc:1403] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.018s
I20260709 13:00:50.882949  9772 raft_consensus.cc:385] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.883559  9772 raft_consensus.cc:740] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31707bf87914b6685047c7646b69dea, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.884752  9773 tablet_bootstrap.cc:654] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.884512  9772 consensus_queue.cc:260] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:50.886803  9772 ts_tablet_manager.cc:1434] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:00:50.888411  9775 raft_consensus.cc:359] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:50.889400  9775 raft_consensus.cc:385] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.889840  9775 raft_consensus.cc:740] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.891062  9775 consensus_queue.cc:260] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:50.894922  9773 tablet_bootstrap.cc:492] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7: No bootstrap required, opened a new log
I20260709 13:00:50.895486  9773 ts_tablet_manager.cc:1403] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:00:50.898334  9683 heartbeater.cc:499] Master 127.0.107.254:34787 was elected leader, sending a full tablet report...
I20260709 13:00:50.898667  9773 raft_consensus.cc:359] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:50.899344  9773 raft_consensus.cc:385] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.899569  9775 ts_tablet_manager.cc:1434] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.006s
I20260709 13:00:50.899590  9773 raft_consensus.cc:740] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df444b9b90e24accb747354452e8c1b7, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.900818  9775 tablet_bootstrap.cc:492] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4: Bootstrap starting.
I20260709 13:00:50.901005  9773 consensus_queue.cc:260] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:50.903357  9773 ts_tablet_manager.cc:1434] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:50.907927  9775 tablet_bootstrap.cc:654] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.913453  9775 tablet_bootstrap.cc:492] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4: No bootstrap required, opened a new log
I20260709 13:00:50.913893  9775 ts_tablet_manager.cc:1403] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:00:50.916272  9775 raft_consensus.cc:359] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:50.916821  9775 raft_consensus.cc:385] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.917104  9775 raft_consensus.cc:740] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.917716  9775 consensus_queue.cc:260] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:50.919553  9775 ts_tablet_manager.cc:1434] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:50.947321  9778 raft_consensus.cc:493] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.947799  9778 raft_consensus.cc:515] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:50.949765  9778 leader_election.cc:290] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194:37737)
I20260709 13:00:50.960165  9583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3d801fc8e140ee9064d50dd2fbd897" candidate_uuid: "df444b9b90e24accb747354452e8c1b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31707bf87914b6685047c7646b69dea" is_pre_election: true
I20260709 13:00:50.960620  9658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3d801fc8e140ee9064d50dd2fbd897" candidate_uuid: "df444b9b90e24accb747354452e8c1b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f171b29f88104a939dec2bf6e2edcff4" is_pre_election: true
I20260709 13:00:50.960912  9583 raft_consensus.cc:2468] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df444b9b90e24accb747354452e8c1b7 in term 0.
I20260709 13:00:50.961299  9658 raft_consensus.cc:2468] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df444b9b90e24accb747354452e8c1b7 in term 0.
I20260709 13:00:50.962224  9696 leader_election.cc:304] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31707bf87914b6685047c7646b69dea, df444b9b90e24accb747354452e8c1b7; no voters: 
I20260709 13:00:50.962919  9778 raft_consensus.cc:2804] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:50.963235  9778 raft_consensus.cc:493] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.963497  9778 raft_consensus.cc:3060] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.968779  9778 raft_consensus.cc:515] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:50.970330  9778 leader_election.cc:290] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [CANDIDATE]: Term 1 election: Requested vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194:37737)
I20260709 13:00:50.971031  9583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3d801fc8e140ee9064d50dd2fbd897" candidate_uuid: "df444b9b90e24accb747354452e8c1b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31707bf87914b6685047c7646b69dea"
I20260709 13:00:50.971292  9658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3d801fc8e140ee9064d50dd2fbd897" candidate_uuid: "df444b9b90e24accb747354452e8c1b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f171b29f88104a939dec2bf6e2edcff4"
I20260709 13:00:50.971666  9583 raft_consensus.cc:3060] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.971854  9658 raft_consensus.cc:3060] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.979231  9658 raft_consensus.cc:2468] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df444b9b90e24accb747354452e8c1b7 in term 1.
I20260709 13:00:50.979231  9583 raft_consensus.cc:2468] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df444b9b90e24accb747354452e8c1b7 in term 1.
I20260709 13:00:50.980525  9695 leader_election.cc:304] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df444b9b90e24accb747354452e8c1b7, f171b29f88104a939dec2bf6e2edcff4; no voters: 
I20260709 13:00:50.981223  9778 raft_consensus.cc:2804] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:50.982277  9778 raft_consensus.cc:697] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 1 LEADER]: Becoming Leader. State: Replica: df444b9b90e24accb747354452e8c1b7, State: Running, Role: LEADER
I20260709 13:00:50.983019  9778 consensus_queue.cc:237] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:50.984171  9782 raft_consensus.cc:493] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.984717  9782 raft_consensus.cc:515] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:50.987577  9782 leader_election.cc:290] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:50.993417  9480 catalog_manager.cc:5697] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to df444b9b90e24accb747354452e8c1b7 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "df444b9b90e24accb747354452e8c1b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.999708  9583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8f8219a84f433d9d278eb5d996e3e1" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31707bf87914b6685047c7646b69dea" is_pre_election: true
I20260709 13:00:51.000470  9583 raft_consensus.cc:2468] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 0.
I20260709 13:00:51.000928  9732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8f8219a84f433d9d278eb5d996e3e1" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df444b9b90e24accb747354452e8c1b7" is_pre_election: true
I20260709 13:00:51.001682  9732 raft_consensus.cc:2468] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 0.
I20260709 13:00:51.001655  9622 leader_election.cc:304] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31707bf87914b6685047c7646b69dea, f171b29f88104a939dec2bf6e2edcff4; no voters: 
I20260709 13:00:51.003155  9782 raft_consensus.cc:2804] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:51.003557  9782 raft_consensus.cc:493] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.003875  9782 raft_consensus.cc:3060] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.009240  9782 raft_consensus.cc:515] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.010887  9782 leader_election.cc:290] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 election: Requested vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:51.011577  9583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8f8219a84f433d9d278eb5d996e3e1" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31707bf87914b6685047c7646b69dea"
I20260709 13:00:51.012009  9732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8f8219a84f433d9d278eb5d996e3e1" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df444b9b90e24accb747354452e8c1b7"
I20260709 13:00:51.012111  9583 raft_consensus.cc:3060] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.012558  9732 raft_consensus.cc:3060] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.017810  9583 raft_consensus.cc:2468] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 1.
I20260709 13:00:51.018061  9732 raft_consensus.cc:2468] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 1.
I20260709 13:00:51.018896  9622 leader_election.cc:304] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31707bf87914b6685047c7646b69dea, f171b29f88104a939dec2bf6e2edcff4; no voters: 
I20260709 13:00:51.019761  9782 raft_consensus.cc:2804] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:51.020589  9782 raft_consensus.cc:697] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Becoming Leader. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Running, Role: LEADER
I20260709 13:00:51.021443  9782 consensus_queue.cc:237] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.028550  9480 catalog_manager.cc:5697] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f171b29f88104a939dec2bf6e2edcff4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.062681  9480 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44768:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:51.064692  9480 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:51.087291  9573 tablet_service.cc:1511] Processing CreateTablet for tablet db138d04b70f41729d0403bcda6325d0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=73ac060dd0b648ef9ac5bde69a86c097]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:00:51.088678  9573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db138d04b70f41729d0403bcda6325d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.088353  9648 tablet_service.cc:1511] Processing CreateTablet for tablet db138d04b70f41729d0403bcda6325d0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=73ac060dd0b648ef9ac5bde69a86c097]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:00:51.089723  9648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db138d04b70f41729d0403bcda6325d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.090461  9722 tablet_service.cc:1511] Processing CreateTablet for tablet db138d04b70f41729d0403bcda6325d0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=73ac060dd0b648ef9ac5bde69a86c097]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:00:51.091668  9722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db138d04b70f41729d0403bcda6325d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.092770  9572 tablet_service.cc:1511] Processing CreateTablet for tablet 311c491e5a24472fa19f9e9ace87486b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=73ac060dd0b648ef9ac5bde69a86c097]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:00:51.093997  9572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311c491e5a24472fa19f9e9ace87486b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.095026  9647 tablet_service.cc:1511] Processing CreateTablet for tablet 311c491e5a24472fa19f9e9ace87486b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=73ac060dd0b648ef9ac5bde69a86c097]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:00:51.096218  9647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311c491e5a24472fa19f9e9ace87486b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.108587  9775 tablet_bootstrap.cc:492] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: Bootstrap starting.
I20260709 13:00:51.110797  9773 tablet_bootstrap.cc:492] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7: Bootstrap starting.
I20260709 13:00:51.110958  9721 tablet_service.cc:1511] Processing CreateTablet for tablet 311c491e5a24472fa19f9e9ace87486b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=73ac060dd0b648ef9ac5bde69a86c097]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:00:51.112329  9721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311c491e5a24472fa19f9e9ace87486b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.116119  9775 tablet_bootstrap.cc:654] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.119923  9773 tablet_bootstrap.cc:654] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.130808  9775 tablet_bootstrap.cc:492] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: No bootstrap required, opened a new log
I20260709 13:00:51.131376  9775 ts_tablet_manager.cc:1403] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:00:51.134446  9775 raft_consensus.cc:359] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.135290  9775 raft_consensus.cc:385] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.135627  9775 raft_consensus.cc:740] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.136478  9775 consensus_queue.cc:260] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.139299  9772 tablet_bootstrap.cc:492] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea: Bootstrap starting.
I20260709 13:00:51.140367  9775 ts_tablet_manager.cc:1434] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:00:51.141433  9775 tablet_bootstrap.cc:492] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4: Bootstrap starting.
I20260709 13:00:51.144158  9773 tablet_bootstrap.cc:492] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7: No bootstrap required, opened a new log
I20260709 13:00:51.144754  9773 ts_tablet_manager.cc:1403] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.007s
I20260709 13:00:51.148113  9772 tablet_bootstrap.cc:654] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.147821  9773 raft_consensus.cc:359] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.148702  9773 raft_consensus.cc:385] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.149026  9773 raft_consensus.cc:740] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df444b9b90e24accb747354452e8c1b7, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.149652  9775 tablet_bootstrap.cc:654] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.149899  9773 consensus_queue.cc:260] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.152522  9773 ts_tablet_manager.cc:1434] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:51.153839  9773 tablet_bootstrap.cc:492] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7: Bootstrap starting.
I20260709 13:00:51.161545  9773 tablet_bootstrap.cc:654] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.162288  9775 tablet_bootstrap.cc:492] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4: No bootstrap required, opened a new log
I20260709 13:00:51.162878  9775 ts_tablet_manager.cc:1403] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.008s
I20260709 13:00:51.166435  9775 raft_consensus.cc:359] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.167371  9775 raft_consensus.cc:385] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.167739  9775 raft_consensus.cc:740] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.168959  9775 consensus_queue.cc:260] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.173022  9782 raft_consensus.cc:493] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.173130  9773 tablet_bootstrap.cc:492] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7: No bootstrap required, opened a new log
I20260709 13:00:51.173725  9773 ts_tablet_manager.cc:1403] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 13:00:51.173542  9782 raft_consensus.cc:515] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.176879  9732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df444b9b90e24accb747354452e8c1b7" is_pre_election: true
I20260709 13:00:51.176991  9773 raft_consensus.cc:359] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.177538  9732 raft_consensus.cc:2468] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 0.
I20260709 13:00:51.177709  9773 raft_consensus.cc:385] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.178056  9773 raft_consensus.cc:740] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df444b9b90e24accb747354452e8c1b7, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.178817  9782 leader_election.cc:290] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:51.178929  9773 consensus_queue.cc:260] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.179338  9624 leader_election.cc:304] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df444b9b90e24accb747354452e8c1b7, f171b29f88104a939dec2bf6e2edcff4; no voters: 
I20260709 13:00:51.178941  9583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31707bf87914b6685047c7646b69dea" is_pre_election: true
I20260709 13:00:51.181035  9775 ts_tablet_manager.cc:1434] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.002s
W20260709 13:00:51.181567  9622 leader_election.cc:343] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d31707bf87914b6685047c7646b69dea (127.0.107.193:36685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:51.182751  9782 raft_consensus.cc:2804] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:51.183178  9782 raft_consensus.cc:493] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.183543  9782 raft_consensus.cc:3060] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.183673  9773 ts_tablet_manager.cc:1434] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:51.183887  9772 tablet_bootstrap.cc:492] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea: No bootstrap required, opened a new log
I20260709 13:00:51.184523  9772 ts_tablet_manager.cc:1403] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.026s
I20260709 13:00:51.187674  9772 raft_consensus.cc:359] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.188385  9772 raft_consensus.cc:385] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.188715  9772 raft_consensus.cc:740] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31707bf87914b6685047c7646b69dea, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.189607  9772 consensus_queue.cc:260] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.191414  9788 raft_consensus.cc:493] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.191823  9772 ts_tablet_manager.cc:1434] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:00:51.191924  9788 raft_consensus.cc:515] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.192128  9782 raft_consensus.cc:515] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.193385  9772 tablet_bootstrap.cc:492] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea: Bootstrap starting.
I20260709 13:00:51.194191  9788 leader_election.cc:290] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:51.194708  9583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31707bf87914b6685047c7646b69dea"
I20260709 13:00:51.195158  9582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311c491e5a24472fa19f9e9ace87486b" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31707bf87914b6685047c7646b69dea" is_pre_election: true
W20260709 13:00:51.196593  9622 leader_election.cc:343] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d31707bf87914b6685047c7646b69dea (127.0.107.193:36685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:51.195322  9583 raft_consensus.cc:3060] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.196849  9732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311c491e5a24472fa19f9e9ace87486b" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df444b9b90e24accb747354452e8c1b7" is_pre_election: true
I20260709 13:00:51.199784  9732 raft_consensus.cc:2468] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 0.
I20260709 13:00:51.200484  9772 tablet_bootstrap.cc:654] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.200932  9624 leader_election.cc:304] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df444b9b90e24accb747354452e8c1b7, f171b29f88104a939dec2bf6e2edcff4; no voters: d31707bf87914b6685047c7646b69dea
I20260709 13:00:51.202049  9788 raft_consensus.cc:2804] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:51.202400  9788 raft_consensus.cc:493] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.202708  9788 raft_consensus.cc:3060] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.206755  9583 raft_consensus.cc:2468] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 1.
I20260709 13:00:51.207799  9782 leader_election.cc:290] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 election: Requested vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:51.208952  9622 leader_election.cc:304] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31707bf87914b6685047c7646b69dea, f171b29f88104a939dec2bf6e2edcff4; no voters: 
I20260709 13:00:51.209148  9732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df444b9b90e24accb747354452e8c1b7"
I20260709 13:00:51.209931  9732 raft_consensus.cc:3060] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.209908  9782 raft_consensus.cc:2804] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:51.210891  9772 tablet_bootstrap.cc:492] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea: No bootstrap required, opened a new log
I20260709 13:00:51.211411  9772 ts_tablet_manager.cc:1403] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 13:00:51.213726  9788 raft_consensus.cc:515] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.214462  9772 raft_consensus.cc:359] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.215193  9772 raft_consensus.cc:385] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.215555  9772 raft_consensus.cc:740] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31707bf87914b6685047c7646b69dea, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.216568  9583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311c491e5a24472fa19f9e9ace87486b" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31707bf87914b6685047c7646b69dea"
I20260709 13:00:51.216336  9772 consensus_queue.cc:260] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.217338  9583 raft_consensus.cc:3060] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.218648  9772 ts_tablet_manager.cc:1434] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:51.220904  9788 leader_election.cc:290] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 election: Requested vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:51.221333  9732 raft_consensus.cc:2468] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 1.
I20260709 13:00:51.222208  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311c491e5a24472fa19f9e9ace87486b" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df444b9b90e24accb747354452e8c1b7"
I20260709 13:00:51.222985  9731 raft_consensus.cc:3060] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.223402  9782 raft_consensus.cc:697] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Becoming Leader. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Running, Role: LEADER
I20260709 13:00:51.224360  9583 raft_consensus.cc:2468] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 1.
I20260709 13:00:51.224359  9782 consensus_queue.cc:237] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.227121  9622 leader_election.cc:304] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31707bf87914b6685047c7646b69dea, f171b29f88104a939dec2bf6e2edcff4; no voters: 
I20260709 13:00:51.228061  9801 raft_consensus.cc:2804] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:51.228505  9801 raft_consensus.cc:697] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Becoming Leader. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Running, Role: LEADER
I20260709 13:00:51.229435  9801 consensus_queue.cc:237] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.231699  9731 raft_consensus.cc:2468] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 1.
I20260709 13:00:51.243419  9480 catalog_manager.cc:5697] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f171b29f88104a939dec2bf6e2edcff4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.255004  9480 catalog_manager.cc:5697] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f171b29f88104a939dec2bf6e2edcff4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.305048  9731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e3d801fc8e140ee9064d50dd2fbd897"
dest_uuid: "df444b9b90e24accb747354452e8c1b7"
mode: GRACEFUL
new_leader_uuid: "d31707bf87914b6685047c7646b69dea"
 from {username='slave'} at 127.0.0.1:53724
I20260709 13:00:51.305603  9731 raft_consensus.cc:606] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 1 LEADER]: Received request to transfer leadership to TS d31707bf87914b6685047c7646b69dea
I20260709 13:00:51.317894  9658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c8f8219a84f433d9d278eb5d996e3e1"
dest_uuid: "f171b29f88104a939dec2bf6e2edcff4"
mode: GRACEFUL
new_leader_uuid: "df444b9b90e24accb747354452e8c1b7"
 from {username='slave'} at 127.0.0.1:45984
I20260709 13:00:51.318478  9658 raft_consensus.cc:606] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Received request to transfer leadership to TS df444b9b90e24accb747354452e8c1b7
I20260709 13:00:51.324267  9658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0"
dest_uuid: "f171b29f88104a939dec2bf6e2edcff4"
mode: GRACEFUL
new_leader_uuid: "d31707bf87914b6685047c7646b69dea"
 from {username='slave'} at 127.0.0.1:45984
I20260709 13:00:51.324846  9658 raft_consensus.cc:606] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Received request to transfer leadership to TS d31707bf87914b6685047c7646b69dea
I20260709 13:00:51.330312  9658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "311c491e5a24472fa19f9e9ace87486b"
dest_uuid: "f171b29f88104a939dec2bf6e2edcff4"
mode: GRACEFUL
new_leader_uuid: "d31707bf87914b6685047c7646b69dea"
 from {username='slave'} at 127.0.0.1:45984
I20260709 13:00:51.330904  9658 raft_consensus.cc:606] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Received request to transfer leadership to TS d31707bf87914b6685047c7646b69dea
I20260709 13:00:51.399981  9778 consensus_queue.cc:1048] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:51.413089  9778 consensus_queue.cc:1048] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:51.428268  9778 raft_consensus.cc:993] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7: : Instructing follower d31707bf87914b6685047c7646b69dea to start an election
I20260709 13:00:51.428757  9778 raft_consensus.cc:1081] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 1 LEADER]: Signalling peer d31707bf87914b6685047c7646b69dea to start an election
I20260709 13:00:51.430553  9583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e3d801fc8e140ee9064d50dd2fbd897"
dest_uuid: "d31707bf87914b6685047c7646b69dea"
 from {username='slave'} at 127.0.0.1:53182
I20260709 13:00:51.431125  9583 raft_consensus.cc:493] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.431483  9583 raft_consensus.cc:3060] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.438238  9583 raft_consensus.cc:515] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:51.440681  9583 leader_election.cc:290] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [CANDIDATE]: Term 2 election: Requested vote from peers df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041), f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194:37737)
I20260709 13:00:51.452605  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3d801fc8e140ee9064d50dd2fbd897" candidate_uuid: "d31707bf87914b6685047c7646b69dea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df444b9b90e24accb747354452e8c1b7"
I20260709 13:00:51.453260  9731 raft_consensus.cc:3055] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.453610  9731 raft_consensus.cc:740] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df444b9b90e24accb747354452e8c1b7, State: Running, Role: LEADER
I20260709 13:00:51.454308  9731 consensus_queue.cc:260] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:51.455443  9731 raft_consensus.cc:3060] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.457989  9658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3d801fc8e140ee9064d50dd2fbd897" candidate_uuid: "d31707bf87914b6685047c7646b69dea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f171b29f88104a939dec2bf6e2edcff4"
I20260709 13:00:51.458657  9658 raft_consensus.cc:3060] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.462850  9731 raft_consensus.cc:2468] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31707bf87914b6685047c7646b69dea in term 2.
I20260709 13:00:51.464140  9549 leader_election.cc:304] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31707bf87914b6685047c7646b69dea, df444b9b90e24accb747354452e8c1b7; no voters: 
I20260709 13:00:51.464973  9777 raft_consensus.cc:2804] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:51.465859  9658 raft_consensus.cc:2468] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31707bf87914b6685047c7646b69dea in term 2.
I20260709 13:00:51.466094  9777 raft_consensus.cc:697] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 2 LEADER]: Becoming Leader. State: Replica: d31707bf87914b6685047c7646b69dea, State: Running, Role: LEADER
I20260709 13:00:51.467136  9777 consensus_queue.cc:237] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } }
I20260709 13:00:51.473660  9480 catalog_manager.cc:5697] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea reported cstate change: term changed from 1 to 2, leader changed from df444b9b90e24accb747354452e8c1b7 (127.0.107.195) to d31707bf87914b6685047c7646b69dea (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d31707bf87914b6685047c7646b69dea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.605930  9782 consensus_queue.cc:1048] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:51.617755  9782 consensus_queue.cc:1048] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:51.626689  9801 raft_consensus.cc:993] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4: : Instructing follower df444b9b90e24accb747354452e8c1b7 to start an election
I20260709 13:00:51.627167  9782 raft_consensus.cc:1081] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Signalling peer df444b9b90e24accb747354452e8c1b7 to start an election
I20260709 13:00:51.628880  9731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c8f8219a84f433d9d278eb5d996e3e1"
dest_uuid: "df444b9b90e24accb747354452e8c1b7"
 from {username='slave'} at 127.0.0.1:53708
I20260709 13:00:51.629349  9731 raft_consensus.cc:493] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.629709  9731 raft_consensus.cc:3060] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.635028  9731 raft_consensus.cc:515] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.637074  9731 leader_election.cc:290] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [CANDIDATE]: Term 2 election: Requested vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194:37737)
I20260709 13:00:51.637702  9583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8f8219a84f433d9d278eb5d996e3e1" candidate_uuid: "df444b9b90e24accb747354452e8c1b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d31707bf87914b6685047c7646b69dea"
I20260709 13:00:51.638144  9658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8f8219a84f433d9d278eb5d996e3e1" candidate_uuid: "df444b9b90e24accb747354452e8c1b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f171b29f88104a939dec2bf6e2edcff4"
I20260709 13:00:51.638445  9583 raft_consensus.cc:3060] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.638829  9658 raft_consensus.cc:3055] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.639191  9658 raft_consensus.cc:740] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Running, Role: LEADER
I20260709 13:00:51.639942  9658 consensus_queue.cc:260] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.640991  9658 raft_consensus.cc:3060] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.645608  9782 consensus_queue.cc:1048] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:51.645980  9583 raft_consensus.cc:2468] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df444b9b90e24accb747354452e8c1b7 in term 2.
I20260709 13:00:51.647128  9696 leader_election.cc:304] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31707bf87914b6685047c7646b69dea, df444b9b90e24accb747354452e8c1b7; no voters: 
I20260709 13:00:51.647701  9658 raft_consensus.cc:2468] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df444b9b90e24accb747354452e8c1b7 in term 2.
I20260709 13:00:51.648151  9778 raft_consensus.cc:2804] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:51.649626  9778 raft_consensus.cc:697] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 2 LEADER]: Becoming Leader. State: Replica: df444b9b90e24accb747354452e8c1b7, State: Running, Role: LEADER
I20260709 13:00:51.650321  9778 consensus_queue.cc:237] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.657617  9480 catalog_manager.cc:5697] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 reported cstate change: term changed from 1 to 2, leader changed from f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194) to df444b9b90e24accb747354452e8c1b7 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "df444b9b90e24accb747354452e8c1b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:51.660012  9801 consensus_queue.cc:1048] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:51.669294  9801 raft_consensus.cc:993] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4: : Instructing follower d31707bf87914b6685047c7646b69dea to start an election
I20260709 13:00:51.669731  9801 raft_consensus.cc:1081] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Signalling peer d31707bf87914b6685047c7646b69dea to start an election
I20260709 13:00:51.671232  9583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "311c491e5a24472fa19f9e9ace87486b"
dest_uuid: "d31707bf87914b6685047c7646b69dea"
 from {username='slave'} at 127.0.0.1:53186
I20260709 13:00:51.671902  9583 raft_consensus.cc:493] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.672407  9583 raft_consensus.cc:3060] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.677898  9583 raft_consensus.cc:515] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.679770  9583 leader_election.cc:290] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [CANDIDATE]: Term 2 election: Requested vote from peers f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194:37737), df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:51.680501  9658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311c491e5a24472fa19f9e9ace87486b" candidate_uuid: "d31707bf87914b6685047c7646b69dea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f171b29f88104a939dec2bf6e2edcff4"
I20260709 13:00:51.680927  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311c491e5a24472fa19f9e9ace87486b" candidate_uuid: "d31707bf87914b6685047c7646b69dea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df444b9b90e24accb747354452e8c1b7"
I20260709 13:00:51.681212  9658 raft_consensus.cc:3055] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.681622  9658 raft_consensus.cc:740] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Running, Role: LEADER
I20260709 13:00:51.681638  9731 raft_consensus.cc:3060] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.682719  9658 consensus_queue.cc:260] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.684113  9658 raft_consensus.cc:3060] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.687718  9731 raft_consensus.cc:2468] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31707bf87914b6685047c7646b69dea in term 2.
I20260709 13:00:51.688845  9549 leader_election.cc:304] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31707bf87914b6685047c7646b69dea, df444b9b90e24accb747354452e8c1b7; no voters: 
I20260709 13:00:51.689627  9777 raft_consensus.cc:2804] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:51.689706  9658 raft_consensus.cc:2468] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31707bf87914b6685047c7646b69dea in term 2.
I20260709 13:00:51.690172  9777 raft_consensus.cc:697] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 2 LEADER]: Becoming Leader. State: Replica: d31707bf87914b6685047c7646b69dea, State: Running, Role: LEADER
I20260709 13:00:51.691128  9777 consensus_queue.cc:237] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.694016  9817 consensus_queue.cc:1048] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:51.698050  9481 catalog_manager.cc:5697] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea reported cstate change: term changed from 1 to 2, leader changed from f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194) to d31707bf87914b6685047c7646b69dea (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d31707bf87914b6685047c7646b69dea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.700479  9788 raft_consensus.cc:993] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: : Instructing follower d31707bf87914b6685047c7646b69dea to start an election
I20260709 13:00:51.701015  9788 raft_consensus.cc:1081] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Signalling peer d31707bf87914b6685047c7646b69dea to start an election
I20260709 13:00:51.703238  9582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0"
dest_uuid: "d31707bf87914b6685047c7646b69dea"
 from {username='slave'} at 127.0.0.1:53186
I20260709 13:00:51.704187  9582 raft_consensus.cc:493] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.704591  9582 raft_consensus.cc:3060] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.709614  9817 consensus_queue.cc:1048] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:51.713361  9582 raft_consensus.cc:515] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.716120  9582 leader_election.cc:290] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [CANDIDATE]: Term 2 election: Requested vote from peers f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194:37737), df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:51.716327  9658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0" candidate_uuid: "d31707bf87914b6685047c7646b69dea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f171b29f88104a939dec2bf6e2edcff4"
I20260709 13:00:51.717064  9658 raft_consensus.cc:3055] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.717276  9658 raft_consensus.cc:740] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Running, Role: LEADER
I20260709 13:00:51.718067  9658 consensus_queue.cc:260] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.718492  9732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0" candidate_uuid: "d31707bf87914b6685047c7646b69dea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df444b9b90e24accb747354452e8c1b7"
I20260709 13:00:51.719187  9658 raft_consensus.cc:3060] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.726657  9658 raft_consensus.cc:2468] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31707bf87914b6685047c7646b69dea in term 2.
I20260709 13:00:51.727829  9546 leader_election.cc:304] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31707bf87914b6685047c7646b69dea, f171b29f88104a939dec2bf6e2edcff4; no voters: df444b9b90e24accb747354452e8c1b7
I20260709 13:00:51.728675  9777 raft_consensus.cc:2804] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:51.729162  9777 raft_consensus.cc:697] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 2 LEADER]: Becoming Leader. State: Replica: d31707bf87914b6685047c7646b69dea, State: Running, Role: LEADER
I20260709 13:00:51.729979  9777 consensus_queue.cc:237] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:51.735507  9481 catalog_manager.cc:5697] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea reported cstate change: term changed from 1 to 2, leader changed from f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194) to d31707bf87914b6685047c7646b69dea (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d31707bf87914b6685047c7646b69dea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.774945   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:00:51.776486   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:00:51.776899   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:00:51.788792  9582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0"
dest_uuid: "d31707bf87914b6685047c7646b69dea"
mode: GRACEFUL
new_leader_uuid: "f171b29f88104a939dec2bf6e2edcff4"
 from {username='slave'} at 127.0.0.1:53202
I20260709 13:00:51.789258  9582 raft_consensus.cc:606] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 2 LEADER]: Received request to transfer leadership to TS f171b29f88104a939dec2bf6e2edcff4
I20260709 13:00:51.790377   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:00:51.891814  9731 raft_consensus.cc:1275] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Refusing update from remote peer d31707bf87914b6685047c7646b69dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.891999  9658 raft_consensus.cc:1275] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Refusing update from remote peer d31707bf87914b6685047c7646b69dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.893170  9812 consensus_queue.cc:1048] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:51.893936  9777 consensus_queue.cc:1048] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.065608  9582 raft_consensus.cc:1275] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Refusing update from remote peer df444b9b90e24accb747354452e8c1b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:52.066926  9778 consensus_queue.cc:1048] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.077152  9658 raft_consensus.cc:1275] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Refusing update from remote peer df444b9b90e24accb747354452e8c1b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:52.078497  9824 consensus_queue.cc:1048] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.115607  9658 raft_consensus.cc:1275] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Refusing update from remote peer d31707bf87914b6685047c7646b69dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:52.116865  9777 consensus_queue.cc:1048] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.121546  9823 raft_consensus.cc:993] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea: : Instructing follower f171b29f88104a939dec2bf6e2edcff4 to start an election
I20260709 13:00:52.122056  9823 raft_consensus.cc:1081] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 2 LEADER]: Signalling peer f171b29f88104a939dec2bf6e2edcff4 to start an election
I20260709 13:00:52.123696  9657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0"
dest_uuid: "f171b29f88104a939dec2bf6e2edcff4"
 from {username='slave'} at 127.0.0.1:45990
I20260709 13:00:52.124310  9657 raft_consensus.cc:493] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.124711  9657 raft_consensus.cc:3060] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.127041  9731 raft_consensus.cc:3060] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.134272  9657 raft_consensus.cc:515] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:52.134979  9731 raft_consensus.cc:1275] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Refusing update from remote peer d31707bf87914b6685047c7646b69dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:52.135473  9658 raft_consensus.cc:1240] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 3 FOLLOWER]: Rejecting Update request from peer d31707bf87914b6685047c7646b69dea for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:52.136404  9812 consensus_queue.cc:1048] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.136994  9657 leader_election.cc:290] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 3 election: Requested vote from peers d31707bf87914b6685047c7646b69dea (127.0.107.193:36685), df444b9b90e24accb747354452e8c1b7 (127.0.107.195:39041)
I20260709 13:00:52.138031  9582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d31707bf87914b6685047c7646b69dea"
I20260709 13:00:52.138214  9812 consensus_queue.cc:1059] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.139050  9582 raft_consensus.cc:3055] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.139394  9582 raft_consensus.cc:740] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d31707bf87914b6685047c7646b69dea, State: Running, Role: LEADER
I20260709 13:00:52.140210  9582 consensus_queue.cc:260] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:52.141388  9582 raft_consensus.cc:3060] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.143191  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db138d04b70f41729d0403bcda6325d0" candidate_uuid: "f171b29f88104a939dec2bf6e2edcff4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df444b9b90e24accb747354452e8c1b7"
I20260709 13:00:52.143844  9731 raft_consensus.cc:3060] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.148290  9582 raft_consensus.cc:2468] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 3.
W20260709 13:00:52.148914  9823 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:00:52.149524  9622 leader_election.cc:304] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31707bf87914b6685047c7646b69dea, f171b29f88104a939dec2bf6e2edcff4; no voters: 
I20260709 13:00:52.150440  9817 raft_consensus.cc:2804] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.150918  9731 raft_consensus.cc:2468] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f171b29f88104a939dec2bf6e2edcff4 in term 3.
I20260709 13:00:52.150964  9817 raft_consensus.cc:697] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 3 LEADER]: Becoming Leader. State: Replica: f171b29f88104a939dec2bf6e2edcff4, State: Running, Role: LEADER
I20260709 13:00:52.152069  9817 consensus_queue.cc:237] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } }
I20260709 13:00:52.158139  9480 catalog_manager.cc:5697] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 reported cstate change: term changed from 2 to 3, leader changed from d31707bf87914b6685047c7646b69dea (127.0.107.193) to f171b29f88104a939dec2bf6e2edcff4 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f171b29f88104a939dec2bf6e2edcff4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31707bf87914b6685047c7646b69dea" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.210146  9658 raft_consensus.cc:1275] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Refusing update from remote peer d31707bf87914b6685047c7646b69dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:52.211498  9823 consensus_queue.cc:1048] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f171b29f88104a939dec2bf6e2edcff4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.218706  9731 raft_consensus.cc:1275] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Refusing update from remote peer d31707bf87914b6685047c7646b69dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:52.220635  9777 consensus_queue.cc:1048] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "df444b9b90e24accb747354452e8c1b7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.399915   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:00:52.419788   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:52.420418   431 tablet_replica.cc:333] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea: stopping tablet replica
I20260709 13:00:52.421060   431 raft_consensus.cc:2243] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:52.421950   431 raft_consensus.cc:2272] T 311c491e5a24472fa19f9e9ace87486b P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.424422   431 tablet_replica.cc:333] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea: stopping tablet replica
I20260709 13:00:52.425021   431 raft_consensus.cc:2243] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.425498   431 raft_consensus.cc:2272] T db138d04b70f41729d0403bcda6325d0 P d31707bf87914b6685047c7646b69dea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.427794   431 tablet_replica.cc:333] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea: stopping tablet replica
I20260709 13:00:52.428309   431 raft_consensus.cc:2243] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:52.429132   431 raft_consensus.cc:2272] T 7e3d801fc8e140ee9064d50dd2fbd897 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.431444   431 tablet_replica.cc:333] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea: stopping tablet replica
I20260709 13:00:52.432019   431 raft_consensus.cc:2243] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.432461   431 raft_consensus.cc:2272] T 3c8f8219a84f433d9d278eb5d996e3e1 P d31707bf87914b6685047c7646b69dea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.445103   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:00:52.457281   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:00:52.474949   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:52.475579   431 tablet_replica.cc:333] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4: stopping tablet replica
I20260709 13:00:52.476137   431 raft_consensus.cc:2243] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.476599   431 raft_consensus.cc:2272] T 311c491e5a24472fa19f9e9ace87486b P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.478744   431 tablet_replica.cc:333] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: stopping tablet replica
I20260709 13:00:52.479262   431 raft_consensus.cc:2243] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:52.479873   431 pending_rounds.cc:70] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: Trying to abort 2 pending ops.
I20260709 13:00:52.480046   431 pending_rounds.cc:77] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634005623808000 op_type: NO_OP noop_request { }
I20260709 13:00:52.480340   431 raft_consensus.cc:2889] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:00:52.480556   431 pending_rounds.cc:77] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634003892912128 op_type: NO_OP noop_request { }
I20260709 13:00:52.480834   431 raft_consensus.cc:2889] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:00:52.481123   431 raft_consensus.cc:2272] T db138d04b70f41729d0403bcda6325d0 P f171b29f88104a939dec2bf6e2edcff4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.483479   431 tablet_replica.cc:333] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4: stopping tablet replica
I20260709 13:00:52.483975   431 raft_consensus.cc:2243] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.484383   431 raft_consensus.cc:2272] T 3c8f8219a84f433d9d278eb5d996e3e1 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.486477   431 tablet_replica.cc:333] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4: stopping tablet replica
I20260709 13:00:52.486945   431 raft_consensus.cc:2243] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.487342   431 raft_consensus.cc:2272] T 7e3d801fc8e140ee9064d50dd2fbd897 P f171b29f88104a939dec2bf6e2edcff4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.509728   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:00:52.521827   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:00:52.539018   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:52.539630   431 tablet_replica.cc:333] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7: stopping tablet replica
I20260709 13:00:52.540189   431 raft_consensus.cc:2243] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.540696   431 raft_consensus.cc:2272] T 311c491e5a24472fa19f9e9ace87486b P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.542873   431 tablet_replica.cc:333] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7: stopping tablet replica
I20260709 13:00:52.543418   431 raft_consensus.cc:2243] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.543848   431 raft_consensus.cc:2272] T db138d04b70f41729d0403bcda6325d0 P df444b9b90e24accb747354452e8c1b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.545933   431 tablet_replica.cc:333] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7: stopping tablet replica
I20260709 13:00:52.546443   431 raft_consensus.cc:2243] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:52.546866   431 raft_consensus.cc:2272] T 7e3d801fc8e140ee9064d50dd2fbd897 P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.548857   431 tablet_replica.cc:333] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7: stopping tablet replica
I20260709 13:00:52.549320   431 raft_consensus.cc:2243] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:52.550102   431 raft_consensus.cc:2272] T 3c8f8219a84f433d9d278eb5d996e3e1 P df444b9b90e24accb747354452e8c1b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.562690   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:00:52.574638   431 master.cc:562] Master@127.0.107.254:34787 shutting down...
I20260709 13:00:52.588289   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:52.588882   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:52.589217   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P d6e7982d0cb04a7cadcbd2f6c90c1ff3: stopping tablet replica
I20260709 13:00:52.606968   431 master.cc:584] Master@127.0.107.254:34787 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2436 ms)
[----------] 6 tests from LeaderRebalancerTest (286154 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:00:52.635142   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41651
I20260709 13:00:52.636212   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:52.641182  9825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:52.641377  9826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:52.642418  9828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:52.643191   431 server_base.cc:1061] running on GCE node
I20260709 13:00:52.644044   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:52.644232   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:52.644407   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602052644372 us; error 0 us; skew 500 ppm
I20260709 13:00:52.644964   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:52.647131   431 webserver.cc:533] Webserver started at http://127.0.107.254:40055/ using document root <none> and password file <none>
I20260709 13:00:52.647611   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:52.647807   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:52.648087   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:52.649175   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/master-0-root/instance:
uuid: "c319d7babf824395b1d6960b0a85718c"
format_stamp: "Formatted at 2026-07-09 13:00:52 on dist-test-slave-73vh"
I20260709 13:00:52.653542   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:00:52.656584  9833 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:52.657383   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:52.657656   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/master-0-root
uuid: "c319d7babf824395b1d6960b0a85718c"
format_stamp: "Formatted at 2026-07-09 13:00:52 on dist-test-slave-73vh"
I20260709 13:00:52.657946   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:52.683790   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:52.684914   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:52.719712   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41651
I20260709 13:00:52.719825  9884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41651 every 8 connection(s)
I20260709 13:00:52.723491  9885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.734095  9885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c: Bootstrap starting.
I20260709 13:00:52.738494  9885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.742390  9885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c: No bootstrap required, opened a new log
I20260709 13:00:52.744443  9885 raft_consensus.cc:359] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c319d7babf824395b1d6960b0a85718c" member_type: VOTER }
I20260709 13:00:52.744912  9885 raft_consensus.cc:385] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.745152  9885 raft_consensus.cc:740] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c319d7babf824395b1d6960b0a85718c, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.745788  9885 consensus_queue.cc:260] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c319d7babf824395b1d6960b0a85718c" member_type: VOTER }
I20260709 13:00:52.746254  9885 raft_consensus.cc:399] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:52.746490  9885 raft_consensus.cc:493] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:52.746760  9885 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.751267  9885 raft_consensus.cc:515] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c319d7babf824395b1d6960b0a85718c" member_type: VOTER }
I20260709 13:00:52.751754  9885 leader_election.cc:304] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c319d7babf824395b1d6960b0a85718c; no voters: 
I20260709 13:00:52.752866  9885 leader_election.cc:290] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:52.753161  9888 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:52.754509  9888 raft_consensus.cc:697] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 1 LEADER]: Becoming Leader. State: Replica: c319d7babf824395b1d6960b0a85718c, State: Running, Role: LEADER
I20260709 13:00:52.755159  9888 consensus_queue.cc:237] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c319d7babf824395b1d6960b0a85718c" member_type: VOTER }
I20260709 13:00:52.755748  9885 sys_catalog.cc:565] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:52.757985  9889 sys_catalog.cc:455] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c319d7babf824395b1d6960b0a85718c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c319d7babf824395b1d6960b0a85718c" member_type: VOTER } }
I20260709 13:00:52.758038  9890 sys_catalog.cc:455] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c319d7babf824395b1d6960b0a85718c. Latest consensus state: current_term: 1 leader_uuid: "c319d7babf824395b1d6960b0a85718c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c319d7babf824395b1d6960b0a85718c" member_type: VOTER } }
I20260709 13:00:52.758816  9890 sys_catalog.cc:458] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:52.758750  9889 sys_catalog.cc:458] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:52.767457  9894 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:52.771838  9894 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:52.772948   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:52.780112  9894 catalog_manager.cc:1383] Generated new cluster ID: e01e87d7b86c418a9deb80d0561b057e
I20260709 13:00:52.780329  9894 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:52.803987  9894 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:52.805271  9894 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:52.817369  9894 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c: Generated new TSK 0
I20260709 13:00:52.817920  9894 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:52.839304   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:52.844914  9906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:52.846160  9907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:52.847675  9909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:52.848356   431 server_base.cc:1061] running on GCE node
I20260709 13:00:52.849475   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:52.849747   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:52.849951   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602052849932 us; error 0 us; skew 500 ppm
I20260709 13:00:52.850723   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:52.852936   431 webserver.cc:533] Webserver started at http://127.0.107.193:38579/ using document root <none> and password file <none>
I20260709 13:00:52.853430   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:52.853628   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:52.853901   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:52.854975   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-0-root/instance:
uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
format_stamp: "Formatted at 2026-07-09 13:00:52 on dist-test-slave-73vh"
I20260709 13:00:52.859598   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:00:52.862906  9914 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:52.863585   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:52.863871   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
format_stamp: "Formatted at 2026-07-09 13:00:52 on dist-test-slave-73vh"
I20260709 13:00:52.864184   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:52.884438   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:52.885603   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:52.887115   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:52.889317   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:52.889542   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:52.889777   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:52.889950   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:52.929047   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:46237
I20260709 13:00:52.929165  9976 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:46237 every 8 connection(s)
I20260709 13:00:52.933934   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:52.940488  9981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:52.943369  9982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:52.945132  9984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:52.946178  9977 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41651
I20260709 13:00:52.946395   431 server_base.cc:1061] running on GCE node
I20260709 13:00:52.946704  9977 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:52.947373   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:52.947640   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:52.947494  9977 heartbeater.cc:507] Master 127.0.107.254:41651 requested a full tablet report, sending...
I20260709 13:00:52.947938   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602052947918 us; error 0 us; skew 500 ppm
I20260709 13:00:52.948534   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:52.949930  9850 ts_manager.cc:194] Registered new tserver with Master: e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237)
I20260709 13:00:52.951089   431 webserver.cc:533] Webserver started at http://127.0.107.194:35081/ using document root <none> and password file <none>
I20260709 13:00:52.951615   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:52.951815   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:52.951963  9850 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49264
I20260709 13:00:52.952080   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:52.953464   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-1-root/instance:
uuid: "2699f38b6db94b80a69602c698e857d9"
format_stamp: "Formatted at 2026-07-09 13:00:52 on dist-test-slave-73vh"
I20260709 13:00:52.957724   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:00:52.960950  9989 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:52.961683   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:52.961964   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-1-root
uuid: "2699f38b6db94b80a69602c698e857d9"
format_stamp: "Formatted at 2026-07-09 13:00:52 on dist-test-slave-73vh"
I20260709 13:00:52.962240   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:52.973433   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:52.974400   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:52.975731   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:52.977931   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:52.978147   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:52.978377   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:52.978546   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:53.015432   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39837
I20260709 13:00:53.015559 10051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39837 every 8 connection(s)
I20260709 13:00:53.020399   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:53.027251 10055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:53.028855 10056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:53.031945   431 server_base.cc:1061] running on GCE node
W20260709 13:00:53.032291 10058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:53.033402   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:53.033430 10052 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41651
W20260709 13:00:53.033665   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:53.033959   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602053033943 us; error 0 us; skew 500 ppm
I20260709 13:00:53.033982 10052 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:53.034565   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:53.034842 10052 heartbeater.cc:507] Master 127.0.107.254:41651 requested a full tablet report, sending...
I20260709 13:00:53.037257  9850 ts_manager.cc:194] Registered new tserver with Master: 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:53.037333   431 webserver.cc:533] Webserver started at http://127.0.107.195:45851/ using document root <none> and password file <none>
I20260709 13:00:53.037982   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:53.038196   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:53.038482   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:53.038951  9850 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49272
I20260709 13:00:53.039602   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-2-root/instance:
uuid: "88cb686af2664080b74b65fbcfe1a0e5"
format_stamp: "Formatted at 2026-07-09 13:00:53 on dist-test-slave-73vh"
I20260709 13:00:53.043924   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:00:53.047075 10063 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:53.047781   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:53.048066   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-2-root
uuid: "88cb686af2664080b74b65fbcfe1a0e5"
format_stamp: "Formatted at 2026-07-09 13:00:53 on dist-test-slave-73vh"
I20260709 13:00:53.048352   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601766316156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:53.073027   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:53.074060   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:53.075464   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:53.077689   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:53.077914   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:53.078159   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:53.078336   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:53.119426   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:46103
I20260709 13:00:53.119541 10125 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:46103 every 8 connection(s)
I20260709 13:00:53.132846 10126 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41651
I20260709 13:00:53.133335 10126 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:53.134049 10126 heartbeater.cc:507] Master 127.0.107.254:41651 requested a full tablet report, sending...
I20260709 13:00:53.135886  9850 ts_manager.cc:194] Registered new tserver with Master: 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:53.136973   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014424492s
I20260709 13:00:53.137475  9850 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49280
I20260709 13:00:53.161095  9850 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49294:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:53.163679  9850 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:53.226425 10091 tablet_service.cc:1511] Processing CreateTablet for tablet ca30096d7f584656801568a185406bcc (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:53.228076 10091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca30096d7f584656801568a185406bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.227715 10090 tablet_service.cc:1511] Processing CreateTablet for tablet c50184a86a9c45e1b0d49d54c0960a7a (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:53.229229 10090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50184a86a9c45e1b0d49d54c0960a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.228922 10088 tablet_service.cc:1511] Processing CreateTablet for tablet 8629656f32e34e5a87dcebf312b5ea0e (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:53.230264 10088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8629656f32e34e5a87dcebf312b5ea0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.232365 10089 tablet_service.cc:1511] Processing CreateTablet for tablet a260a3b7fdc545d4a11bdee89eca07cf (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:53.234151 10089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a260a3b7fdc545d4a11bdee89eca07cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.258373 10087 tablet_service.cc:1511] Processing CreateTablet for tablet c33c46c3f4bc43359933d049fb7fb85f (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:53.260397 10087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c33c46c3f4bc43359933d049fb7fb85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.262830 10086 tablet_service.cc:1511] Processing CreateTablet for tablet 0b90e8db2f9848a88f0dcec6a384a4b7 (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:53.267582 10086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b90e8db2f9848a88f0dcec6a384a4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.269436 10085 tablet_service.cc:1511] Processing CreateTablet for tablet 878a515f14e34721ad3705dfd1ed2e21 (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:53.270812 10085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878a515f14e34721ad3705dfd1ed2e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.286330  9942 tablet_service.cc:1511] Processing CreateTablet for tablet ca30096d7f584656801568a185406bcc (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:53.287782  9942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca30096d7f584656801568a185406bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.288457  9941 tablet_service.cc:1511] Processing CreateTablet for tablet c50184a86a9c45e1b0d49d54c0960a7a (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:53.289812  9941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50184a86a9c45e1b0d49d54c0960a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.293694  9940 tablet_service.cc:1511] Processing CreateTablet for tablet a260a3b7fdc545d4a11bdee89eca07cf (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:53.295015  9940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a260a3b7fdc545d4a11bdee89eca07cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.294709 10089 tablet_service.cc:1511] Processing CreateTablet for tablet 052ec08f0ff5424db162a58f3d75311d (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:53.295485 10090 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee1905ec0fd4bf384efe8a590b1b0c4 (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:53.296020 10089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052ec08f0ff5424db162a58f3d75311d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.296730 10090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee1905ec0fd4bf384efe8a590b1b0c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.297727  9939 tablet_service.cc:1511] Processing CreateTablet for tablet 8629656f32e34e5a87dcebf312b5ea0e (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:53.298987  9939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8629656f32e34e5a87dcebf312b5ea0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.301759  9938 tablet_service.cc:1511] Processing CreateTablet for tablet c33c46c3f4bc43359933d049fb7fb85f (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:53.303045  9938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c33c46c3f4bc43359933d049fb7fb85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.306228  9937 tablet_service.cc:1511] Processing CreateTablet for tablet 0b90e8db2f9848a88f0dcec6a384a4b7 (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:53.309342 10016 tablet_service.cc:1511] Processing CreateTablet for tablet c50184a86a9c45e1b0d49d54c0960a7a (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:53.310652 10016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50184a86a9c45e1b0d49d54c0960a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.310384 10012 tablet_service.cc:1511] Processing CreateTablet for tablet 0b90e8db2f9848a88f0dcec6a384a4b7 (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:53.311679 10012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b90e8db2f9848a88f0dcec6a384a4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.313706 10015 tablet_service.cc:1511] Processing CreateTablet for tablet a260a3b7fdc545d4a11bdee89eca07cf (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:53.315073 10015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a260a3b7fdc545d4a11bdee89eca07cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.317041 10017 tablet_service.cc:1511] Processing CreateTablet for tablet ca30096d7f584656801568a185406bcc (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:53.318643 10014 tablet_service.cc:1511] Processing CreateTablet for tablet 8629656f32e34e5a87dcebf312b5ea0e (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:53.319401 10010 tablet_service.cc:1511] Processing CreateTablet for tablet 052ec08f0ff5424db162a58f3d75311d (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:53.320009 10011 tablet_service.cc:1511] Processing CreateTablet for tablet 878a515f14e34721ad3705dfd1ed2e21 (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:53.321542 10009 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee1905ec0fd4bf384efe8a590b1b0c4 (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:53.321435  9935 tablet_service.cc:1511] Processing CreateTablet for tablet 052ec08f0ff5424db162a58f3d75311d (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:53.324219  9937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b90e8db2f9848a88f0dcec6a384a4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.325055 10013 tablet_service.cc:1511] Processing CreateTablet for tablet c33c46c3f4bc43359933d049fb7fb85f (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:53.327008  9936 tablet_service.cc:1511] Processing CreateTablet for tablet 878a515f14e34721ad3705dfd1ed2e21 (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:53.328310  9936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878a515f14e34721ad3705dfd1ed2e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.337761  9934 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee1905ec0fd4bf384efe8a590b1b0c4 (DEFAULT_TABLE table=test-workload [id=878f883ade6245c69dc3df7651fe5ecf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:53.339118 10017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca30096d7f584656801568a185406bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.341820 10013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c33c46c3f4bc43359933d049fb7fb85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.344969  9935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052ec08f0ff5424db162a58f3d75311d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.344971 10011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878a515f14e34721ad3705dfd1ed2e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.346827 10014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8629656f32e34e5a87dcebf312b5ea0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.348583  9934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee1905ec0fd4bf384efe8a590b1b0c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.349756 10010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052ec08f0ff5424db162a58f3d75311d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.352056 10009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee1905ec0fd4bf384efe8a590b1b0c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:53.374362 10141 tablet_bootstrap.cc:492] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:53.374455 10140 tablet_bootstrap.cc:492] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:53.381276 10141 tablet_bootstrap.cc:654] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.382041 10140 tablet_bootstrap.cc:654] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.473004 10144 tablet_bootstrap.cc:492] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:53.491163 10141 tablet_bootstrap.cc:492] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:53.491741 10141 ts_tablet_manager.cc:1403] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.118s	user 0.041s	sys 0.047s
I20260709 13:00:53.494158 10141 raft_consensus.cc:359] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:53.494711 10141 raft_consensus.cc:385] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.494980 10141 raft_consensus.cc:740] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.495414 10140 tablet_bootstrap.cc:492] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:53.495949 10140 ts_tablet_manager.cc:1403] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.000s
I20260709 13:00:53.495718 10141 consensus_queue.cc:260] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:53.498940 10140 raft_consensus.cc:359] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:53.499620 10140 raft_consensus.cc:385] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.499927 10140 raft_consensus.cc:740] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.491747 10144 tablet_bootstrap.cc:654] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.500806 10140 consensus_queue.cc:260] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:53.517050 10126 heartbeater.cc:499] Master 127.0.107.254:41651 was elected leader, sending a full tablet report...
I20260709 13:00:53.518265 10140 ts_tablet_manager.cc:1434] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:00:53.519768 10140 tablet_bootstrap.cc:492] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:53.530228 10144 tablet_bootstrap.cc:492] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:53.530800 10144 ts_tablet_manager.cc:1403] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.010s
I20260709 13:00:53.533390 10140 tablet_bootstrap.cc:654] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.534538 10144 raft_consensus.cc:359] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.535343 10144 raft_consensus.cc:385] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.535638 10144 raft_consensus.cc:740] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.536787  9977 heartbeater.cc:499] Master 127.0.107.254:41651 was elected leader, sending a full tablet report...
I20260709 13:00:53.536537 10144 consensus_queue.cc:260] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.537598 10141 ts_tablet_manager.cc:1434] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.045s	user 0.021s	sys 0.024s
I20260709 13:00:53.538726 10141 tablet_bootstrap.cc:492] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:53.544994 10141 tablet_bootstrap.cc:654] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.555119 10052 heartbeater.cc:499] Master 127.0.107.254:41651 was elected leader, sending a full tablet report...
I20260709 13:00:53.555807 10141 tablet_bootstrap.cc:492] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:53.556106 10140 tablet_bootstrap.cc:492] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:53.556450 10141 ts_tablet_manager.cc:1403] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.008s
I20260709 13:00:53.556713 10140 ts_tablet_manager.cc:1403] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 13:00:53.559693 10141 raft_consensus.cc:359] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.560031 10140 raft_consensus.cc:359] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.560590 10141 raft_consensus.cc:385] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.560912 10140 raft_consensus.cc:385] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.561076 10141 raft_consensus.cc:740] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.561305 10140 raft_consensus.cc:740] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.562139 10141 consensus_queue.cc:260] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.562932 10144 ts_tablet_manager.cc:1434] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.032s	user 0.019s	sys 0.004s
I20260709 13:00:53.564030 10144 tablet_bootstrap.cc:492] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:53.564324 10141 ts_tablet_manager.cc:1434] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:00:53.565315 10141 tablet_bootstrap.cc:492] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:53.565071 10140 consensus_queue.cc:260] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.570080 10144 tablet_bootstrap.cc:654] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.571167 10140 ts_tablet_manager.cc:1434] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:00:53.571349 10141 tablet_bootstrap.cc:654] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.572372 10140 tablet_bootstrap.cc:492] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:53.586058 10140 tablet_bootstrap.cc:654] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.592288 10144 tablet_bootstrap.cc:492] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:53.592821 10144 ts_tablet_manager.cc:1403] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.015s
I20260709 13:00:53.593174 10140 tablet_bootstrap.cc:492] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:53.593341 10141 tablet_bootstrap.cc:492] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:53.593691 10140 ts_tablet_manager.cc:1403] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.005s
I20260709 13:00:53.594044 10141 ts_tablet_manager.cc:1403] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.005s
I20260709 13:00:53.595721 10144 raft_consensus.cc:359] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.596483 10144 raft_consensus.cc:385] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.596848 10144 raft_consensus.cc:740] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.597081 10141 raft_consensus.cc:359] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.597951 10141 raft_consensus.cc:385] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.597800 10144 consensus_queue.cc:260] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.596616 10140 raft_consensus.cc:359] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.598364 10141 raft_consensus.cc:740] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.598861 10140 raft_consensus.cc:385] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.599205 10140 raft_consensus.cc:740] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.599548 10141 consensus_queue.cc:260] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.600365 10144 ts_tablet_manager.cc:1434] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:53.599951 10140 consensus_queue.cc:260] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.601339 10144 tablet_bootstrap.cc:492] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:53.602244 10140 ts_tablet_manager.cc:1434] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:00:53.603309 10140 tablet_bootstrap.cc:492] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:53.604557 10141 ts_tablet_manager.cc:1434] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 13:00:53.605695 10141 tablet_bootstrap.cc:492] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:53.607916 10144 tablet_bootstrap.cc:654] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.609243 10140 tablet_bootstrap.cc:654] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.612030 10141 tablet_bootstrap.cc:654] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.620046 10144 tablet_bootstrap.cc:492] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:53.620702 10144 ts_tablet_manager.cc:1403] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.008s
I20260709 13:00:53.624434 10144 raft_consensus.cc:359] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.625411 10144 raft_consensus.cc:385] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.625773 10144 raft_consensus.cc:740] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.629871 10140 tablet_bootstrap.cc:492] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:53.629578 10144 consensus_queue.cc:260] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.630975 10141 tablet_bootstrap.cc:492] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:53.631544 10141 ts_tablet_manager.cc:1403] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.009s
I20260709 13:00:53.631830 10144 ts_tablet_manager.cc:1434] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:00:53.630439 10140 ts_tablet_manager.cc:1403] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.017s
I20260709 13:00:53.632872 10144 tablet_bootstrap.cc:492] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:53.634743 10141 raft_consensus.cc:359] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.635512 10141 raft_consensus.cc:385] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.635447 10140 raft_consensus.cc:359] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.636032 10141 raft_consensus.cc:740] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.636349 10140 raft_consensus.cc:385] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.636708 10140 raft_consensus.cc:740] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.637046 10141 consensus_queue.cc:260] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.637735 10140 consensus_queue.cc:260] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.639688 10144 tablet_bootstrap.cc:654] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.639791 10141 ts_tablet_manager.cc:1434] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:00:53.640334 10140 ts_tablet_manager.cc:1434] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:00:53.641150 10141 tablet_bootstrap.cc:492] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:53.641367 10140 tablet_bootstrap.cc:492] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:53.647405 10140 tablet_bootstrap.cc:654] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.647955 10141 tablet_bootstrap.cc:654] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.651211 10146 raft_consensus.cc:493] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.651714 10146 raft_consensus.cc:515] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.656450 10146 leader_election.cc:290] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:53.664048 10141 tablet_bootstrap.cc:492] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:53.665016 10141 ts_tablet_manager.cc:1403] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.013s
I20260709 13:00:53.669457 10140 tablet_bootstrap.cc:492] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:53.670014 10140 ts_tablet_manager.cc:1403] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.007s
I20260709 13:00:53.672513 10144 tablet_bootstrap.cc:492] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:53.673257 10140 raft_consensus.cc:359] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.674077 10140 raft_consensus.cc:385] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.673026 10141 raft_consensus.cc:359] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.674448 10140 raft_consensus.cc:740] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.674139 10144 ts_tablet_manager.cc:1403] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.012s
I20260709 13:00:53.675287 10140 consensus_queue.cc:260] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.674609 10141 raft_consensus.cc:385] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.676306 10141 raft_consensus.cc:740] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.676533  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:53.677199 10141 consensus_queue.cc:260] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.677654 10140 ts_tablet_manager.cc:1434] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 13:00:53.678369 10065 leader_election.cc:343] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.680042 10140 tablet_bootstrap.cc:492] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:53.680531 10141 ts_tablet_manager.cc:1434] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:00:53.681555 10141 tablet_bootstrap.cc:492] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:53.685529 10146 raft_consensus.cc:493] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.686060 10146 raft_consensus.cc:515] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.688153 10146 leader_election.cc:290] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:53.688345 10141 tablet_bootstrap.cc:654] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.688485 10140 tablet_bootstrap.cc:654] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.689881  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
W20260709 13:00:53.692191 10065 leader_election.cc:343] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.693463 10144 raft_consensus.cc:359] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.694280 10144 raft_consensus.cc:385] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.699939 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:53.694631 10144 raft_consensus.cc:740] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
W20260709 13:00:53.702909 10065 leader_election.cc:343] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.701840 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:53.703336 10146 raft_consensus.cc:493] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.703920 10026 raft_consensus.cc:2468] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:53.704020 10146 raft_consensus.cc:515] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:53.705617 10140 tablet_bootstrap.cc:492] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:53.706182 10146 leader_election.cc:290] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:53.706171 10140 ts_tablet_manager.cc:1403] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.000s
I20260709 13:00:53.706947 10145 raft_consensus.cc:493] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.707484 10145 raft_consensus.cc:515] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.703421 10065 leader_election.cc:304] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5; no voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:53.710183 10140 raft_consensus.cc:359] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.710984 10140 raft_consensus.cc:385] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.711323 10140 raft_consensus.cc:740] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.711623 10065 leader_election.cc:304] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:53.712754 10146 raft_consensus.cc:2749] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.712312 10140 consensus_queue.cc:260] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.713564 10146 raft_consensus.cc:2804] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.713979 10146 raft_consensus.cc:493] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.714425 10146 raft_consensus.cc:3060] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.715493 10140 ts_tablet_manager.cc:1434] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:53.716781 10140 tablet_bootstrap.cc:492] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:53.716853 10145 leader_election.cc:290] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:53.719717 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca30096d7f584656801568a185406bcc" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:53.725229 10140 tablet_bootstrap.cc:654] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.729552 10144 consensus_queue.cc:260] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
W20260709 13:00:53.737505 10065 leader_election.cc:343] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.738543 10144 ts_tablet_manager.cc:1434] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.001s
I20260709 13:00:53.739595 10144 tablet_bootstrap.cc:492] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:53.739935 10146 raft_consensus.cc:515] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.744999 10145 raft_consensus.cc:493] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.745532 10145 raft_consensus.cc:515] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.747663 10145 leader_election.cc:290] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:53.748930 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:53.749729 10026 raft_consensus.cc:3060] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.740434 10140 tablet_bootstrap.cc:492] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:53.751698 10140 ts_tablet_manager.cc:1403] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.003s
I20260709 13:00:53.754721 10140 raft_consensus.cc:359] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.755820 10140 raft_consensus.cc:385] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.756186 10140 raft_consensus.cc:740] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.757283 10140 consensus_queue.cc:260] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.759717 10140 ts_tablet_manager.cc:1434] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:00:53.760768 10140 tablet_bootstrap.cc:492] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:53.767242 10140 tablet_bootstrap.cc:654] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.763283 10146 leader_election.cc:290] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:53.774010 10026 raft_consensus.cc:2468] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:53.775739  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca30096d7f584656801568a185406bcc" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:53.775673 10065 leader_election.cc:304] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:53.776609  9952 raft_consensus.cc:2468] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:53.777205 10146 raft_consensus.cc:2804] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.777908 10146 raft_consensus.cc:697] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:53.778982 10146 consensus_queue.cc:237] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.779938  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:53.780037 10065 leader_election.cc:304] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:53.781040 10166 raft_consensus.cc:2804] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.781410 10166 raft_consensus.cc:493] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.781744 10166 raft_consensus.cc:3060] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:53.782990  9898 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:00:53.783535 10065 leader_election.cc:343] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.787581 10144 tablet_bootstrap.cc:654] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.788225 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:53.789175 10101 raft_consensus.cc:2468] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:53.792317 10140 tablet_bootstrap.cc:492] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:53.793094 10140 ts_tablet_manager.cc:1403] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.007s
I20260709 13:00:53.794987 10141 tablet_bootstrap.cc:492] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:53.795038 10145 raft_consensus.cc:493] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.795651 10141 ts_tablet_manager.cc:1403] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.114s	user 0.039s	sys 0.054s
I20260709 13:00:53.795674 10145 raft_consensus.cc:515] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.797118 10166 raft_consensus.cc:515] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:53.797941 10145 leader_election.cc:290] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:53.798871 10141 raft_consensus.cc:359] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.799579 10141 raft_consensus.cc:385] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.791154 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee1905ec0fd4bf384efe8a590b1b0c4" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:53.799856 10141 raft_consensus.cc:740] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.800089 10140 raft_consensus.cc:359] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.800361 10100 raft_consensus.cc:2468] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:53.791219  9915 leader_election.cc:304] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:53.800618 10141 consensus_queue.cc:260] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.802722  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca30096d7f584656801568a185406bcc" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:53.803283  9952 raft_consensus.cc:3060] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.800781 10140 raft_consensus.cc:385] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.803699 10140 raft_consensus.cc:740] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.804381 10140 consensus_queue.cc:260] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.802811 10145 raft_consensus.cc:2804] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.807238 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:53.809403  9915 leader_election.cc:304] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:53.823217 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c33c46c3f4bc43359933d049fb7fb85f" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:53.823791 10166 leader_election.cc:290] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:53.819962  9952 raft_consensus.cc:2468] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:53.824231 10101 raft_consensus.cc:2468] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:53.825338 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca30096d7f584656801568a185406bcc" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:53.824397 10145 raft_consensus.cc:493] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.826562 10145 raft_consensus.cc:3060] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.826864 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee1905ec0fd4bf384efe8a590b1b0c4" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:53.827502 10027 raft_consensus.cc:2468] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:53.807999 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c33c46c3f4bc43359933d049fb7fb85f" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:53.823534 10026 raft_consensus.cc:2468] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
W20260709 13:00:53.829541  9916 leader_election.cc:343] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:53.835163 10065 leader_election.cc:343] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.807170  9847 catalog_manager.cc:5697] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.836863 10144 tablet_bootstrap.cc:492] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:53.837378 10144 ts_tablet_manager.cc:1403] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.012s
I20260709 13:00:53.845818 10171 raft_consensus.cc:493] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.847730 10140 ts_tablet_manager.cc:1434] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.011s
I20260709 13:00:53.848225 10173 raft_consensus.cc:2804] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.847985 10171 raft_consensus.cc:515] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.849911 10145 raft_consensus.cc:515] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.848695 10173 raft_consensus.cc:493] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.851191 10173 raft_consensus.cc:3060] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.851272 10171 leader_election.cc:290] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:53.845916  9915 leader_election.cc:304] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:53.848877 10065 leader_election.cc:304] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:53.852944 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:53.854315 10171 raft_consensus.cc:2804] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.854656 10144 raft_consensus.cc:359] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.855211 10145 leader_election.cc:290] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:53.855437 10144 raft_consensus.cc:385] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.855799 10145 raft_consensus.cc:2804] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.855506 10141 ts_tablet_manager.cc:1434] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.059s	user 0.013s	sys 0.005s
I20260709 13:00:53.856235 10145 raft_consensus.cc:493] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.856840 10027 raft_consensus.cc:3060] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.858562 10145 raft_consensus.cc:3060] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.856006 10144 raft_consensus.cc:740] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.859879 10141 tablet_bootstrap.cc:492] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:53.857210 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:53.857797 10171 raft_consensus.cc:697] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:53.857023 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:53.862900 10171 consensus_queue.cc:237] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
W20260709 13:00:53.865454 10065 leader_election.cc:343] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.849112 10140 tablet_bootstrap.cc:492] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:53.863596 10101 raft_consensus.cc:3060] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.866214 10145 raft_consensus.cc:515] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.857803  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:53.869477 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c33c46c3f4bc43359933d049fb7fb85f" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:53.872759 10140 tablet_bootstrap.cc:654] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.871373 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c33c46c3f4bc43359933d049fb7fb85f" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:53.872952  9952 raft_consensus.cc:2468] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:53.873287 10100 raft_consensus.cc:3060] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.874166 10141 tablet_bootstrap.cc:654] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.874161 10065 leader_election.cc:304] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:53.860586 10144 consensus_queue.cc:260] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.871958 10145 leader_election.cc:290] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:53.875850 10166 raft_consensus.cc:2804] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.880865 10166 raft_consensus.cc:493] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.880981 10144 ts_tablet_manager.cc:1434] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:00:53.881256 10166 raft_consensus.cc:3060] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.882107 10144 tablet_bootstrap.cc:492] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:53.876583 10026 raft_consensus.cc:3060] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.884394 10100 raft_consensus.cc:2468] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:53.885118 10101 raft_consensus.cc:2468] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:53.885591  9915 leader_election.cc:304] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:53.886449 10145 raft_consensus.cc:2804] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.886744  9915 leader_election.cc:304] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:53.887050 10145 raft_consensus.cc:697] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:53.888028 10172 raft_consensus.cc:2804] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.888062 10145 consensus_queue.cc:237] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.896883 10144 tablet_bootstrap.cc:654] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.897514 10171 raft_consensus.cc:493] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.898864 10171 raft_consensus.cc:515] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.902609 10027 raft_consensus.cc:2468] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:53.895190 10173 raft_consensus.cc:515] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.907480 10172 raft_consensus.cc:697] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:53.909305 10172 consensus_queue.cc:237] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.912355  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:53.912637 10166 raft_consensus.cc:515] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.913744 10026 raft_consensus.cc:2468] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:53.914740 10166 leader_election.cc:290] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
W20260709 13:00:53.915409 10065 leader_election.cc:343] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.916500 10171 leader_election.cc:290] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:53.921499 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:53.922164  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:53.922744  9952 raft_consensus.cc:3060] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.922648 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:53.923092 10173 leader_election.cc:290] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:53.924526 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee1905ec0fd4bf384efe8a590b1b0c4" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:53.923354 10024 raft_consensus.cc:2468] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:53.925169 10101 raft_consensus.cc:3060] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:53.926328 10065 leader_election.cc:343] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.927157 10140 tablet_bootstrap.cc:492] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:53.927616 10140 ts_tablet_manager.cc:1403] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.004s
I20260709 13:00:53.928093 10065 leader_election.cc:304] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:53.927711 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee1905ec0fd4bf384efe8a590b1b0c4" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:53.929596 10027 raft_consensus.cc:3060] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.929618 10171 raft_consensus.cc:2804] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.930162 10171 raft_consensus.cc:493] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.930529 10171 raft_consensus.cc:3060] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.930359 10140 raft_consensus.cc:359] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.931109 10140 raft_consensus.cc:385] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.931382 10140 raft_consensus.cc:740] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.932749 10140 consensus_queue.cc:260] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.934955 10140 ts_tablet_manager.cc:1434] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:53.936602 10101 raft_consensus.cc:2468] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:53.937333 10141 tablet_bootstrap.cc:492] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:53.938581  9915 leader_election.cc:304] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:53.940513 10027 raft_consensus.cc:2468] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:53.941021 10141 ts_tablet_manager.cc:1403] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.016s
I20260709 13:00:53.941471 10145 raft_consensus.cc:2804] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.942196 10145 raft_consensus.cc:697] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:53.942474  9952 raft_consensus.cc:2468] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:53.943640 10065 leader_election.cc:304] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:53.939913 10171 raft_consensus.cc:515] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.944458 10166 raft_consensus.cc:2804] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.944953 10166 raft_consensus.cc:697] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:53.943318 10145 consensus_queue.cc:237] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.945796 10166 consensus_queue.cc:237] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.949608 10144 tablet_bootstrap.cc:492] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:53.950142 10144 ts_tablet_manager.cc:1403] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.018s
I20260709 13:00:53.953258 10144 raft_consensus.cc:359] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.953953 10144 raft_consensus.cc:385] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.954227 10144 raft_consensus.cc:740] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.954828 10171 leader_election.cc:290] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:53.944967 10141 raft_consensus.cc:359] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.956076  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:53.955263 10144 consensus_queue.cc:260] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.956837 10141 raft_consensus.cc:385] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:53.957535 10065 leader_election.cc:343] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.958289 10141 raft_consensus.cc:740] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.958458 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:53.958747 10144 ts_tablet_manager.cc:1434] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:00:53.959085 10026 raft_consensus.cc:3060] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.959239 10141 consensus_queue.cc:260] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.959864 10144 tablet_bootstrap.cc:492] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:53.961851 10141 ts_tablet_manager.cc:1434] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 13:00:53.963670 10141 tablet_bootstrap.cc:492] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:53.967690 10144 tablet_bootstrap.cc:654] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.971616 10141 tablet_bootstrap.cc:654] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.972239 10026 raft_consensus.cc:2468] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:53.973469 10065 leader_election.cc:304] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:53.977145 10166 raft_consensus.cc:2804] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.977607 10166 raft_consensus.cc:697] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:53.973065  9850 catalog_manager.cc:5697] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 0 to 1, leader changed from <none> to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.978374 10166 consensus_queue.cc:237] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.993028 10144 tablet_bootstrap.cc:492] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:53.993762 10144 ts_tablet_manager.cc:1403] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.004s
I20260709 13:00:53.997180 10144 raft_consensus.cc:359] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:53.997956 10144 raft_consensus.cc:385] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.998294 10144 raft_consensus.cc:740] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.999190 10144 consensus_queue.cc:260] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.000792  9847 catalog_manager.cc:5697] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.001819 10144 ts_tablet_manager.cc:1434] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:54.002781  9847 catalog_manager.cc:5697] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.003938 10144 tablet_bootstrap.cc:492] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:54.005751  9847 catalog_manager.cc:5697] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.010310 10144 tablet_bootstrap.cc:654] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.012688 10141 tablet_bootstrap.cc:492] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:54.013376 10141 ts_tablet_manager.cc:1403] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.013s
I20260709 13:00:54.014971  9849 catalog_manager.cc:5697] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 0 to 1, leader changed from <none> to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.016958 10141 raft_consensus.cc:359] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.016884  9849 catalog_manager.cc:5697] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 0 to 1, leader changed from <none> to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.018069 10141 raft_consensus.cc:385] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.018549 10141 raft_consensus.cc:740] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.019518 10141 consensus_queue.cc:260] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.022271 10141 ts_tablet_manager.cc:1434] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:00:54.023523 10141 tablet_bootstrap.cc:492] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:54.033418 10141 tablet_bootstrap.cc:654] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.033432 10144 tablet_bootstrap.cc:492] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:54.034130 10144 ts_tablet_manager.cc:1403] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.019s
I20260709 13:00:54.037514 10144 raft_consensus.cc:359] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.038378 10144 raft_consensus.cc:385] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.038744 10144 raft_consensus.cc:740] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.039242 10145 raft_consensus.cc:493] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.039800 10145 raft_consensus.cc:515] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.039659 10144 consensus_queue.cc:260] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.042281 10145 leader_election.cc:290] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.043067 10144 ts_tablet_manager.cc:1434] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:00:54.044310 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878a515f14e34721ad3705dfd1ed2e21" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:54.044998 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878a515f14e34721ad3705dfd1ed2e21" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:54.045683 10026 raft_consensus.cc:2468] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:54.045009 10101 raft_consensus.cc:2468] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:54.046998  9916 leader_election.cc:304] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:54.049300 10144 tablet_bootstrap.cc:492] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:54.049295 10145 raft_consensus.cc:2804] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.050143 10145 raft_consensus.cc:493] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.050514 10145 raft_consensus.cc:3060] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.057716 10144 tablet_bootstrap.cc:654] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.059485 10141 tablet_bootstrap.cc:492] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:54.058936 10145 raft_consensus.cc:515] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.060184 10141 ts_tablet_manager.cc:1403] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.016s
I20260709 13:00:54.062002 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878a515f14e34721ad3705dfd1ed2e21" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:54.062599 10026 raft_consensus.cc:3060] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.064307 10141 raft_consensus.cc:359] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.065342 10141 raft_consensus.cc:385] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.065733 10141 raft_consensus.cc:740] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.066762 10141 consensus_queue.cc:260] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.068912 10141 ts_tablet_manager.cc:1434] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:54.070722 10144 tablet_bootstrap.cc:492] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:54.071205 10144 ts_tablet_manager.cc:1403] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:00:54.071362 10145 leader_election.cc:290] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.072855 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878a515f14e34721ad3705dfd1ed2e21" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:54.073549 10101 raft_consensus.cc:3060] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.073678 10144 raft_consensus.cc:359] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:54.074414 10144 raft_consensus.cc:385] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.074688 10144 raft_consensus.cc:740] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.075327 10144 consensus_queue.cc:260] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:54.070761 10026 raft_consensus.cc:2468] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:54.076953 10144 ts_tablet_manager.cc:1434] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:00:54.078049  9916 leader_election.cc:304] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:54.078814 10145 raft_consensus.cc:2804] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.079236 10145 raft_consensus.cc:697] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:54.079867 10101 raft_consensus.cc:2468] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:54.079922 10145 consensus_queue.cc:237] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.088821  9847 catalog_manager.cc:5697] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 0 to 1, leader changed from <none> to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.237008 10149 raft_consensus.cc:493] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.237532 10149 raft_consensus.cc:515] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.239791 10149 leader_election.cc:290] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.250573  9952 raft_consensus.cc:3060] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.251888  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:54.252853  9951 raft_consensus.cc:2393] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2699f38b6db94b80a69602c698e857d9 in current term 1: Already voted for candidate 88cb686af2664080b74b65fbcfe1a0e5 in this term.
I20260709 13:00:54.252784 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:54.254314  9990 leader_election.cc:304] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9; no voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:54.255013 10149 raft_consensus.cc:3060] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.259651 10166 consensus_queue.cc:1048] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.261926 10149 raft_consensus.cc:2749] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.265413 10026 raft_consensus.cc:3060] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.275609 10171 consensus_queue.cc:1048] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.276790 10166 consensus_queue.cc:1048] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.296327 10145 consensus_queue.cc:1048] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.298166 10171 consensus_queue.cc:1048] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.299610 10145 raft_consensus.cc:493] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.300177 10145 raft_consensus.cc:515] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.302456 10145 leader_election.cc:290] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.303095 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:54.303910 10027 raft_consensus.cc:2393] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e659c6ee3bc84b9f8f15bf8794c6a918 in current term 1: Already voted for candidate 88cb686af2664080b74b65fbcfe1a0e5 in this term.
I20260709 13:00:54.305313 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:54.307024 10172 consensus_queue.cc:1048] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.307216  9915 leader_election.cc:304] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:00:54.308386 10172 raft_consensus.cc:3060] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.308705 10173 consensus_queue.cc:1048] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.314112 10145 consensus_queue.cc:1048] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.316427 10172 raft_consensus.cc:2749] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.348371 10145 consensus_queue.cc:1048] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.362077 10172 consensus_queue.cc:1048] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.364174 10171 consensus_queue.cc:1048] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.382300 10166 consensus_queue.cc:1048] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.387424 10149 raft_consensus.cc:493] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.387951 10149 raft_consensus.cc:515] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.389798 10149 leader_election.cc:290] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.390539  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:54.391305  9952 raft_consensus.cc:2468] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 0.
I20260709 13:00:54.391283 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:54.392264 10100 raft_consensus.cc:2468] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 0.
I20260709 13:00:54.392895  9991 leader_election.cc:304] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:54.393748 10149 raft_consensus.cc:2804] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.394168 10149 raft_consensus.cc:493] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.394462 10149 raft_consensus.cc:3060] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.400157 10149 raft_consensus.cc:515] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.402534  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:54.403090  9952 raft_consensus.cc:3060] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.403054 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:54.403828 10100 raft_consensus.cc:3060] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.404769 10149 leader_election.cc:290] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.408993  9952 raft_consensus.cc:2468] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 1.
I20260709 13:00:54.410152  9991 leader_election.cc:304] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:54.410825 10100 raft_consensus.cc:2468] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 1.
I20260709 13:00:54.410977 10149 raft_consensus.cc:2804] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.411580 10149 raft_consensus.cc:697] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:54.412858 10149 consensus_queue.cc:237] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.420176  9847 catalog_manager.cc:5697] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.508265 10146 consensus_queue.cc:1048] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.524333 10171 consensus_queue.cc:1048] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.634780 10172 consensus_queue.cc:1048] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.654721 10172 consensus_queue.cc:1048] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.661259 10101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca30096d7f584656801568a185406bcc"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
mode: GRACEFUL
new_leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:00:54.662259 10101 raft_consensus.cc:606] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Received request to transfer leadership to TS e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:54.679013 10026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
mode: GRACEFUL
new_leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:60032
I20260709 13:00:54.679572 10026 raft_consensus.cc:606] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Received request to transfer leadership to TS e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:54.685010 10100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
mode: GRACEFUL
new_leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:00:54.685503 10100 raft_consensus.cc:606] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Received request to transfer leadership to TS e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:54.690112 10100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
mode: GRACEFUL
new_leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:00:54.690573 10100 raft_consensus.cc:606] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Received request to transfer leadership to TS e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:54.705406  9952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c33c46c3f4bc43359933d049fb7fb85f"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
mode: GRACEFUL
new_leader_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:36356
I20260709 13:00:54.705909  9952 raft_consensus.cc:606] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Received request to transfer leadership to TS 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:54.710984 10100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
mode: GRACEFUL
new_leader_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:00:54.711483 10100 raft_consensus.cc:606] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Received request to transfer leadership to TS 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:54.716125  9952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "878a515f14e34721ad3705dfd1ed2e21"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
mode: GRACEFUL
new_leader_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:36356
I20260709 13:00:54.716602  9952 raft_consensus.cc:606] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Received request to transfer leadership to TS 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:54.721382  9952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
mode: GRACEFUL
new_leader_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:36356
I20260709 13:00:54.721855  9952 raft_consensus.cc:606] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Received request to transfer leadership to TS 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:54.726519  9952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ee1905ec0fd4bf384efe8a590b1b0c4"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
mode: GRACEFUL
new_leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:36356
I20260709 13:00:54.726975  9952 raft_consensus.cc:606] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Received request to transfer leadership to TS 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:00:54.745630 10173 raft_consensus.cc:993] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918: : Instructing follower 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:54.746061 10172 raft_consensus.cc:1081] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Signalling peer 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:54.747574 10027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c33c46c3f4bc43359933d049fb7fb85f"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:60020
I20260709 13:00:54.748052 10027 raft_consensus.cc:493] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.748353 10027 raft_consensus.cc:3060] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.756297 10166 raft_consensus.cc:993] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5: : Instructing follower e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:54.756878 10171 raft_consensus.cc:1081] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Signalling peer e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:54.757912 10027 raft_consensus.cc:515] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.758603  9952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca30096d7f584656801568a185406bcc"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:00:54.759279  9952 raft_consensus.cc:493] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.759665  9952 raft_consensus.cc:3060] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.760829 10027 leader_election.cc:290] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.761612  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c33c46c3f4bc43359933d049fb7fb85f" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:54.761976 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c33c46c3f4bc43359933d049fb7fb85f" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:54.762364  9951 raft_consensus.cc:3055] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.762785  9951 raft_consensus.cc:740] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:54.762837 10100 raft_consensus.cc:3060] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.763978  9951 consensus_queue.cc:260] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.765836  9951 raft_consensus.cc:3060] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.769958  9952 raft_consensus.cc:515] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:54.772490  9951 raft_consensus.cc:2468] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:54.772869  9952 leader_election.cc:290] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Requested vote from peers 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:54.773005 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca30096d7f584656801568a185406bcc" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:54.773332 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca30096d7f584656801568a185406bcc" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:54.773850 10101 raft_consensus.cc:3055] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.773918 10027 raft_consensus.cc:3060] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.774223 10101 raft_consensus.cc:740] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:54.773926  9991 leader_election.cc:304] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:54.775980 10149 raft_consensus.cc:2804] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.776556 10149 raft_consensus.cc:697] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:54.777069 10100 raft_consensus.cc:2468] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:54.775481 10101 consensus_queue.cc:260] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:54.777779 10149 consensus_queue.cc:237] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.779350 10101 raft_consensus.cc:3060] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.787432 10101 raft_consensus.cc:2468] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:54.788796  9915 leader_election.cc:304] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:54.789475 10027 raft_consensus.cc:2468] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:54.789835 10172 raft_consensus.cc:2804] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.790431 10172 raft_consensus.cc:697] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:54.791430 10172 consensus_queue.cc:237] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } }
I20260709 13:00:54.790903  9847 catalog_manager.cc:5697] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 1 to 2, leader changed from e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193) to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.804106  9849 catalog_manager.cc:5697] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 1 to 2, leader changed from 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195) to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.823424 10149 consensus_queue.cc:1048] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.835412 10213 consensus_queue.cc:1048] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.843741 10149 raft_consensus.cc:993] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9: : Instructing follower e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:54.844215 10213 raft_consensus.cc:1081] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Signalling peer e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:54.845729  9952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:36354
I20260709 13:00:54.846221  9952 raft_consensus.cc:493] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.846510  9952 raft_consensus.cc:3060] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.852213  9952 raft_consensus.cc:515] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.854149  9952 leader_election.cc:290] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.855037 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:54.855715 10027 raft_consensus.cc:3055] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.856063 10027 raft_consensus.cc:740] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:54.856499 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50184a86a9c45e1b0d49d54c0960a7a" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:54.857247 10101 raft_consensus.cc:3060] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.857069 10027 consensus_queue.cc:260] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.858579 10027 raft_consensus.cc:3060] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.862778 10166 raft_consensus.cc:993] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5: : Instructing follower e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:54.863292 10166 raft_consensus.cc:1081] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Signalling peer e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:54.864775 10173 raft_consensus.cc:993] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918: : Instructing follower 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:00:54.865305 10173 raft_consensus.cc:1081] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Signalling peer 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:00:54.865353  9952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:00:54.866089  9952 raft_consensus.cc:493] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.866505  9952 raft_consensus.cc:3060] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.867043 10101 raft_consensus.cc:2468] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:54.867578 10100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ee1905ec0fd4bf384efe8a590b1b0c4"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:50688
I20260709 13:00:54.868189 10100 raft_consensus.cc:493] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.868443  9915 leader_election.cc:304] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:54.868602 10100 raft_consensus.cc:3060] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.869364 10172 raft_consensus.cc:2804] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.869876 10172 raft_consensus.cc:697] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:54.870637 10027 raft_consensus.cc:2468] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:54.870940 10172 consensus_queue.cc:237] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.874053  9952 raft_consensus.cc:515] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.876960 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:54.877321 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:54.877526 10027 raft_consensus.cc:3060] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.877929 10101 raft_consensus.cc:3055] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.878315 10101 raft_consensus.cc:740] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:54.878438  9952 leader_election.cc:290] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.879724 10101 consensus_queue.cc:260] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.879874 10100 raft_consensus.cc:515] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.881306 10101 raft_consensus.cc:3060] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.880735  9847 catalog_manager.cc:5697] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 1 to 2, leader changed from 2699f38b6db94b80a69602c698e857d9 (127.0.107.194) to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.882201 10100 leader_election.cc:290] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:54.883298 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee1905ec0fd4bf384efe8a590b1b0c4" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:54.884024 10026 raft_consensus.cc:3060] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.884267  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee1905ec0fd4bf384efe8a590b1b0c4" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:54.884893  9952 raft_consensus.cc:3055] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.885210  9952 raft_consensus.cc:740] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:54.885601 10027 raft_consensus.cc:2468] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:54.886219  9952 consensus_queue.cc:260] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.887156  9916 leader_election.cc:304] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:54.888182  9952 raft_consensus.cc:3060] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.888177 10172 raft_consensus.cc:2804] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.890774 10172 raft_consensus.cc:697] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:54.891873 10172 consensus_queue.cc:237] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.894063 10026 raft_consensus.cc:2468] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 2.
I20260709 13:00:54.895043 10101 raft_consensus.cc:2468] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:54.895416 10065 leader_election.cc:304] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:54.896288  9952 raft_consensus.cc:2468] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 2.
I20260709 13:00:54.896584 10171 raft_consensus.cc:2804] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.897220 10171 raft_consensus.cc:697] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:54.898201 10171 consensus_queue.cc:237] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.904328  9847 catalog_manager.cc:5697] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 1 to 2, leader changed from 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195) to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.905869  9849 catalog_manager.cc:5697] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 1 to 2, leader changed from e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193) to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.934945 10173 raft_consensus.cc:993] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918: : Instructing follower 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:54.935460 10172 raft_consensus.cc:1081] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Signalling peer 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:54.936930 10026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:60020
I20260709 13:00:54.937410 10026 raft_consensus.cc:493] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.937706 10026 raft_consensus.cc:3060] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.942902 10026 raft_consensus.cc:515] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.944710 10026 leader_election.cc:290] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.945286  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:54.945709 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:54.945910  9952 raft_consensus.cc:3055] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.946344  9952 raft_consensus.cc:740] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:54.946413 10101 raft_consensus.cc:3060] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.947436  9952 consensus_queue.cc:260] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.948966  9952 raft_consensus.cc:3060] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.953091 10101 raft_consensus.cc:2468] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:54.954398  9952 raft_consensus.cc:2468] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:54.954458  9990 leader_election.cc:304] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:54.955492 10213 raft_consensus.cc:2804] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.955924 10213 raft_consensus.cc:697] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:54.956987 10213 consensus_queue.cc:237] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.964552 10146 raft_consensus.cc:993] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5: : Instructing follower e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:54.965135 10171 raft_consensus.cc:1081] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Signalling peer e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:54.964293  9849 catalog_manager.cc:5697] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 1 to 2, leader changed from e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193) to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.966888  9952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:00:54.967410  9952 raft_consensus.cc:493] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.967753  9952 raft_consensus.cc:3060] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.973558  9952 raft_consensus.cc:515] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.975095  9952 leader_election.cc:290] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:54.975786 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:54.976119 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8629656f32e34e5a87dcebf312b5ea0e" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:54.976445 10026 raft_consensus.cc:3060] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.976761 10101 raft_consensus.cc:3055] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.977101 10101 raft_consensus.cc:740] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:54.977974 10101 consensus_queue.cc:260] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.979300 10101 raft_consensus.cc:3060] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.983738 10026 raft_consensus.cc:2468] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:54.984885  9916 leader_election.cc:304] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:54.985558 10172 raft_consensus.cc:2804] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.985967 10172 raft_consensus.cc:697] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:54.985980 10101 raft_consensus.cc:2468] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:54.986984 10172 consensus_queue.cc:237] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:54.992898  9849 catalog_manager.cc:5697] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 1 to 2, leader changed from 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195) to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.008960 10166 raft_consensus.cc:993] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5: : Instructing follower 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:55.009460 10171 raft_consensus.cc:1081] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Signalling peer 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:55.010939 10026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:60014
I20260709 13:00:55.011533 10026 raft_consensus.cc:493] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:55.011938 10026 raft_consensus.cc:3060] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:55.017055 10026 raft_consensus.cc:515] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:55.018608 10026 leader_election.cc:290] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:55.019373  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:55.019652 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b90e8db2f9848a88f0dcec6a384a4b7" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:55.020112  9952 raft_consensus.cc:3060] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:55.020244 10101 raft_consensus.cc:3055] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:55.020697 10101 raft_consensus.cc:740] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:55.021585 10101 consensus_queue.cc:260] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:55.022891 10101 raft_consensus.cc:3060] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:55.027426  9952 raft_consensus.cc:2468] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:55.028797  9991 leader_election.cc:304] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:55.029498 10213 raft_consensus.cc:2804] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:55.029801 10101 raft_consensus.cc:2468] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:55.029920 10213 raft_consensus.cc:697] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:55.031180 10213 consensus_queue.cc:237] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:55.037739 10173 raft_consensus.cc:993] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918: : Instructing follower 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:55.038225 10172 raft_consensus.cc:1081] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Signalling peer 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:55.037840  9849 catalog_manager.cc:5697] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 1 to 2, leader changed from 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195) to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.039775 10026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "878a515f14e34721ad3705dfd1ed2e21"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:60020
I20260709 13:00:55.040252 10026 raft_consensus.cc:493] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:55.040611 10026 raft_consensus.cc:3060] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:55.047788 10026 raft_consensus.cc:515] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:55.050285  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878a515f14e34721ad3705dfd1ed2e21" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:55.050945  9952 raft_consensus.cc:3055] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:55.050015 10026 leader_election.cc:290] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:55.051364  9952 raft_consensus.cc:740] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:55.051236 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878a515f14e34721ad3705dfd1ed2e21" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:55.052229 10101 raft_consensus.cc:3060] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:55.052824  9952 consensus_queue.cc:260] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:55.053980  9952 raft_consensus.cc:3060] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:55.057663 10101 raft_consensus.cc:2468] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:55.058619  9990 leader_election.cc:304] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:55.058853  9952 raft_consensus.cc:2468] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:55.059324 10213 raft_consensus.cc:2804] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:55.059859 10213 raft_consensus.cc:697] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:55.060860 10213 consensus_queue.cc:237] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:55.066847  9849 catalog_manager.cc:5697] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 1 to 2, leader changed from e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193) to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.238761 10101 raft_consensus.cc:1275] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.240000 10213 consensus_queue.cc:1048] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.248838  9952 raft_consensus.cc:1275] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.251019 10224 consensus_queue.cc:1048] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:55.306761 10101 raft_consensus.cc:1275] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.308121 10172 consensus_queue.cc:1048] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.317461 10026 raft_consensus.cc:1275] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.322007 10226 consensus_queue.cc:1048] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:55.333079 10026 raft_consensus.cc:1275] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.334767 10226 consensus_queue.cc:1048] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.344403 10101 raft_consensus.cc:1275] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.346549 10172 consensus_queue.cc:1048] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:55.375020 10026 raft_consensus.cc:1275] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.376132 10171 consensus_queue.cc:1048] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.385993  9952 raft_consensus.cc:1275] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.388144 10166 consensus_queue.cc:1048] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.412770 10101 raft_consensus.cc:1275] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.413944 10224 consensus_queue.cc:1048] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.422421  9952 raft_consensus.cc:1275] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.423758 10213 consensus_queue.cc:1048] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.432327 10101 raft_consensus.cc:1275] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.433297 10100 raft_consensus.cc:1275] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.433583 10224 consensus_queue.cc:1048] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.434731 10173 consensus_queue.cc:1048] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.437536 10026 raft_consensus.cc:1275] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.439208 10226 consensus_queue.cc:1048] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.452127  9952 raft_consensus.cc:1275] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.453568 10213 consensus_queue.cc:1048] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.469535 10026 raft_consensus.cc:1275] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.470789 10226 consensus_queue.cc:1048] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.478165 10101 raft_consensus.cc:1275] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.480412 10229 consensus_queue.cc:1048] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:55.510161  9952 raft_consensus.cc:1275] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.510787 10101 raft_consensus.cc:1275] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:55.511416 10213 consensus_queue.cc:1048] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.512255 10149 consensus_queue.cc:1048] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:57.759303  9849 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49300:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:57.761893  9849 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:57.810738  9940 tablet_service.cc:1511] Processing CreateTablet for tablet 6a7e9eef6d1c46ee8e8f6c6f698a636b (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:57.812033 10017 tablet_service.cc:1511] Processing CreateTablet for tablet 6a7e9eef6d1c46ee8e8f6c6f698a636b (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:57.812448  9940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a7e9eef6d1c46ee8e8f6c6f698a636b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.813664 10017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a7e9eef6d1c46ee8e8f6c6f698a636b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.814636  9939 tablet_service.cc:1511] Processing CreateTablet for tablet feca2d7a1d3a4b08a2d5a023325be891 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:57.816072  9939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feca2d7a1d3a4b08a2d5a023325be891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.817950 10085 tablet_service.cc:1511] Processing CreateTablet for tablet 6a7e9eef6d1c46ee8e8f6c6f698a636b (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:57.819375 10085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a7e9eef6d1c46ee8e8f6c6f698a636b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.823051 10014 tablet_service.cc:1511] Processing CreateTablet for tablet feca2d7a1d3a4b08a2d5a023325be891 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:57.823378 10016 tablet_service.cc:1511] Processing CreateTablet for tablet da0e2afd632c4cf299c5f74f63635e81 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:57.824410 10014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feca2d7a1d3a4b08a2d5a023325be891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.825122 10016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0e2afd632c4cf299c5f74f63635e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.825316 10086 tablet_service.cc:1511] Processing CreateTablet for tablet feca2d7a1d3a4b08a2d5a023325be891 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:57.826736 10086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feca2d7a1d3a4b08a2d5a023325be891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.826675 10088 tablet_service.cc:1511] Processing CreateTablet for tablet da0e2afd632c4cf299c5f74f63635e81 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:57.828392 10088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0e2afd632c4cf299c5f74f63635e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.828764  9937 tablet_service.cc:1511] Processing CreateTablet for tablet da0e2afd632c4cf299c5f74f63635e81 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:57.830194  9937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0e2afd632c4cf299c5f74f63635e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.832617 10011 tablet_service.cc:1511] Processing CreateTablet for tablet d706cb125080468783b3987e92aab002 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
W20260709 13:00:57.833523  9898 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:57.836938 10011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d706cb125080468783b3987e92aab002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.842602 10087 tablet_service.cc:1511] Processing CreateTablet for tablet d706cb125080468783b3987e92aab002 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:57.843936 10087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d706cb125080468783b3987e92aab002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.846276  9936 tablet_service.cc:1511] Processing CreateTablet for tablet af2da0d8f14548768d3745299b61f088 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:57.847786  9936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2da0d8f14548768d3745299b61f088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.849376 10013 tablet_service.cc:1511] Processing CreateTablet for tablet af2da0d8f14548768d3745299b61f088 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:57.850690 10013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2da0d8f14548768d3745299b61f088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.848457 10090 tablet_service.cc:1511] Processing CreateTablet for tablet af2da0d8f14548768d3745299b61f088 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:57.853856 10090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2da0d8f14548768d3745299b61f088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.858233  9938 tablet_service.cc:1511] Processing CreateTablet for tablet aa0d6d3137224a629a998208779353a7 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:57.859092 10010 tablet_service.cc:1511] Processing CreateTablet for tablet aa0d6d3137224a629a998208779353a7 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:57.859556  9938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0d6d3137224a629a998208779353a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.860410 10010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0d6d3137224a629a998208779353a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.861877 10089 tablet_service.cc:1511] Processing CreateTablet for tablet aa0d6d3137224a629a998208779353a7 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:57.863138 10089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0d6d3137224a629a998208779353a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.865337 10091 tablet_service.cc:1511] Processing CreateTablet for tablet ce081aca9e734696b10214e4e05801c4 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:57.866618 10091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce081aca9e734696b10214e4e05801c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.869832 10015 tablet_service.cc:1511] Processing CreateTablet for tablet ce081aca9e734696b10214e4e05801c4 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:57.871101 10015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce081aca9e734696b10214e4e05801c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.872074 10084 tablet_service.cc:1511] Processing CreateTablet for tablet 281909f0fd0e4c80bc38770538e9debf (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:57.873383 10084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281909f0fd0e4c80bc38770538e9debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.873991 10012 tablet_service.cc:1511] Processing CreateTablet for tablet 281909f0fd0e4c80bc38770538e9debf (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:57.875303 10012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281909f0fd0e4c80bc38770538e9debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.879709 10009 tablet_service.cc:1511] Processing CreateTablet for tablet d7afd881cc7747ba8a4706311f72156c (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:57.881031 10009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7afd881cc7747ba8a4706311f72156c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.882458  9935 tablet_service.cc:1511] Processing CreateTablet for tablet ce081aca9e734696b10214e4e05801c4 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:57.882867 10083 tablet_service.cc:1511] Processing CreateTablet for tablet d7afd881cc7747ba8a4706311f72156c (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:57.883838  9935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce081aca9e734696b10214e4e05801c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.886066  9934 tablet_service.cc:1511] Processing CreateTablet for tablet 281909f0fd0e4c80bc38770538e9debf (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:57.887328  9934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281909f0fd0e4c80bc38770538e9debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.884531 10083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7afd881cc7747ba8a4706311f72156c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.827032  9941 tablet_service.cc:1511] Processing CreateTablet for tablet d706cb125080468783b3987e92aab002 (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:57.904626  9941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d706cb125080468783b3987e92aab002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.909096  9942 tablet_service.cc:1511] Processing CreateTablet for tablet d7afd881cc7747ba8a4706311f72156c (DEFAULT_TABLE table=soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:57.910878  9942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7afd881cc7747ba8a4706311f72156c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.955693 10248 tablet_bootstrap.cc:492] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:58.010201 10249 tablet_bootstrap.cc:492] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:58.024413 10252 tablet_bootstrap.cc:492] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:58.034543 10248 tablet_bootstrap.cc:654] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.041567 10249 tablet_bootstrap.cc:654] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.043128 10252 tablet_bootstrap.cc:654] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.055037 10249 tablet_bootstrap.cc:492] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:58.055657 10249 ts_tablet_manager.cc:1403] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.000s
I20260709 13:00:58.058773 10249 raft_consensus.cc:359] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.060738 10249 raft_consensus.cc:385] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.061105 10249 raft_consensus.cc:740] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.061883 10249 consensus_queue.cc:260] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.064253 10248 tablet_bootstrap.cc:492] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:58.064718 10249 ts_tablet_manager.cc:1434] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:00:58.066573 10248 ts_tablet_manager.cc:1403] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.027s
I20260709 13:00:58.067155 10249 tablet_bootstrap.cc:492] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:58.070550 10248 raft_consensus.cc:359] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.071599 10248 raft_consensus.cc:385] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.072052 10248 raft_consensus.cc:740] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.073119 10248 consensus_queue.cc:260] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.075019 10249 tablet_bootstrap.cc:654] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.076311 10248 ts_tablet_manager.cc:1434] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:00:58.077781 10248 tablet_bootstrap.cc:492] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:58.091475 10248 tablet_bootstrap.cc:654] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.092099 10249 tablet_bootstrap.cc:492] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:58.092730 10249 ts_tablet_manager.cc:1403] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:00:58.095901 10249 raft_consensus.cc:359] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.096911 10249 raft_consensus.cc:385] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.097246 10249 raft_consensus.cc:740] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.098133 10249 consensus_queue.cc:260] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.100775 10249 ts_tablet_manager.cc:1434] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:58.101804 10249 tablet_bootstrap.cc:492] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:58.104856 10248 tablet_bootstrap.cc:492] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:58.106057 10248 ts_tablet_manager.cc:1403] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.007s
I20260709 13:00:58.108311 10249 tablet_bootstrap.cc:654] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.110306 10248 raft_consensus.cc:359] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.111340 10248 raft_consensus.cc:385] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.111706 10248 raft_consensus.cc:740] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.112509 10248 consensus_queue.cc:260] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.113544 10252 tablet_bootstrap.cc:492] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:58.114074 10252 ts_tablet_manager.cc:1403] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.090s	user 0.036s	sys 0.043s
I20260709 13:00:58.114601 10249 tablet_bootstrap.cc:492] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:58.115000 10248 ts_tablet_manager.cc:1434] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:00:58.115088 10249 ts_tablet_manager.cc:1403] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:00:58.116137 10248 tablet_bootstrap.cc:492] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:58.117162 10252 raft_consensus.cc:359] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.117923 10252 raft_consensus.cc:385] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.118204 10252 raft_consensus.cc:740] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.118491 10249 raft_consensus.cc:359] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.119349 10249 raft_consensus.cc:385] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.118939 10252 consensus_queue.cc:260] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.119649 10249 raft_consensus.cc:740] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.120385 10249 consensus_queue.cc:260] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.122128 10252 ts_tablet_manager.cc:1434] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:58.123257 10252 tablet_bootstrap.cc:492] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:58.125056 10249 ts_tablet_manager.cc:1434] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:00:58.126158 10249 tablet_bootstrap.cc:492] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:58.130179 10252 tablet_bootstrap.cc:654] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.130174 10248 tablet_bootstrap.cc:654] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.132706 10249 tablet_bootstrap.cc:654] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.143886 10248 tablet_bootstrap.cc:492] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:58.144361 10248 ts_tablet_manager.cc:1403] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.008s
I20260709 13:00:58.147716 10252 tablet_bootstrap.cc:492] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:58.147594 10248 raft_consensus.cc:359] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.148280 10252 ts_tablet_manager.cc:1403] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 13:00:58.148392 10248 raft_consensus.cc:385] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.148854 10248 raft_consensus.cc:740] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.149703 10248 consensus_queue.cc:260] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.151628 10252 raft_consensus.cc:359] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.152058 10248 ts_tablet_manager.cc:1434] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:58.152441 10252 raft_consensus.cc:385] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.152825 10252 raft_consensus.cc:740] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.153328 10248 tablet_bootstrap.cc:492] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:58.153854 10249 tablet_bootstrap.cc:492] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:58.153615 10252 consensus_queue.cc:260] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.154439 10249 ts_tablet_manager.cc:1403] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 13:00:58.156343 10252 ts_tablet_manager.cc:1434] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:58.157531 10252 tablet_bootstrap.cc:492] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:58.157548 10249 raft_consensus.cc:359] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.158494 10249 raft_consensus.cc:385] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.159253 10249 raft_consensus.cc:740] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.160120 10249 consensus_queue.cc:260] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.161335 10248 tablet_bootstrap.cc:654] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.162478 10249 ts_tablet_manager.cc:1434] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:00:58.163520 10249 tablet_bootstrap.cc:492] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:58.167299 10252 tablet_bootstrap.cc:654] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.176422 10249 tablet_bootstrap.cc:654] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.176975 10248 tablet_bootstrap.cc:492] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:58.177101 10252 tablet_bootstrap.cc:492] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:58.177577 10248 ts_tablet_manager.cc:1403] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 13:00:58.177647 10252 ts_tablet_manager.cc:1403] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:00:58.180691 10252 raft_consensus.cc:359] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.180884 10248 raft_consensus.cc:359] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.181445 10252 raft_consensus.cc:385] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.181651 10248 raft_consensus.cc:385] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.181806 10252 raft_consensus.cc:740] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.182044 10248 raft_consensus.cc:740] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.182128 10249 tablet_bootstrap.cc:492] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:58.182648 10252 consensus_queue.cc:260] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.182897 10248 consensus_queue.cc:260] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.183560 10251 raft_consensus.cc:493] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.184041 10251 raft_consensus.cc:515] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.185487 10248 ts_tablet_manager.cc:1434] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:00:58.185596 10252 ts_tablet_manager.cc:1434] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:58.186277 10251 leader_election.cc:290] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.186705 10252 tablet_bootstrap.cc:492] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:58.186837 10248 tablet_bootstrap.cc:492] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:58.188205 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:58.188683 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:58.193953 10248 tablet_bootstrap.cc:654] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:58.195902  9915 leader_election.cc:343] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.196995 10252 tablet_bootstrap.cc:654] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:58.197081  9916 leader_election.cc:343] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.197774  9916 leader_election.cc:304] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:00:58.200593 10229 raft_consensus.cc:2749] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.182878 10249 ts_tablet_manager.cc:1403] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:00:58.212121 10249 raft_consensus.cc:359] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.213101 10249 raft_consensus.cc:385] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.214068 10249 raft_consensus.cc:740] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.215533 10249 consensus_queue.cc:260] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.219144 10249 ts_tablet_manager.cc:1434] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:00:58.220490 10249 tablet_bootstrap.cc:492] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:58.229353 10249 tablet_bootstrap.cc:654] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.239200 10252 tablet_bootstrap.cc:492] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:58.239650 10252 ts_tablet_manager.cc:1403] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.024s
I20260709 13:00:58.242868 10252 raft_consensus.cc:359] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.243597 10252 raft_consensus.cc:385] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.243887 10252 raft_consensus.cc:740] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.244823 10252 consensus_queue.cc:260] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.248027 10252 ts_tablet_manager.cc:1434] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:58.248425 10248 tablet_bootstrap.cc:492] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:58.249053 10248 ts_tablet_manager.cc:1403] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.062s	user 0.026s	sys 0.035s
I20260709 13:00:58.249109 10252 tablet_bootstrap.cc:492] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:58.250136 10249 tablet_bootstrap.cc:492] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:58.250703 10249 ts_tablet_manager.cc:1403] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.010s
I20260709 13:00:58.252636 10248 raft_consensus.cc:359] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.253402 10248 raft_consensus.cc:385] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.253688 10248 raft_consensus.cc:740] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.254518 10248 consensus_queue.cc:260] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.256709 10252 tablet_bootstrap.cc:654] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.256934 10248 ts_tablet_manager.cc:1434] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:58.258116 10248 tablet_bootstrap.cc:492] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:58.254834 10249 raft_consensus.cc:359] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.259575 10249 raft_consensus.cc:385] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.259959 10249 raft_consensus.cc:740] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.260771 10249 consensus_queue.cc:260] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.265425 10248 tablet_bootstrap.cc:654] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.267186 10249 ts_tablet_manager.cc:1434] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:00:58.268795 10249 tablet_bootstrap.cc:492] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:58.273162 10252 tablet_bootstrap.cc:492] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:58.273769 10252 ts_tablet_manager.cc:1403] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:00:58.275679 10249 tablet_bootstrap.cc:654] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.281850 10252 raft_consensus.cc:359] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.282893 10252 raft_consensus.cc:385] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.283248 10252 raft_consensus.cc:740] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.284516 10252 consensus_queue.cc:260] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.288148 10252 ts_tablet_manager.cc:1434] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:00:58.289496 10252 tablet_bootstrap.cc:492] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:58.299008 10252 tablet_bootstrap.cc:654] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.304322 10249 tablet_bootstrap.cc:492] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:58.305044 10249 ts_tablet_manager.cc:1403] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.011s
I20260709 13:00:58.307068 10248 tablet_bootstrap.cc:492] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:58.307574 10248 ts_tablet_manager.cc:1403] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.020s
I20260709 13:00:58.308969 10249 raft_consensus.cc:359] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.309722 10249 raft_consensus.cc:385] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.310024 10249 raft_consensus.cc:740] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.310492 10248 raft_consensus.cc:359] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.311154 10248 raft_consensus.cc:385] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.310778 10249 consensus_queue.cc:260] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.311331 10252 tablet_bootstrap.cc:492] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:58.311417 10248 raft_consensus.cc:740] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.311916 10252 ts_tablet_manager.cc:1403] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:00:58.312419 10248 consensus_queue.cc:260] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.314783 10248 ts_tablet_manager.cc:1434] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:58.314905 10252 raft_consensus.cc:359] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.315610 10252 raft_consensus.cc:385] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.315758 10248 tablet_bootstrap.cc:492] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:58.315940 10252 raft_consensus.cc:740] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.318174 10249 ts_tablet_manager.cc:1434] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:00:58.319197 10249 tablet_bootstrap.cc:492] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:58.320849 10252 consensus_queue.cc:260] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.323483 10248 tablet_bootstrap.cc:654] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.323554 10252 ts_tablet_manager.cc:1434] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:00:58.325197 10252 tablet_bootstrap.cc:492] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:58.325713 10249 tablet_bootstrap.cc:654] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.332896 10252 tablet_bootstrap.cc:654] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.335000 10248 tablet_bootstrap.cc:492] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:58.335495 10248 ts_tablet_manager.cc:1403] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:00:58.338543 10248 raft_consensus.cc:359] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.339217 10248 raft_consensus.cc:385] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.339489 10248 raft_consensus.cc:740] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.340502 10248 consensus_queue.cc:260] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.343189 10248 ts_tablet_manager.cc:1434] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:58.343354 10249 tablet_bootstrap.cc:492] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:58.343477 10252 tablet_bootstrap.cc:492] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:58.343935 10249 ts_tablet_manager.cc:1403] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.011s
I20260709 13:00:58.343950 10252 ts_tablet_manager.cc:1403] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 13:00:58.344274 10248 tablet_bootstrap.cc:492] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:58.347046 10249 raft_consensus.cc:359] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.347321 10252 raft_consensus.cc:359] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.347786 10249 raft_consensus.cc:385] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.348045 10252 raft_consensus.cc:385] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.348537 10252 raft_consensus.cc:740] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.349609 10252 consensus_queue.cc:260] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.352754 10252 ts_tablet_manager.cc:1434] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:58.353842 10248 tablet_bootstrap.cc:654] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.353906 10252 tablet_bootstrap.cc:492] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:58.348066 10249 raft_consensus.cc:740] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.358747 10249 consensus_queue.cc:260] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.361045 10249 ts_tablet_manager.cc:1434] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:00:58.361428 10252 tablet_bootstrap.cc:654] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.361991 10249 tablet_bootstrap.cc:492] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918: Bootstrap starting.
I20260709 13:00:58.366621 10248 tablet_bootstrap.cc:492] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:58.367173 10248 ts_tablet_manager.cc:1403] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:00:58.370249 10248 raft_consensus.cc:359] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.370982 10248 raft_consensus.cc:385] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.371295 10248 raft_consensus.cc:740] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.372051 10248 consensus_queue.cc:260] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.372783 10252 tablet_bootstrap.cc:492] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:58.373270 10252 ts_tablet_manager.cc:1403] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:00:58.374212 10248 ts_tablet_manager.cc:1434] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:58.375515 10248 tablet_bootstrap.cc:492] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5: Bootstrap starting.
I20260709 13:00:58.375844 10252 raft_consensus.cc:359] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.376521 10252 raft_consensus.cc:385] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.376792 10252 raft_consensus.cc:740] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.377588 10251 raft_consensus.cc:493] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.377408 10252 consensus_queue.cc:260] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.378183 10251 raft_consensus.cc:515] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.379758 10252 ts_tablet_manager.cc:1434] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:58.380968 10251 leader_election.cc:290] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.381043 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2da0d8f14548768d3745299b61f088" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:58.381456 10252 tablet_bootstrap.cc:492] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9: Bootstrap starting.
I20260709 13:00:58.381865 10026 raft_consensus.cc:2468] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:58.382966 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2da0d8f14548768d3745299b61f088" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:58.383687 10101 raft_consensus.cc:2468] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:58.384146 10249 tablet_bootstrap.cc:654] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.382975  9916 leader_election.cc:304] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.386727 10229 raft_consensus.cc:2804] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.387157 10229 raft_consensus.cc:493] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.387555 10229 raft_consensus.cc:3060] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.389053 10252 tablet_bootstrap.cc:654] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.395876 10249 tablet_bootstrap.cc:492] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918: No bootstrap required, opened a new log
I20260709 13:00:58.396476 10249 ts_tablet_manager.cc:1403] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.003s
I20260709 13:00:58.405009 10249 raft_consensus.cc:359] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.405746 10249 raft_consensus.cc:385] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.405273 10229 raft_consensus.cc:515] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.406047 10249 raft_consensus.cc:740] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.407209 10252 tablet_bootstrap.cc:492] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9: No bootstrap required, opened a new log
I20260709 13:00:58.406791 10249 consensus_queue.cc:260] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.408854 10252 ts_tablet_manager.cc:1403] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.006s
I20260709 13:00:58.409927 10249 ts_tablet_manager.cc:1434] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.005s
I20260709 13:00:58.410710 10250 raft_consensus.cc:493] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.411600 10166 raft_consensus.cc:493] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.412084 10166 raft_consensus.cc:515] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.414454 10166 leader_election.cc:290] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:58.414963 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2da0d8f14548768d3745299b61f088" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:58.414830 10252 raft_consensus.cc:359] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.411190 10250 raft_consensus.cc:515] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.415632 10026 raft_consensus.cc:3060] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.417749 10250 leader_election.cc:290] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.415717 10252 raft_consensus.cc:385] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.418403 10252 raft_consensus.cc:740] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.419190 10252 consensus_queue.cc:260] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.416425 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281909f0fd0e4c80bc38770538e9debf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:58.420274 10027 raft_consensus.cc:2468] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:58.421641 10252 ts_tablet_manager.cc:1434] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:00:58.421804  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706cb125080468783b3987e92aab002" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:58.422622  9952 raft_consensus.cc:2468] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 0.
I20260709 13:00:58.424095 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706cb125080468783b3987e92aab002" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:58.424997 10101 raft_consensus.cc:2468] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 0.
I20260709 13:00:58.427227 10065 leader_election.cc:304] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:58.427892  9991 leader_election.cc:304] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.428162 10166 raft_consensus.cc:2804] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.428874 10166 raft_consensus.cc:493] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.429404 10166 raft_consensus.cc:3060] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.430877 10213 raft_consensus.cc:2804] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.432163 10213 raft_consensus.cc:493] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.432617 10213 raft_consensus.cc:3060] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.436913 10280 raft_consensus.cc:493] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.437424 10280 raft_consensus.cc:515] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.438190 10250 raft_consensus.cc:493] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.448948 10250 raft_consensus.cc:515] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.449469 10213 raft_consensus.cc:515] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.451498 10213 leader_election.cc:290] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.452195 10250 leader_election.cc:290] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.439949 10280 leader_election.cc:290] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.453292 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706cb125080468783b3987e92aab002" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:58.453502 10026 raft_consensus.cc:2468] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:58.453537 10166 raft_consensus.cc:515] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.454190 10100 raft_consensus.cc:3060] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.457162 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
W20260709 13:00:58.459085  9990 leader_election.cc:343] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.459856  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706cb125080468783b3987e92aab002" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:58.460676  9951 raft_consensus.cc:3060] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.461153  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:58.461983  9952 raft_consensus.cc:2468] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 0.
I20260709 13:00:58.463786 10166 leader_election.cc:290] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:58.465256  9916 leader_election.cc:304] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.466596 10280 raft_consensus.cc:2804] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.467203 10280 raft_consensus.cc:697] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:58.467935 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a7e9eef6d1c46ee8e8f6c6f698a636b" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:58.469143 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281909f0fd0e4c80bc38770538e9debf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:58.469909 10027 raft_consensus.cc:3060] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.468521 10026 raft_consensus.cc:2468] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:58.470170  9991 leader_election.cc:304] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:00:58.468319 10280 consensus_queue.cc:237] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.472554 10281 raft_consensus.cc:2804] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.473282 10281 raft_consensus.cc:493] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.473713 10281 raft_consensus.cc:3060] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:58.476238  9915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46103, user_credentials={real_user=slave}} blocked reactor thread for 74240.7us
I20260709 13:00:58.476558  9916 leader_election.cc:304] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.477800 10251 raft_consensus.cc:2804] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.478204 10251 raft_consensus.cc:493] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.478513 10251 raft_consensus.cc:3060] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.485235 10281 raft_consensus.cc:515] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.487440 10281 leader_election.cc:290] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.488570 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
W20260709 13:00:58.490351  9990 leader_election.cc:343] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.490378  9951 raft_consensus.cc:2468] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 1.
I20260709 13:00:58.491315  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:58.492681  9991 leader_election.cc:304] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.491974  9952 raft_consensus.cc:3060] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.495584 10251 raft_consensus.cc:515] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.496207 10213 raft_consensus.cc:2804] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.496765 10213 raft_consensus.cc:697] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:58.497581 10213 consensus_queue.cc:237] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.498040 10251 leader_election.cc:290] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.498425 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a7e9eef6d1c46ee8e8f6c6f698a636b" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:58.498960 10026 raft_consensus.cc:3060] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.415220 10229 leader_election.cc:290] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.471161 10166 raft_consensus.cc:493] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.501719 10166 raft_consensus.cc:515] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.503739 10166 leader_election.cc:290] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:58.505636 10100 raft_consensus.cc:2468] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 1.
I20260709 13:00:58.443280 10248 tablet_bootstrap.cc:654] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.506908 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2da0d8f14548768d3745299b61f088" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:58.507048 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:58.507519 10101 raft_consensus.cc:3060] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.507651 10024 raft_consensus.cc:2468] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:58.505931 10026 raft_consensus.cc:2468] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:58.509757  9916 leader_election.cc:304] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.510924 10229 raft_consensus.cc:2804] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.511660 10229 raft_consensus.cc:697] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:58.511654 10027 raft_consensus.cc:2468] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:58.512967 10065 leader_election.cc:304] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:58.513355 10229 consensus_queue.cc:237] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.513818 10166 raft_consensus.cc:2804] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.512980  9952 raft_consensus.cc:2468] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 1.
I20260709 13:00:58.513952 10065 leader_election.cc:304] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:58.514406 10166 raft_consensus.cc:493] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.514878 10166 raft_consensus.cc:3060] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.516384 10101 raft_consensus.cc:2468] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:58.517547  9991 leader_election.cc:304] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:00:58.518675 10281 raft_consensus.cc:2804] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.519199 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a7e9eef6d1c46ee8e8f6c6f698a636b" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:58.519359 10281 raft_consensus.cc:697] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:58.519826 10101 raft_consensus.cc:2468] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:58.520335 10281 consensus_queue.cc:237] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.527786 10248 tablet_bootstrap.cc:492] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5: No bootstrap required, opened a new log
I20260709 13:00:58.527346  9849 catalog_manager.cc:5697] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.524109 10166 raft_consensus.cc:515] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.530617 10166 leader_election.cc:290] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:58.531342 10166 raft_consensus.cc:2804] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.531880 10166 raft_consensus.cc:697] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:58.532181  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281909f0fd0e4c80bc38770538e9debf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:58.528331 10248 ts_tablet_manager.cc:1403] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.000s
I20260709 13:00:58.533056  9951 raft_consensus.cc:2468] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:58.534826  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281909f0fd0e4c80bc38770538e9debf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:58.535478  9951 raft_consensus.cc:3060] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.536847 10248 raft_consensus.cc:359] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.537708 10248 raft_consensus.cc:385] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.539902 10280 raft_consensus.cc:493] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.540405 10280 raft_consensus.cc:515] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.541885 10286 raft_consensus.cc:493] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.542371 10286 raft_consensus.cc:515] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.543234 10280 leader_election.cc:290] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.545709  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:58.546343  9952 raft_consensus.cc:2468] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:58.546510 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a7e9eef6d1c46ee8e8f6c6f698a636b" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:58.547086 10101 raft_consensus.cc:3060] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.550247 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:58.550719 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:58.551033 10027 raft_consensus.cc:2468] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 0.
I20260709 13:00:58.551649 10100 raft_consensus.cc:2393] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e659c6ee3bc84b9f8f15bf8794c6a918 in current term 1: Already voted for candidate 88cb686af2664080b74b65fbcfe1a0e5 in this term.
I20260709 13:00:58.555379  9916 leader_election.cc:304] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:00:58.557089 10280 raft_consensus.cc:2804] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:58.557482 10065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39837, user_credentials={real_user=slave}} blocked reactor thread for 43612.2us
I20260709 13:00:58.557650 10280 raft_consensus.cc:493] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.558199  9951 raft_consensus.cc:2468] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:58.558375 10280 raft_consensus.cc:3060] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.560094  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:58.532948 10166 consensus_queue.cc:237] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.538028 10248 raft_consensus.cc:740] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.562079  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0e2afd632c4cf299c5f74f63635e81" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:58.563313  9951 raft_consensus.cc:2468] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:58.564734 10065 leader_election.cc:304] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.564622 10248 consensus_queue.cc:260] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.565982 10285 raft_consensus.cc:2804] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.566352 10285 raft_consensus.cc:493] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.566717 10285 raft_consensus.cc:3060] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.566601 10101 raft_consensus.cc:2468] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 1.
I20260709 13:00:58.568751 10286 leader_election.cc:290] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:58.574456 10285 raft_consensus.cc:515] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.577956  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0e2afd632c4cf299c5f74f63635e81" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:58.578915  9951 raft_consensus.cc:3060] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.579103 10285 leader_election.cc:290] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:58.577951 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:58.580677 10027 raft_consensus.cc:3060] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.588428 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0e2afd632c4cf299c5f74f63635e81" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:58.589262 10026 raft_consensus.cc:2468] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:58.590454  9951 raft_consensus.cc:2468] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:58.590842 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0e2afd632c4cf299c5f74f63635e81" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:58.591567 10026 raft_consensus.cc:3060] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.592240 10065 leader_election.cc:304] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.593458 10286 raft_consensus.cc:493] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.593920 10286 raft_consensus.cc:515] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.595948 10286 leader_election.cc:290] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:58.596413 10286 raft_consensus.cc:2804] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.596812 10286 raft_consensus.cc:697] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:58.597713 10286 consensus_queue.cc:237] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.599680 10026 raft_consensus.cc:2468] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:58.597679  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:58.602237  9951 raft_consensus.cc:2393] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88cb686af2664080b74b65fbcfe1a0e5 in current term 1: Already voted for candidate 2699f38b6db94b80a69602c698e857d9 in this term.
I20260709 13:00:58.606961 10280 raft_consensus.cc:515] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.623297 10248 ts_tablet_manager.cc:1434] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5: Time spent starting tablet: real 0.090s	user 0.013s	sys 0.028s
I20260709 13:00:58.623837  9950 raft_consensus.cc:2393] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88cb686af2664080b74b65fbcfe1a0e5 in current term 1: Already voted for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in this term.
I20260709 13:00:58.614971 10289 raft_consensus.cc:493] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.625924 10289 raft_consensus.cc:515] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.628201 10289 leader_election.cc:290] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.628433 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:58.628804 10280 leader_election.cc:290] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.629267 10101 raft_consensus.cc:2393] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e659c6ee3bc84b9f8f15bf8794c6a918 in current term 1: Already voted for candidate 88cb686af2664080b74b65fbcfe1a0e5 in this term.
I20260709 13:00:58.629655 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5" is_pre_election: true
I20260709 13:00:58.630329 10100 raft_consensus.cc:2468] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 0.
I20260709 13:00:58.627463  9848 catalog_manager.cc:5697] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.631588  9990 leader_election.cc:304] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:58.632251 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:58.633347  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:58.634056  9950 raft_consensus.cc:2468] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 0.
I20260709 13:00:58.634531 10289 raft_consensus.cc:2804] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.634928 10289 raft_consensus.cc:493] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.635237 10289 raft_consensus.cc:3060] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.619602 10027 raft_consensus.cc:2468] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:58.620788 10026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:58.638170  9916 leader_election.cc:304] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:00:58.637320 10065 leader_election.cc:304] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:58.637473  9850 catalog_manager.cc:5697] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 0 to 1, leader changed from <none> to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.640698 10065 leader_election.cc:304] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5; no voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:58.641247 10280 raft_consensus.cc:2749] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.640959 10292 raft_consensus.cc:2804] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.641119  9850 catalog_manager.cc:5697] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 0 to 1, leader changed from <none> to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.642586 10166 raft_consensus.cc:3060] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.643687 10292 raft_consensus.cc:697] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:58.644668 10292 consensus_queue.cc:237] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.650187 10166 raft_consensus.cc:2749] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.652884 10289 raft_consensus.cc:515] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.655840  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:58.656366 10289 leader_election.cc:290] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.655761  9849 catalog_manager.cc:5697] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.656610  9950 raft_consensus.cc:3060] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.657254 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:58.657930 10100 raft_consensus.cc:3060] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.664535  9950 raft_consensus.cc:2468] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 1.
I20260709 13:00:58.665395 10100 raft_consensus.cc:2468] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 1.
I20260709 13:00:58.666257  9991 leader_election.cc:304] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.666198  9848 catalog_manager.cc:5697] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.667526 10289 raft_consensus.cc:2804] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.667994 10289 raft_consensus.cc:697] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:58.667970  9848 catalog_manager.cc:5697] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.669049 10289 consensus_queue.cc:237] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.676265 10166 raft_consensus.cc:493] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.676752 10166 raft_consensus.cc:515] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.677913  9849 catalog_manager.cc:5697] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.678858 10166 leader_election.cc:290] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:58.680055  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0d6d3137224a629a998208779353a7" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" is_pre_election: true
I20260709 13:00:58.680563 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0d6d3137224a629a998208779353a7" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9" is_pre_election: true
I20260709 13:00:58.680837  9950 raft_consensus.cc:2468] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:58.681305 10027 raft_consensus.cc:2468] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 0.
I20260709 13:00:58.682536 10065 leader_election.cc:304] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:58.683944 10166 raft_consensus.cc:2804] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.684311 10166 raft_consensus.cc:493] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.684630 10166 raft_consensus.cc:3060] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.691128 10166 raft_consensus.cc:515] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.693025 10166 leader_election.cc:290] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:58.693926  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0d6d3137224a629a998208779353a7" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:58.694144 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0d6d3137224a629a998208779353a7" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:58.694583  9950 raft_consensus.cc:3060] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.694839 10027 raft_consensus.cc:3060] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.700150  9950 raft_consensus.cc:2468] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:58.700834 10027 raft_consensus.cc:2468] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 1.
I20260709 13:00:58.701189 10065 leader_election.cc:304] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.702086 10166 raft_consensus.cc:2804] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.702629 10166 raft_consensus.cc:697] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:58.703493 10166 consensus_queue.cc:237] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.710570  9849 catalog_manager.cc:5697] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.813642 10100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
mode: GRACEFUL
new_leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:00:58.814194 10100 raft_consensus.cc:606] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Received request to transfer leadership to TS e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:58.818683 10100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da0e2afd632c4cf299c5f74f63635e81"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
mode: GRACEFUL
new_leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:00:58.819166 10100 raft_consensus.cc:606] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Received request to transfer leadership to TS e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:58.823637 10027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d706cb125080468783b3987e92aab002"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
mode: GRACEFUL
new_leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:60032
I20260709 13:00:58.824133 10027 raft_consensus.cc:606] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Received request to transfer leadership to TS e659c6ee3bc84b9f8f15bf8794c6a918
I20260709 13:00:58.828495  9950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af2da0d8f14548768d3745299b61f088"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
mode: GRACEFUL
new_leader_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:36356
I20260709 13:00:58.829027  9950 raft_consensus.cc:606] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Received request to transfer leadership to TS 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:58.833505 10100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa0d6d3137224a629a998208779353a7"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
mode: GRACEFUL
new_leader_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:00:58.833974 10100 raft_consensus.cc:606] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Received request to transfer leadership to TS 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:58.841763 10100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281909f0fd0e4c80bc38770538e9debf"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
mode: GRACEFUL
new_leader_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:00:58.842339 10100 raft_consensus.cc:606] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Received request to transfer leadership to TS 2699f38b6db94b80a69602c698e857d9
I20260709 13:00:58.847146 10027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
mode: GRACEFUL
new_leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:60032
I20260709 13:00:58.847607 10027 raft_consensus.cc:606] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Received request to transfer leadership to TS 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:00:58.886634 10280 consensus_queue.cc:1048] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.898600 10251 consensus_queue.cc:1048] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.908593 10280 raft_consensus.cc:993] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918: : Instructing follower 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:58.909122 10280 raft_consensus.cc:1081] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Signalling peer 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:58.911201 10027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af2da0d8f14548768d3745299b61f088"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:60020
I20260709 13:00:58.911762 10027 raft_consensus.cc:493] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.912117 10027 raft_consensus.cc:3060] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.913388 10280 consensus_queue.cc:1048] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.918886 10027 raft_consensus.cc:515] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.923509 10279 consensus_queue.cc:1048] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.925911  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2da0d8f14548768d3745299b61f088" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:58.926466  9950 raft_consensus.cc:3055] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:58.926815  9950 raft_consensus.cc:740] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:58.928349  9950 consensus_queue.cc:260] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.929351  9950 raft_consensus.cc:3060] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.932152 10027 leader_election.cc:290] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:58.932737 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2da0d8f14548768d3745299b61f088" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:58.933310 10101 raft_consensus.cc:3060] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.937426  9950 raft_consensus.cc:2468] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:58.938606  9991 leader_election.cc:304] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:58.939447 10289 raft_consensus.cc:2804] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.939908 10289 raft_consensus.cc:697] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:58.941004 10101 raft_consensus.cc:2468] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:58.940709 10289 consensus_queue.cc:237] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:58.947415  9849 catalog_manager.cc:5697] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 1 to 2, leader changed from e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193) to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.021992 10289 consensus_queue.cc:1048] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.029870 10281 raft_consensus.cc:993] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9: : Instructing follower e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:59.030361 10213 raft_consensus.cc:1081] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Signalling peer e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:59.032546  9951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d706cb125080468783b3987e92aab002"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:36354
I20260709 13:00:59.033113  9951 raft_consensus.cc:493] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:59.033486  9951 raft_consensus.cc:3060] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.038378 10281 consensus_queue.cc:1048] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.041493  9951 raft_consensus.cc:515] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.042629  9950 raft_consensus.cc:1240] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Rejecting Update request from peer 2699f38b6db94b80a69602c698e857d9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:59.047513  9951 leader_election.cc:290] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:59.050729 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706cb125080468783b3987e92aab002" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:59.051345 10101 raft_consensus.cc:3060] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.052878 10281 consensus_queue.cc:1059] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.053737 10281 raft_consensus.cc:3055] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:59.054061 10281 raft_consensus.cc:740] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:59.054862 10281 consensus_queue.cc:260] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.056115 10281 raft_consensus.cc:3060] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.058734 10213 consensus_queue.cc:1048] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.059124 10101 raft_consensus.cc:2468] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:59.060801  9915 leader_election.cc:304] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:59.061671 10279 raft_consensus.cc:2804] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:59.062354 10279 raft_consensus.cc:697] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:59.063405 10279 consensus_queue.cc:237] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.065213 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706cb125080468783b3987e92aab002" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:59.072840  9848 catalog_manager.cc:5697] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 1 to 2, leader changed from 2699f38b6db94b80a69602c698e857d9 (127.0.107.194) to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.073776 10213 consensus_queue.cc:1048] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.085177 10027 raft_consensus.cc:2468] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:59.092059 10213 raft_consensus.cc:993] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9: : Instructing follower 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:00:59.092482 10281 raft_consensus.cc:1081] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Signalling peer 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:00:59.093997 10101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:50690
I20260709 13:00:59.094560 10101 raft_consensus.cc:493] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:59.094887 10101 raft_consensus.cc:3060] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.099618 10101 raft_consensus.cc:515] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.101195 10101 leader_election.cc:290] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:00:59.102303  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:59.102607 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7afd881cc7747ba8a4706311f72156c" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:59.102964  9950 raft_consensus.cc:3060] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.103197 10027 raft_consensus.cc:3055] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:59.103533 10027 raft_consensus.cc:740] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:59.104364 10027 consensus_queue.cc:260] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.105628 10027 raft_consensus.cc:3060] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.110152  9950 raft_consensus.cc:2468] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 2.
I20260709 13:00:59.111322 10065 leader_election.cc:304] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:59.112195 10166 raft_consensus.cc:2804] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:59.112622 10166 raft_consensus.cc:697] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:59.112793 10027 raft_consensus.cc:2468] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 2.
I20260709 13:00:59.113468 10166 consensus_queue.cc:237] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.120069  9849 catalog_manager.cc:5697] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 1 to 2, leader changed from 2699f38b6db94b80a69602c698e857d9 (127.0.107.194) to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.130353 10292 consensus_queue.cc:1048] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.131173 10166 consensus_queue.cc:1048] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.137323 10292 raft_consensus.cc:993] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5: : Instructing follower 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:59.138034 10166 raft_consensus.cc:1081] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Signalling peer 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:59.144598 10026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "281909f0fd0e4c80bc38770538e9debf"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:60014
I20260709 13:00:59.145342 10026 raft_consensus.cc:493] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:59.145787 10026 raft_consensus.cc:3060] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.148420 10166 consensus_queue.cc:1048] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.153916 10166 consensus_queue.cc:1048] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.162045 10026 raft_consensus.cc:515] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.170899 10166 consensus_queue.cc:1048] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.171754  9952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281909f0fd0e4c80bc38770538e9debf" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:59.171876 10026 leader_election.cc:290] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:59.172353  9952 raft_consensus.cc:3060] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.173096 10166 consensus_queue.cc:1048] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.173820 10313 raft_consensus.cc:993] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5: : Instructing follower e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:59.174463 10313 raft_consensus.cc:1081] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Signalling peer e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:59.181373 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281909f0fd0e4c80bc38770538e9debf" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:59.181931 10101 raft_consensus.cc:3055] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:59.182226 10101 raft_consensus.cc:740] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:59.182761 10292 consensus_queue.cc:1048] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.182960 10101 consensus_queue.cc:260] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.184094 10101 raft_consensus.cc:3060] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.185243  9948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:00:59.185856  9948 raft_consensus.cc:493] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:59.186223  9948 raft_consensus.cc:3060] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.192664 10292 consensus_queue.cc:1048] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.195892 10101 raft_consensus.cc:2468] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:59.199400  9990 leader_election.cc:304] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:00:59.200280 10281 raft_consensus.cc:2804] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:59.200909 10281 raft_consensus.cc:697] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:59.201989 10281 consensus_queue.cc:237] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.195916  9948 raft_consensus.cc:515] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.200340  9952 raft_consensus.cc:2468] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:59.206526  9949 raft_consensus.cc:1240] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Rejecting Update request from peer 88cb686af2664080b74b65fbcfe1a0e5 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:00:59.209746 10166 raft_consensus.cc:993] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5: : Instructing follower e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:59.210163 10166 raft_consensus.cc:1081] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Signalling peer e659c6ee3bc84b9f8f15bf8794c6a918 to start an election
I20260709 13:00:59.210580  9948 leader_election.cc:290] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:59.212674 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:59.214805 10213 consensus_queue.cc:1048] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.217655 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feca2d7a1d3a4b08a2d5a023325be891" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:59.217877 10024 raft_consensus.cc:3060] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.218238 10100 raft_consensus.cc:3055] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:59.218571 10100 raft_consensus.cc:740] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:59.219367 10100 consensus_queue.cc:260] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.220211 10100 raft_consensus.cc:3060] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.228951 10024 raft_consensus.cc:2468] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:59.230844 10314 raft_consensus.cc:993] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5: : Instructing follower 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:59.231330 10314 raft_consensus.cc:1081] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Signalling peer 2699f38b6db94b80a69602c698e857d9 to start an election
I20260709 13:00:59.231370  9951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da0e2afd632c4cf299c5f74f63635e81"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:00:59.232244  9951 raft_consensus.cc:493] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:59.232769  9951 raft_consensus.cc:3060] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.233872  9916 leader_election.cc:304] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:59.236622 10024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa0d6d3137224a629a998208779353a7"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
 from {username='slave'} at 127.0.0.1:60014
I20260709 13:00:59.237188 10024 raft_consensus.cc:493] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:59.237542 10024 raft_consensus.cc:3060] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.238044 10279 raft_consensus.cc:2804] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:59.238730 10279 raft_consensus.cc:697] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:59.244217 10100 raft_consensus.cc:2468] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:59.244963 10024 raft_consensus.cc:515] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.239962 10279 consensus_queue.cc:237] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.247865  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0d6d3137224a629a998208779353a7" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:00:59.248462  9948 raft_consensus.cc:3060] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.252491  9850 catalog_manager.cc:5697] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 1 to 2, leader changed from 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195) to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.253060  9951 raft_consensus.cc:515] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.255564  9948 raft_consensus.cc:2468] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:59.255748  9951 leader_election.cc:290] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Requested vote from peers 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:59.255898 10027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0e2afd632c4cf299c5f74f63635e81" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:00:59.256536 10027 raft_consensus.cc:3060] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.256785  9991 leader_election.cc:304] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:59.257717 10213 raft_consensus.cc:2804] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:59.258213 10213 raft_consensus.cc:697] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Becoming Leader. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:00:59.258992 10213 consensus_queue.cc:237] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.265578 10027 raft_consensus.cc:2468] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:59.266958 10281 consensus_queue.cc:1048] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.267390 10024 leader_election.cc:290] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103)
I20260709 13:00:59.269112  9916 leader_election.cc:304] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:00:59.270709 10279 raft_consensus.cc:2804] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:59.271188 10279 raft_consensus.cc:697] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Becoming Leader. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:00:59.272114 10279 consensus_queue.cc:237] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.274114 10101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0d6d3137224a629a998208779353a7" candidate_uuid: "2699f38b6db94b80a69602c698e857d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:59.274693 10101 raft_consensus.cc:3055] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:59.274982 10101 raft_consensus.cc:740] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:59.275910 10100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0e2afd632c4cf299c5f74f63635e81" candidate_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
I20260709 13:00:59.275712 10101 consensus_queue.cc:260] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.276489 10100 raft_consensus.cc:3055] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:59.276867 10100 raft_consensus.cc:740] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:00:59.277007 10101 raft_consensus.cc:3060] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.280505 10100 consensus_queue.cc:260] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:00:59.282389 10100 raft_consensus.cc:3060] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.283557 10101 raft_consensus.cc:2468] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2699f38b6db94b80a69602c698e857d9 in term 2.
I20260709 13:00:59.290154 10100 raft_consensus.cc:2468] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e659c6ee3bc84b9f8f15bf8794c6a918 in term 2.
I20260709 13:00:59.292568  9848 catalog_manager.cc:5697] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 reported cstate change: term changed from 1 to 2, leader changed from 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195) to 2699f38b6db94b80a69602c698e857d9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2699f38b6db94b80a69602c698e857d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.302104  9850 catalog_manager.cc:5697] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 1 to 2, leader changed from 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195) to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.303442  9850 catalog_manager.cc:5697] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 reported cstate change: term changed from 1 to 2, leader changed from 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195) to e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.358809 10100 raft_consensus.cc:1275] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.360199 10289 consensus_queue.cc:1048] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.368284  9950 raft_consensus.cc:1275] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.369783 10309 consensus_queue.cc:1048] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:59.484020 10024 raft_consensus.cc:1275] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.485435 10279 consensus_queue.cc:1048] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.493498 10100 raft_consensus.cc:1275] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.495047 10279 consensus_queue.cc:1048] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.553436  9950 raft_consensus.cc:1275] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.554724 10313 consensus_queue.cc:1048] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.562105 10024 raft_consensus.cc:1275] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.563884 10286 consensus_queue.cc:1048] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.590039  9950 raft_consensus.cc:1275] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.591094 10309 consensus_queue.cc:1048] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.599632 10100 raft_consensus.cc:1275] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.601325 10289 consensus_queue.cc:1048] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.799134 10024 raft_consensus.cc:1275] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.801118 10279 consensus_queue.cc:1048] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.806907 10027 raft_consensus.cc:1275] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.808997 10100 raft_consensus.cc:1275] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.811116 10279 consensus_queue.cc:1048] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.812407 10280 consensus_queue.cc:1048] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.822593 10100 raft_consensus.cc:1275] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer e659c6ee3bc84b9f8f15bf8794c6a918: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.824846 10229 consensus_queue.cc:1048] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.829713 10101 raft_consensus.cc:1275] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.832113 10213 consensus_queue.cc:1048] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.840461  9950 raft_consensus.cc:1275] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 2699f38b6db94b80a69602c698e857d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.841939 10309 consensus_queue.cc:1048] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:01.850715  9849 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49300:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:01:01.870241  9849 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49300:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:01:01.974689   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:01:02.093317 10341 log.cc:927] Time spent T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918: Append to log took a long time: real 0.108s	user 0.000s	sys 0.004s
W20260709 13:01:02.176791 10354 log.cc:927] Time spent T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:01:02.216523 10374 tablet.cc:1724] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.257925 10383 tablet.cc:1724] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.259965 10378 tablet.cc:1724] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:01:02.295560  9915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46103, user_credentials={real_user=slave}} blocked reactor thread for 78374.2us
I20260709 13:01:02.294107 10023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
mode: GRACEFUL
new_leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:60038
I20260709 13:01:02.314144 10390 tablet.cc:1724] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.321462 10384 tablet.cc:1724] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.304517 10023 raft_consensus.cc:606] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Received request to transfer leadership to TS 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:01:02.382275 10385 tablet.cc:1724] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.402369 10346 raft_consensus.cc:993] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9: : Instructing follower 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:01:02.403126 10351 raft_consensus.cc:1081] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Signalling peer 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:01:02.403234 10374 tablet.cc:1724] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.389914 10387 tablet.cc:1724] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.408890 10388 tablet.cc:1724] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.399189 10386 tablet.cc:1724] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.435552 10383 tablet.cc:1724] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.428470 10390 tablet.cc:1724] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.455870 10378 tablet.cc:1724] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.474897 10402 tablet.cc:1724] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.477941 10401 tablet.cc:1724] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.494184 10386 tablet.cc:1724] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.495811 10387 tablet.cc:1724] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.487313 10397 tablet.cc:1724] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.515233 10099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:50690
I20260709 13:01:02.515854 10099 raft_consensus.cc:493] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:02.516232 10099 raft_consensus.cc:3060] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.518065 10385 tablet.cc:1724] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.518844 10401 tablet.cc:1724] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.524192 10099 raft_consensus.cc:515] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:02.525488 10097 raft_consensus.cc:1240] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Rejecting Update request from peer 2699f38b6db94b80a69602c698e857d9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:02.532968  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:01:02.539280 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce081aca9e734696b10214e4e05801c4" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:01:02.539678  9948 raft_consensus.cc:3060] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.540112 10025 raft_consensus.cc:3055] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:02.540491 10025 raft_consensus.cc:740] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:01:02.541450 10025 consensus_queue.cc:260] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:02.542686 10025 raft_consensus.cc:3060] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.547123  9948 raft_consensus.cc:2468] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 2.
I20260709 13:01:02.554765 10385 tablet.cc:1724] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.512176 10384 tablet.cc:1724] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.532240 10099 leader_election.cc:290] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 2 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:01:02.570967 10065 leader_election.cc:304] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:01:02.570993 10388 tablet.cc:1724] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.572223 10326 raft_consensus.cc:2804] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:02.572821 10326 raft_consensus.cc:697] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:01:02.573825 10326 consensus_queue.cc:237] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:02.583879  9849 catalog_manager.cc:5697] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 1 to 2, leader changed from 2699f38b6db94b80a69602c698e857d9 (127.0.107.194) to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.559088 10374 tablet.cc:1724] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.585328  9849 catalog_manager.cc:5789] TS 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195:46103) does not have the latest schema for tablet ce081aca9e734696b10214e4e05801c4 (table soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9]). Expected version 1 got 0
I20260709 13:01:02.589990 10025 raft_consensus.cc:2468] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 2.
I20260709 13:01:02.595000 10385 tablet.cc:1724] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.596700 10383 tablet.cc:1724] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.620707  9948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d706cb125080468783b3987e92aab002"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
mode: GRACEFUL
new_leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:36364
I20260709 13:01:02.621344  9948 raft_consensus.cc:606] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Received request to transfer leadership to TS 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:01:02.622882   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:01:02.623594   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:02.635864 10025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d"
dest_uuid: "2699f38b6db94b80a69602c698e857d9"
mode: GRACEFUL
new_leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:60038
I20260709 13:01:02.636520 10025 raft_consensus.cc:606] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Received request to transfer leadership to TS 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:01:02.639792  9948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf"
dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
mode: GRACEFUL
new_leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:36364
I20260709 13:01:02.640407  9948 raft_consensus.cc:606] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Received request to transfer leadership to TS 88cb686af2664080b74b65fbcfe1a0e5
I20260709 13:01:02.641682   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:02.642315   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:02.644624  9848 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c: soft_deleted_table [id=3a279e5a78c74c4daa815fa9baaf85a9] alter complete (version 1)
I20260709 13:01:02.741881 10346 raft_consensus.cc:993] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9: : Instructing follower 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:01:02.742367 10351 raft_consensus.cc:1081] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Signalling peer 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:01:02.744026 10101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:50690
I20260709 13:01:02.744562 10101 raft_consensus.cc:493] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:02.744935 10101 raft_consensus.cc:3060] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.751451 10101 raft_consensus.cc:515] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:02.752974 10101 leader_election.cc:290] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 3 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:01:02.753778  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:01:02.754022 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052ec08f0ff5424db162a58f3d75311d" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:01:02.754457  9948 raft_consensus.cc:3060] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.754591 10025 raft_consensus.cc:3055] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.755012 10025 raft_consensus.cc:740] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2699f38b6db94b80a69602c698e857d9, State: Running, Role: LEADER
I20260709 13:01:02.755822 10025 consensus_queue.cc:260] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:02.757114 10025 raft_consensus.cc:3060] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.761101  9948 raft_consensus.cc:2468] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 3.
I20260709 13:01:02.762460 10065 leader_election.cc:304] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:01:02.763298 10326 raft_consensus.cc:2804] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.763857 10326 raft_consensus.cc:697] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:01:02.764694 10326 consensus_queue.cc:237] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:02.765370 10025 raft_consensus.cc:2468] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 3.
I20260709 13:01:02.774446  9849 catalog_manager.cc:5697] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 2 to 3, leader changed from 2699f38b6db94b80a69602c698e857d9 (127.0.107.194) to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.955561 10400 raft_consensus.cc:993] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918: : Instructing follower 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:01:02.956097 10398 raft_consensus.cc:1081] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Signalling peer 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:01:02.957795 10101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d706cb125080468783b3987e92aab002"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:50688
I20260709 13:01:02.958312 10101 raft_consensus.cc:493] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:02.958642 10101 raft_consensus.cc:3060] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.963732 10101 raft_consensus.cc:515] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:02.965600 10101 leader_election.cc:290] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 3 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:01:02.966329  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706cb125080468783b3987e92aab002" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:01:02.966976 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706cb125080468783b3987e92aab002" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:01:02.967585 10025 raft_consensus.cc:3060] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.966989  9948 raft_consensus.cc:3055] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.969149  9948 raft_consensus.cc:740] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:01:02.969957  9948 consensus_queue.cc:260] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:02.971251  9948 raft_consensus.cc:3060] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.974541  9949 raft_consensus.cc:1275] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:02.974586 10398 raft_consensus.cc:993] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918: : Instructing follower 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:01:02.975328 10400 raft_consensus.cc:1081] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Signalling peer 88cb686af2664080b74b65fbcfe1a0e5 to start an election
I20260709 13:01:02.976274 10326 consensus_queue.cc:1048] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:02.977087 10025 raft_consensus.cc:2468] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 3.
I20260709 13:01:02.978576 10065 leader_election.cc:304] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2699f38b6db94b80a69602c698e857d9, 88cb686af2664080b74b65fbcfe1a0e5; no voters: 
I20260709 13:01:02.981482 10326 raft_consensus.cc:2804] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.981984 10326 raft_consensus.cc:697] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:01:02.982357  9948 raft_consensus.cc:2468] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 3.
I20260709 13:01:02.982834 10326 consensus_queue.cc:237] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:02.990151 10401 tablet.cc:1724] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:02.994935  9848 catalog_manager.cc:5697] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 2 to 3, leader changed from e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193) to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.978767 10101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf"
dest_uuid: "88cb686af2664080b74b65fbcfe1a0e5"
 from {username='slave'} at 127.0.0.1:50688
I20260709 13:01:03.003621 10101 raft_consensus.cc:493] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:03.004017 10101 raft_consensus.cc:3060] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:03.007031 10025 raft_consensus.cc:1275] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:03.010418 10408 consensus_queue.cc:1048] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:03.015652 10101 raft_consensus.cc:515] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:03.017735 10101 leader_election.cc:290] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 3 election: Requested vote from peers e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237), 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837)
I20260709 13:01:03.022975 10401 tablet.cc:1719] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:01:03.018838 10022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2699f38b6db94b80a69602c698e857d9"
I20260709 13:01:03.023717 10022 raft_consensus.cc:3060] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:03.020619  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a260a3b7fdc545d4a11bdee89eca07cf" candidate_uuid: "88cb686af2664080b74b65fbcfe1a0e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918"
I20260709 13:01:03.024770  9949 raft_consensus.cc:3055] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:03.025096  9949 raft_consensus.cc:740] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e659c6ee3bc84b9f8f15bf8794c6a918, State: Running, Role: LEADER
I20260709 13:01:03.025916  9949 consensus_queue.cc:260] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:03.027242  9949 raft_consensus.cc:3060] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:03.031600 10022 raft_consensus.cc:2468] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 3.
I20260709 13:01:03.033401 10387 tablet.cc:1719] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:01:03.036265  9949 raft_consensus.cc:2468] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88cb686af2664080b74b65fbcfe1a0e5 in term 3.
I20260709 13:01:03.039306 10065 leader_election.cc:304] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88cb686af2664080b74b65fbcfe1a0e5, e659c6ee3bc84b9f8f15bf8794c6a918; no voters: 
I20260709 13:01:03.040159 10389 raft_consensus.cc:2804] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:03.040633 10389 raft_consensus.cc:697] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 LEADER]: Becoming Leader. State: Replica: 88cb686af2664080b74b65fbcfe1a0e5, State: Running, Role: LEADER
I20260709 13:01:03.041481 10389 consensus_queue.cc:237] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } }
I20260709 13:01:03.042944 10378 tablet.cc:1719] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:01:03.056504  9849 catalog_manager.cc:5697] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 reported cstate change: term changed from 2 to 3, leader changed from e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193) to 88cb686af2664080b74b65fbcfe1a0e5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "88cb686af2664080b74b65fbcfe1a0e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88cb686af2664080b74b65fbcfe1a0e5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46103 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.145689 10022 raft_consensus.cc:1275] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.146996 10411 consensus_queue.cc:1048] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.155956  9949 raft_consensus.cc:1275] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.158891 10326 consensus_queue.cc:1048] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.457055 10022 raft_consensus.cc:1275] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:03.458319 10326 consensus_queue.cc:1048] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:03.465270  9949 raft_consensus.cc:1275] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.465781  9948 raft_consensus.cc:1275] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:03.468070 10389 consensus_queue.cc:1048] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:03.467237 10411 consensus_queue.cc:1048] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e659c6ee3bc84b9f8f15bf8794c6a918" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:03.483377 10022 raft_consensus.cc:1275] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Refusing update from remote peer 88cb686af2664080b74b65fbcfe1a0e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.485085 10326 consensus_queue.cc:1048] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2699f38b6db94b80a69602c698e857d9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.691912   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:01:03.696869   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:01:03.697276   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:03.702231   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:01:03.702661   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:04.739719   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:04.759729  9991 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 13:01:04.770555  9991 consensus_peers.cc:597] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 -> Peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Couldn't send request to peer e659c6ee3bc84b9f8f15bf8794c6a918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.782116   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:04.783514   431 tablet_replica.cc:333] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.785260   431 raft_consensus.cc:2243] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.786587   431 raft_consensus.cc:2272] T d7afd881cc7747ba8a4706311f72156c P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.789590   431 tablet_replica.cc:333] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.790107   431 raft_consensus.cc:2243] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.791214   431 raft_consensus.cc:2272] T da0e2afd632c4cf299c5f74f63635e81 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.795109   431 tablet_replica.cc:333] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
W20260709 13:01:04.795748  9991 consensus_peers.cc:597] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 -> Peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Couldn't send request to peer e659c6ee3bc84b9f8f15bf8794c6a918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.796011   431 raft_consensus.cc:2243] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.796783   431 raft_consensus.cc:2272] T aa0d6d3137224a629a998208779353a7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.799595   431 tablet_replica.cc:333] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.800213   431 raft_consensus.cc:2243] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.800767   431 raft_consensus.cc:2272] T d706cb125080468783b3987e92aab002 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.803367   431 tablet_replica.cc:333] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.803956   431 raft_consensus.cc:2243] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.804601   431 raft_consensus.cc:2272] T af2da0d8f14548768d3745299b61f088 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.807348   431 tablet_replica.cc:333] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.808027   431 raft_consensus.cc:2243] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.809183   431 raft_consensus.cc:2272] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P e659c6ee3bc84b9f8f15bf8794c6a918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.811543   431 tablet_replica.cc:333] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.812110   431 raft_consensus.cc:2243] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.813292   431 raft_consensus.cc:2272] T feca2d7a1d3a4b08a2d5a023325be891 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.815749   431 tablet_replica.cc:333] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.816325   431 raft_consensus.cc:2243] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.816939   431 raft_consensus.cc:2272] T a260a3b7fdc545d4a11bdee89eca07cf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.819357   431 tablet_replica.cc:333] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.819938   431 raft_consensus.cc:2243] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.821051   431 raft_consensus.cc:2272] T c50184a86a9c45e1b0d49d54c0960a7a P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.823412   431 tablet_replica.cc:333] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.823972   431 raft_consensus.cc:2243] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.824496   431 raft_consensus.cc:2272] T 0b90e8db2f9848a88f0dcec6a384a4b7 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.827912   431 tablet_replica.cc:333] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.828547   431 raft_consensus.cc:2243] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:01:04.829860  9991 consensus_peers.cc:597] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 -> Peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Couldn't send request to peer e659c6ee3bc84b9f8f15bf8794c6a918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.829869   431 raft_consensus.cc:2272] T ca30096d7f584656801568a185406bcc P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.832620   431 tablet_replica.cc:333] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.833268   431 raft_consensus.cc:2243] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.834293   431 raft_consensus.cc:2272] T 8629656f32e34e5a87dcebf312b5ea0e P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.837226   431 tablet_replica.cc:333] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.837900   431 raft_consensus.cc:2243] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.838637   431 raft_consensus.cc:2272] T 281909f0fd0e4c80bc38770538e9debf P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.841956   431 tablet_replica.cc:333] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.842576   431 raft_consensus.cc:2243] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.843283   431 raft_consensus.cc:2272] T 878a515f14e34721ad3705dfd1ed2e21 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.847102   431 tablet_replica.cc:333] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.847775   431 raft_consensus.cc:2243] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.848450   431 raft_consensus.cc:2272] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.850929   431 tablet_replica.cc:333] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.851481   431 raft_consensus.cc:2243] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.852219   431 raft_consensus.cc:2272] T ce081aca9e734696b10214e4e05801c4 P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.854579   431 tablet_replica.cc:333] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.855098   431 raft_consensus.cc:2243] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.855696   431 raft_consensus.cc:2272] T c33c46c3f4bc43359933d049fb7fb85f P e659c6ee3bc84b9f8f15bf8794c6a918 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.858348   431 tablet_replica.cc:333] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918: stopping tablet replica
I20260709 13:01:04.858857   431 raft_consensus.cc:2243] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.859503   431 raft_consensus.cc:2272] T 052ec08f0ff5424db162a58f3d75311d P e659c6ee3bc84b9f8f15bf8794c6a918 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:04.871498 10065 consensus_peers.cc:597] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 -> Peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Couldn't send request to peer e659c6ee3bc84b9f8f15bf8794c6a918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:04.887271 10065 consensus_peers.cc:597] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 -> Peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Couldn't send request to peer e659c6ee3bc84b9f8f15bf8794c6a918. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.909592   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:01:04.953967   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:01:04.981179   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:04.981891   431 tablet_replica.cc:333] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:04.982857   431 raft_consensus.cc:2243] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.983508   431 raft_consensus.cc:2272] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 2699f38b6db94b80a69602c698e857d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.986115   431 tablet_replica.cc:333] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:04.986724   431 raft_consensus.cc:2243] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.987730   431 raft_consensus.cc:2272] T af2da0d8f14548768d3745299b61f088 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.990060   431 tablet_replica.cc:333] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:04.990875   431 raft_consensus.cc:2243] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.991412   431 raft_consensus.cc:2272] T feca2d7a1d3a4b08a2d5a023325be891 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.993784   431 tablet_replica.cc:333] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:04.994470   431 raft_consensus.cc:2243] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:04.995411   431 raft_consensus.cc:2272] T aa0d6d3137224a629a998208779353a7 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.997696   431 tablet_replica.cc:333] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:04.998276   431 raft_consensus.cc:2243] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.998842   431 raft_consensus.cc:2272] T d706cb125080468783b3987e92aab002 P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.001135   431 tablet_replica.cc:333] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.001709   431 raft_consensus.cc:2243] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.002233   431 raft_consensus.cc:2272] T 8629656f32e34e5a87dcebf312b5ea0e P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.004441   431 tablet_replica.cc:333] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.005050   431 raft_consensus.cc:2243] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.005537   431 raft_consensus.cc:2272] T ca30096d7f584656801568a185406bcc P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.007743   431 tablet_replica.cc:333] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.008286   431 raft_consensus.cc:2243] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.009248   431 raft_consensus.cc:2272] T 281909f0fd0e4c80bc38770538e9debf P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.011307   431 tablet_replica.cc:333] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.011878   431 raft_consensus.cc:2243] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.012840   431 raft_consensus.cc:2272] T 878a515f14e34721ad3705dfd1ed2e21 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.015154   431 tablet_replica.cc:333] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.015697   431 raft_consensus.cc:2243] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.016175   431 raft_consensus.cc:2272] T c50184a86a9c45e1b0d49d54c0960a7a P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.018559   431 tablet_replica.cc:333] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.019121   431 raft_consensus.cc:2243] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.019793   431 raft_consensus.cc:2272] T ce081aca9e734696b10214e4e05801c4 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.022329   431 tablet_replica.cc:333] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.022864   431 raft_consensus.cc:2243] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.023942   431 raft_consensus.cc:2272] T c33c46c3f4bc43359933d049fb7fb85f P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.026459   431 tablet_replica.cc:333] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.027038   431 raft_consensus.cc:2243] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.027702   431 raft_consensus.cc:2272] T d7afd881cc7747ba8a4706311f72156c P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.030294   431 tablet_replica.cc:333] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.030818   431 raft_consensus.cc:2243] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.031418   431 raft_consensus.cc:2272] T 052ec08f0ff5424db162a58f3d75311d P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.033938   431 tablet_replica.cc:333] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.034503   431 raft_consensus.cc:2243] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.035528   431 raft_consensus.cc:2272] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.037983   431 tablet_replica.cc:333] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.038549   431 raft_consensus.cc:2243] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.039109   431 raft_consensus.cc:2272] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.041405   431 tablet_replica.cc:333] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.041935   431 raft_consensus.cc:2243] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.042466   431 raft_consensus.cc:2272] T da0e2afd632c4cf299c5f74f63635e81 P 2699f38b6db94b80a69602c698e857d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.044642   431 tablet_replica.cc:333] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9: stopping tablet replica
I20260709 13:01:05.045202   431 raft_consensus.cc:2243] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.045688   431 raft_consensus.cc:2272] T a260a3b7fdc545d4a11bdee89eca07cf P 2699f38b6db94b80a69602c698e857d9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:05.057087 10065 consensus_peers.cc:597] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 -> Peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Couldn't send request to peer e659c6ee3bc84b9f8f15bf8794c6a918. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:05.069316 10065 consensus_peers.cc:597] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 -> Peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Couldn't send request to peer 2699f38b6db94b80a69602c698e857d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:05.092780   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:01:05.098973 10065 consensus_peers.cc:597] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 -> Peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Couldn't send request to peer e659c6ee3bc84b9f8f15bf8794c6a918. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:05.122201 10065 consensus_peers.cc:597] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 -> Peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Couldn't send request to peer e659c6ee3bc84b9f8f15bf8794c6a918. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:05.133363 10065 consensus_peers.cc:597] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 -> Peer e659c6ee3bc84b9f8f15bf8794c6a918 (127.0.107.193:46237): Couldn't send request to peer e659c6ee3bc84b9f8f15bf8794c6a918. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:05.139711   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:05.150004 10065 consensus_peers.cc:597] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 -> Peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Couldn't send request to peer 2699f38b6db94b80a69602c698e857d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:05.163457 10065 consensus_peers.cc:597] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 -> Peer 2699f38b6db94b80a69602c698e857d9 (127.0.107.194:39837): Couldn't send request to peer 2699f38b6db94b80a69602c698e857d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:05.172612   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:05.173429   431 tablet_replica.cc:333] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.174151   431 raft_consensus.cc:2243] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.175055   431 raft_consensus.cc:2272] T d7afd881cc7747ba8a4706311f72156c P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.177424   431 tablet_replica.cc:333] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.178035   431 raft_consensus.cc:2243] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.178552   431 raft_consensus.cc:2272] T af2da0d8f14548768d3745299b61f088 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.180728   431 tablet_replica.cc:333] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.181281   431 raft_consensus.cc:2243] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.181782   431 raft_consensus.cc:2272] T da0e2afd632c4cf299c5f74f63635e81 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.183894   431 tablet_replica.cc:333] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.184440   431 raft_consensus.cc:2243] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.184957   431 raft_consensus.cc:2272] T aa0d6d3137224a629a998208779353a7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.187005   431 tablet_replica.cc:333] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.187557   431 raft_consensus.cc:2243] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.188372   431 raft_consensus.cc:2272] T d706cb125080468783b3987e92aab002 P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.190392   431 tablet_replica.cc:333] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.190953   431 raft_consensus.cc:2243] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.191444   431 raft_consensus.cc:2272] T 6a7e9eef6d1c46ee8e8f6c6f698a636b P 88cb686af2664080b74b65fbcfe1a0e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.193527   431 tablet_replica.cc:333] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.194077   431 raft_consensus.cc:2243] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.194594   431 raft_consensus.cc:2272] T feca2d7a1d3a4b08a2d5a023325be891 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.196766   431 tablet_replica.cc:333] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.197328   431 raft_consensus.cc:2243] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.197819   431 raft_consensus.cc:2272] T 281909f0fd0e4c80bc38770538e9debf P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.199820   431 tablet_replica.cc:333] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.200357   431 raft_consensus.cc:2243] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.200863   431 raft_consensus.cc:2272] T 878a515f14e34721ad3705dfd1ed2e21 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.202836   431 tablet_replica.cc:333] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.203374   431 raft_consensus.cc:2243] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.203861   431 raft_consensus.cc:2272] T 0b90e8db2f9848a88f0dcec6a384a4b7 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.205814   431 tablet_replica.cc:333] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.206355   431 raft_consensus.cc:2243] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.206809   431 raft_consensus.cc:2272] T ca30096d7f584656801568a185406bcc P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.208822   431 tablet_replica.cc:333] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.209333   431 raft_consensus.cc:2243] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.209784   431 raft_consensus.cc:2272] T 8629656f32e34e5a87dcebf312b5ea0e P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.211814   431 tablet_replica.cc:333] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.212461   431 raft_consensus.cc:2243] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.213383   431 raft_consensus.cc:2272] T ce081aca9e734696b10214e4e05801c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.215451   431 tablet_replica.cc:333] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.215991   431 raft_consensus.cc:2243] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.216457   431 raft_consensus.cc:2272] T c33c46c3f4bc43359933d049fb7fb85f P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.218619   431 tablet_replica.cc:333] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.219170   431 raft_consensus.cc:2243] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.220001   431 raft_consensus.cc:2272] T 4ee1905ec0fd4bf384efe8a590b1b0c4 P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.222049   431 tablet_replica.cc:333] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.222517   431 raft_consensus.cc:2243] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.223315   431 raft_consensus.cc:2272] T a260a3b7fdc545d4a11bdee89eca07cf P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.225350   431 tablet_replica.cc:333] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.225812   431 raft_consensus.cc:2243] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:05.226270   431 raft_consensus.cc:2272] T c50184a86a9c45e1b0d49d54c0960a7a P 88cb686af2664080b74b65fbcfe1a0e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.228260   431 tablet_replica.cc:333] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5: stopping tablet replica
I20260709 13:01:05.228720   431 raft_consensus.cc:2243] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.229554   431 raft_consensus.cc:2272] T 052ec08f0ff5424db162a58f3d75311d P 88cb686af2664080b74b65fbcfe1a0e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.271189   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:01:05.308501   431 master.cc:562] Master@127.0.107.254:41651 shutting down...
I20260709 13:01:05.337634   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:05.338207   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:05.338490   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P c319d7babf824395b1d6960b0a85718c: stopping tablet replica
I20260709 13:01:05.359156   431 master.cc:584] Master@127.0.107.254:41651 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12778 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:01:05.414469   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:39243
I20260709 13:01:05.415568   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:05.422119 10425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:05.422410 10426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:05.422853 10428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:05.424574   431 server_base.cc:1061] running on GCE node
I20260709 13:01:05.425436   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:05.425606   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:05.425719   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602065425707 us; error 0 us; skew 500 ppm
I20260709 13:01:05.426148   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:05.428352   431 webserver.cc:533] Webserver started at http://127.0.107.254:44199/ using document root <none> and password file <none>
I20260709 13:01:05.428871   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:05.429028   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:05.429241   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:05.430301   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/master-0-root/instance:
uuid: "81cb2c3e0eca4e8b8883a584093db691"
format_stamp: "Formatted at 2026-07-09 13:01:05 on dist-test-slave-73vh"
I20260709 13:01:05.434433   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:05.437424 10433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.438136   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:05.438407   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/master-0-root
uuid: "81cb2c3e0eca4e8b8883a584093db691"
format_stamp: "Formatted at 2026-07-09 13:01:05 on dist-test-slave-73vh"
I20260709 13:01:05.438654   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:05.457033   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:05.458204   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:05.495369   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:39243
I20260709 13:01:05.495479 10484 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:39243 every 8 connection(s)
I20260709 13:01:05.499193 10485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:05.510725 10485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691: Bootstrap starting.
I20260709 13:01:05.515655 10485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:05.519793 10485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691: No bootstrap required, opened a new log
I20260709 13:01:05.522043 10485 raft_consensus.cc:359] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81cb2c3e0eca4e8b8883a584093db691" member_type: VOTER }
I20260709 13:01:05.522455 10485 raft_consensus.cc:385] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:05.522722 10485 raft_consensus.cc:740] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cb2c3e0eca4e8b8883a584093db691, State: Initialized, Role: FOLLOWER
I20260709 13:01:05.523283 10485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81cb2c3e0eca4e8b8883a584093db691" member_type: VOTER }
I20260709 13:01:05.523761 10485 raft_consensus.cc:399] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:05.523979 10485 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:05.524259 10485 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:05.528985 10485 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81cb2c3e0eca4e8b8883a584093db691" member_type: VOTER }
I20260709 13:01:05.529472 10485 leader_election.cc:304] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81cb2c3e0eca4e8b8883a584093db691; no voters: 
I20260709 13:01:05.530535 10485 leader_election.cc:290] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:05.530972 10488 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:05.532330 10488 raft_consensus.cc:697] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 1 LEADER]: Becoming Leader. State: Replica: 81cb2c3e0eca4e8b8883a584093db691, State: Running, Role: LEADER
I20260709 13:01:05.533046 10488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81cb2c3e0eca4e8b8883a584093db691" member_type: VOTER }
I20260709 13:01:05.533671 10485 sys_catalog.cc:565] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:05.539986 10489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81cb2c3e0eca4e8b8883a584093db691" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81cb2c3e0eca4e8b8883a584093db691" member_type: VOTER } }
I20260709 13:01:05.540117 10490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81cb2c3e0eca4e8b8883a584093db691. Latest consensus state: current_term: 1 leader_uuid: "81cb2c3e0eca4e8b8883a584093db691" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81cb2c3e0eca4e8b8883a584093db691" member_type: VOTER } }
I20260709 13:01:05.540866 10489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:05.540932 10490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:05.542999 10497 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:05.547945 10497 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:05.549503   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:05.556474 10497 catalog_manager.cc:1383] Generated new cluster ID: 694eb2a43a614c788998b8cb0831a6c7
I20260709 13:01:05.556762 10497 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:05.584441 10497 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:05.585764 10497 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:05.604506 10497 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691: Generated new TSK 0
I20260709 13:01:05.605161 10497 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:05.615662   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:05.621403 10506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:05.622740 10507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:05.624159 10509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:05.625113   431 server_base.cc:1061] running on GCE node
I20260709 13:01:05.625919   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:05.626107   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:05.626227   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602065626217 us; error 0 us; skew 500 ppm
I20260709 13:01:05.626660   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:05.628763   431 webserver.cc:533] Webserver started at http://127.0.107.193:36221/ using document root <none> and password file <none>
I20260709 13:01:05.629189   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:05.629338   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:05.629542   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:05.630542   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-0-root/instance:
uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
format_stamp: "Formatted at 2026-07-09 13:01:05 on dist-test-slave-73vh"
I20260709 13:01:05.634748   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:05.637940 10514 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.638677   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:01:05.638962   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-0-root
uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
format_stamp: "Formatted at 2026-07-09 13:01:05 on dist-test-slave-73vh"
I20260709 13:01:05.639238   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:05.662789   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:05.663952   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:05.665391   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:05.667536   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:05.667745   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.667985   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:05.668180   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.708997   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35839
I20260709 13:01:05.709136 10576 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35839 every 8 connection(s)
I20260709 13:01:05.714017   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:05.721079 10581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:05.722457 10582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:05.725510   431 server_base.cc:1061] running on GCE node
W20260709 13:01:05.725781 10584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:05.726794   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:05.727023   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:05.727210   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602065727193 us; error 0 us; skew 500 ppm
I20260709 13:01:05.727739   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:05.731050   431 webserver.cc:533] Webserver started at http://127.0.107.194:44499/ using document root <none> and password file <none>
I20260709 13:01:05.731420 10577 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39243
I20260709 13:01:05.731648   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:05.731890 10577 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:05.731951   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:05.732362   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:05.732853 10577 heartbeater.cc:507] Master 127.0.107.254:39243 requested a full tablet report, sending...
I20260709 13:01:05.733978   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-1-root/instance:
uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
format_stamp: "Formatted at 2026-07-09 13:01:05 on dist-test-slave-73vh"
I20260709 13:01:05.735219 10450 ts_manager.cc:194] Registered new tserver with Master: 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839)
I20260709 13:01:05.737097 10450 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50214
I20260709 13:01:05.739009   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:01:05.742637 10589 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.743360   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:05.743629   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-1-root
uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
format_stamp: "Formatted at 2026-07-09 13:01:05 on dist-test-slave-73vh"
I20260709 13:01:05.743860   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:05.759739   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:05.760900   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:05.762243   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:05.764336   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:05.764506   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.764850   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:05.765012   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.805275   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37141
I20260709 13:01:05.805387 10651 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37141 every 8 connection(s)
I20260709 13:01:05.810221   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:05.817378 10655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:05.818104 10656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:05.822288 10659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:05.822321   431 server_base.cc:1061] running on GCE node
I20260709 13:01:05.823220 10652 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39243
I20260709 13:01:05.823659 10652 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:05.823944   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:05.824227   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:05.824409   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602065824395 us; error 0 us; skew 500 ppm
I20260709 13:01:05.824450 10652 heartbeater.cc:507] Master 127.0.107.254:39243 requested a full tablet report, sending...
I20260709 13:01:05.825114   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:05.826749 10450 ts_manager.cc:194] Registered new tserver with Master: cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:05.827935   431 webserver.cc:533] Webserver started at http://127.0.107.195:40041/ using document root <none> and password file <none>
I20260709 13:01:05.828218 10450 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50222
I20260709 13:01:05.828469   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:05.828819   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:05.829114   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:05.830376   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-2-root/instance:
uuid: "2c1ca790591f42ecbb5522152122eb5d"
format_stamp: "Formatted at 2026-07-09 13:01:05 on dist-test-slave-73vh"
I20260709 13:01:05.834790   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:05.838047 10663 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.838784   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:01:05.839082   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-2-root
uuid: "2c1ca790591f42ecbb5522152122eb5d"
format_stamp: "Formatted at 2026-07-09 13:01:05 on dist-test-slave-73vh"
I20260709 13:01:05.839351   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskn6nUuT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601766316156-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:05.861330   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:05.862593   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:05.864089   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:05.866358   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:05.866565   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.866825   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:05.866986   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:05.908186   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39831
I20260709 13:01:05.908316 10725 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39831 every 8 connection(s)
I20260709 13:01:05.922518 10726 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39243
I20260709 13:01:05.922974 10726 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:05.923707 10726 heartbeater.cc:507] Master 127.0.107.254:39243 requested a full tablet report, sending...
I20260709 13:01:05.925648 10450 ts_manager.cc:194] Registered new tserver with Master: 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:05.926009   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014693466s
I20260709 13:01:05.927323 10450 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50224
I20260709 13:01:05.951556 10450 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50228:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:05.954365 10450 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:06.028735 10691 tablet_service.cc:1511] Processing CreateTablet for tablet 6272cc1c4708433eb1f5b67046edb253 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:06.030287 10691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6272cc1c4708433eb1f5b67046edb253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.039971 10690 tablet_service.cc:1511] Processing CreateTablet for tablet bd1bc8f3de24442fb7d7b37a6e002b00 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:06.041558 10690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1bc8f3de24442fb7d7b37a6e002b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.042886 10542 tablet_service.cc:1511] Processing CreateTablet for tablet 6272cc1c4708433eb1f5b67046edb253 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:06.044343 10542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6272cc1c4708433eb1f5b67046edb253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.045871 10541 tablet_service.cc:1511] Processing CreateTablet for tablet bd1bc8f3de24442fb7d7b37a6e002b00 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:06.046377 10689 tablet_service.cc:1511] Processing CreateTablet for tablet c4fa13f278744c27810ecad0366b08f8 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:06.047767 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fa13f278744c27810ecad0366b08f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.048331 10540 tablet_service.cc:1511] Processing CreateTablet for tablet c4fa13f278744c27810ecad0366b08f8 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:06.048769 10536 tablet_service.cc:1511] Processing CreateTablet for tablet 46c29720ed0d4fa1afddf01203710826 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:06.049835 10688 tablet_service.cc:1511] Processing CreateTablet for tablet a27ffb93016c42b28364b40602cbf58e (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:06.050812 10686 tablet_service.cc:1511] Processing CreateTablet for tablet 84f8a422c5394e80b0c9aea3145a71e8 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:06.051290 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27ffb93016c42b28364b40602cbf58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.051055 10537 tablet_service.cc:1511] Processing CreateTablet for tablet 84f8a422c5394e80b0c9aea3145a71e8 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:06.053320 10538 tablet_service.cc:1511] Processing CreateTablet for tablet 83d47b175de44c19b4eea8c34e264733 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:06.053869 10687 tablet_service.cc:1511] Processing CreateTablet for tablet 83d47b175de44c19b4eea8c34e264733 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:06.055349 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d47b175de44c19b4eea8c34e264733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.055038 10539 tablet_service.cc:1511] Processing CreateTablet for tablet a27ffb93016c42b28364b40602cbf58e (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:06.057752 10686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f8a422c5394e80b0c9aea3145a71e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.054343 10537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f8a422c5394e80b0c9aea3145a71e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.061321 10536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c29720ed0d4fa1afddf01203710826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.062054 10539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27ffb93016c42b28364b40602cbf58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.064890 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fa13f278744c27810ecad0366b08f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.065527 10538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d47b175de44c19b4eea8c34e264733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.068951 10541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1bc8f3de24442fb7d7b37a6e002b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.082342 10685 tablet_service.cc:1511] Processing CreateTablet for tablet 46c29720ed0d4fa1afddf01203710826 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:06.083858 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c29720ed0d4fa1afddf01203710826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.108754 10741 tablet_bootstrap.cc:492] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:06.111256 10535 tablet_service.cc:1511] Processing CreateTablet for tablet 3e82fd94e36f44a4ac1bdabc5f287867 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:06.112820 10535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e82fd94e36f44a4ac1bdabc5f287867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.115293 10689 tablet_service.cc:1511] Processing CreateTablet for tablet 3e82fd94e36f44a4ac1bdabc5f287867 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:06.119216 10542 tablet_service.cc:1511] Processing CreateTablet for tablet 4fee234e8a894122a7ce2ce36cccb305 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:06.121588 10542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fee234e8a894122a7ce2ce36cccb305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.130371 10685 tablet_service.cc:1511] Processing CreateTablet for tablet 4fee234e8a894122a7ce2ce36cccb305 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:06.132603 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e82fd94e36f44a4ac1bdabc5f287867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.133225 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fee234e8a894122a7ce2ce36cccb305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.138862 10741 tablet_bootstrap.cc:654] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.153941 10614 tablet_service.cc:1511] Processing CreateTablet for tablet a27ffb93016c42b28364b40602cbf58e (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:06.154162 10611 tablet_service.cc:1511] Processing CreateTablet for tablet 46c29720ed0d4fa1afddf01203710826 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:06.155465 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27ffb93016c42b28364b40602cbf58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.157814 10613 tablet_service.cc:1511] Processing CreateTablet for tablet 83d47b175de44c19b4eea8c34e264733 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:06.158241 10609 tablet_service.cc:1511] Processing CreateTablet for tablet 4fee234e8a894122a7ce2ce36cccb305 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:06.156075 10610 tablet_service.cc:1511] Processing CreateTablet for tablet 3e82fd94e36f44a4ac1bdabc5f287867 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:06.159843 10612 tablet_service.cc:1511] Processing CreateTablet for tablet 84f8a422c5394e80b0c9aea3145a71e8 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:06.161369 10616 tablet_service.cc:1511] Processing CreateTablet for tablet bd1bc8f3de24442fb7d7b37a6e002b00 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:06.162066 10613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d47b175de44c19b4eea8c34e264733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.163142 10615 tablet_service.cc:1511] Processing CreateTablet for tablet c4fa13f278744c27810ecad0366b08f8 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:06.151615 10617 tablet_service.cc:1511] Processing CreateTablet for tablet 6272cc1c4708433eb1f5b67046edb253 (DEFAULT_TABLE table=test-workload [id=693434e0bad5406d98113b337c3121f3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:06.169377 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1bc8f3de24442fb7d7b37a6e002b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.172963 10741 tablet_bootstrap.cc:492] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:06.173503 10741 ts_tablet_manager.cc:1403] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.005s
I20260709 13:01:06.173520 10610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e82fd94e36f44a4ac1bdabc5f287867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.177827 10741 raft_consensus.cc:359] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:06.178679 10741 raft_consensus.cc:385] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.178992 10741 raft_consensus.cc:740] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.179508 10742 tablet_bootstrap.cc:492] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:06.179903 10741 consensus_queue.cc:260] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:06.181022 10609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fee234e8a894122a7ce2ce36cccb305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.184944 10611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c29720ed0d4fa1afddf01203710826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.188341 10612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f8a422c5394e80b0c9aea3145a71e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.193118 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fa13f278744c27810ecad0366b08f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.197533 10617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6272cc1c4708433eb1f5b67046edb253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.217051 10742 tablet_bootstrap.cc:654] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.221477 10742 tablet_bootstrap.cc:492] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:06.221915 10742 ts_tablet_manager.cc:1403] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.004s
I20260709 13:01:06.224117 10742 raft_consensus.cc:359] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.224700 10742 raft_consensus.cc:385] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.224956 10742 raft_consensus.cc:740] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.225950 10742 consensus_queue.cc:260] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.321907 10577 heartbeater.cc:499] Master 127.0.107.254:39243 was elected leader, sending a full tablet report...
I20260709 13:01:06.323551 10741 ts_tablet_manager.cc:1434] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.150s	user 0.041s	sys 0.078s
I20260709 13:01:06.324785 10741 tablet_bootstrap.cc:492] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:06.326774 10726 heartbeater.cc:499] Master 127.0.107.254:39243 was elected leader, sending a full tablet report...
I20260709 13:01:06.331897 10742 ts_tablet_manager.cc:1434] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.110s	user 0.031s	sys 0.070s
I20260709 13:01:06.332952 10742 tablet_bootstrap.cc:492] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:06.338277 10745 tablet_bootstrap.cc:492] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:06.339550 10742 tablet_bootstrap.cc:654] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.341737 10741 tablet_bootstrap.cc:654] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.351902 10742 tablet_bootstrap.cc:492] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:06.352389 10742 ts_tablet_manager.cc:1403] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:01:06.358566 10742 raft_consensus.cc:359] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.359318 10742 raft_consensus.cc:385] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.359639 10742 raft_consensus.cc:740] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.361752 10741 tablet_bootstrap.cc:492] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:06.362399 10741 ts_tablet_manager.cc:1403] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.006s
I20260709 13:01:06.362677 10745 tablet_bootstrap.cc:654] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.364403 10742 consensus_queue.cc:260] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.365478 10741 raft_consensus.cc:359] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.366225 10741 raft_consensus.cc:385] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.366537 10741 raft_consensus.cc:740] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.367600 10742 ts_tablet_manager.cc:1434] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:01:06.367445 10741 consensus_queue.cc:260] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.368594 10742 tablet_bootstrap.cc:492] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:06.368736 10745 tablet_bootstrap.cc:492] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:06.369318 10745 ts_tablet_manager.cc:1403] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 13:01:06.372370 10745 raft_consensus.cc:359] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.373198 10745 raft_consensus.cc:385] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.373549 10745 raft_consensus.cc:740] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.374311 10745 consensus_queue.cc:260] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.376019 10741 ts_tablet_manager.cc:1434] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:01:06.376127 10742 tablet_bootstrap.cc:654] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.379531 10741 tablet_bootstrap.cc:492] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:06.380138 10745 ts_tablet_manager.cc:1434] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:01:06.381111 10652 heartbeater.cc:499] Master 127.0.107.254:39243 was elected leader, sending a full tablet report...
I20260709 13:01:06.381491 10745 tablet_bootstrap.cc:492] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:06.385897 10742 tablet_bootstrap.cc:492] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:06.386459 10742 ts_tablet_manager.cc:1403] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 13:01:06.386795 10741 tablet_bootstrap.cc:654] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.389650 10745 tablet_bootstrap.cc:654] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.389719 10742 raft_consensus.cc:359] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.390753 10742 raft_consensus.cc:385] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.391149 10742 raft_consensus.cc:740] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.392114 10742 consensus_queue.cc:260] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.395098 10742 ts_tablet_manager.cc:1434] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:06.396416 10742 tablet_bootstrap.cc:492] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:06.405011 10742 tablet_bootstrap.cc:654] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.427815 10741 tablet_bootstrap.cc:492] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:06.427858 10742 tablet_bootstrap.cc:492] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:06.428419 10745 tablet_bootstrap.cc:492] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:06.428442 10741 ts_tablet_manager.cc:1403] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.019s
I20260709 13:01:06.428498 10742 ts_tablet_manager.cc:1403] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.020s
I20260709 13:01:06.429072 10745 ts_tablet_manager.cc:1403] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.020s
I20260709 13:01:06.431594 10745 raft_consensus.cc:359] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.432140 10745 raft_consensus.cc:385] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.432094 10742 raft_consensus.cc:359] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.432322 10741 raft_consensus.cc:359] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.432862 10745 raft_consensus.cc:740] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.433096 10742 raft_consensus.cc:385] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.433213 10741 raft_consensus.cc:385] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.433501 10742 raft_consensus.cc:740] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.433581 10741 raft_consensus.cc:740] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.433784 10745 consensus_queue.cc:260] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.434394 10742 consensus_queue.cc:260] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.434552 10741 consensus_queue.cc:260] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.436434 10745 ts_tablet_manager.cc:1434] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:06.437148 10742 ts_tablet_manager.cc:1434] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:01:06.437477 10745 tablet_bootstrap.cc:492] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:06.438202 10742 tablet_bootstrap.cc:492] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:06.438853 10741 ts_tablet_manager.cc:1434] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 13:01:06.440141 10741 tablet_bootstrap.cc:492] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:06.445935 10742 tablet_bootstrap.cc:654] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.446049 10745 tablet_bootstrap.cc:654] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.446822 10741 tablet_bootstrap.cc:654] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.455591 10747 raft_consensus.cc:493] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.456208 10747 raft_consensus.cc:515] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.464063 10747 leader_election.cc:290] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.488471 10745 tablet_bootstrap.cc:492] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:06.489104 10745 ts_tablet_manager.cc:1403] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.007s
I20260709 13:01:06.491321 10745 raft_consensus.cc:359] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.491879 10745 raft_consensus.cc:385] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.492251 10745 raft_consensus.cc:740] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.494204 10747 raft_consensus.cc:493] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.494791 10747 raft_consensus.cc:515] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.497128 10747 leader_election.cc:290] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.493340 10745 consensus_queue.cc:260] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.500798 10745 ts_tablet_manager.cc:1434] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:01:06.501968 10745 tablet_bootstrap.cc:492] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:06.503260 10742 tablet_bootstrap.cc:492] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:06.503844 10742 ts_tablet_manager.cc:1403] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.036s
I20260709 13:01:06.506975 10742 raft_consensus.cc:359] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.507725 10742 raft_consensus.cc:385] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.508019 10742 raft_consensus.cc:740] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.508882 10745 tablet_bootstrap.cc:654] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.508808 10742 consensus_queue.cc:260] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.511262 10742 ts_tablet_manager.cc:1434] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:01:06.512239 10742 tablet_bootstrap.cc:492] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:06.516032 10741 tablet_bootstrap.cc:492] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:06.516577 10741 ts_tablet_manager.cc:1403] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.039s
I20260709 13:01:06.519644 10741 raft_consensus.cc:359] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.520339 10741 raft_consensus.cc:385] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.520848 10742 tablet_bootstrap.cc:654] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.521899 10747 raft_consensus.cc:493] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.522648 10747 raft_consensus.cc:515] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.525169 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c29720ed0d4fa1afddf01203710826" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:06.526181 10552 raft_consensus.cc:2468] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
I20260709 13:01:06.520633 10741 raft_consensus.cc:740] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.528892 10741 consensus_queue.cc:260] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.538091 10741 ts_tablet_manager.cc:1434] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:01:06.539434 10741 tablet_bootstrap.cc:492] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:06.527833 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
W20260709 13:01:06.545477 10498 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:06.546550 10744 raft_consensus.cc:493] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.547256 10744 raft_consensus.cc:515] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.549687 10664 leader_election.cc:304] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:06.553107 10741 tablet_bootstrap.cc:654] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.555816 10751 raft_consensus.cc:493] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.556563 10751 raft_consensus.cc:515] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.561730 10751 leader_election.cc:290] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:06.570683 10747 leader_election.cc:290] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.571511 10747 raft_consensus.cc:493] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.597054 10744 leader_election.cc:290] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:06.597931 10744 raft_consensus.cc:493] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.598559 10744 raft_consensus.cc:515] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.572149 10747 raft_consensus.cc:515] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.613878 10747 leader_election.cc:290] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.614683 10747 raft_consensus.cc:2804] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.615144 10747 raft_consensus.cc:493] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.615643 10747 raft_consensus.cc:3060] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.636979 10744 leader_election.cc:290] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:06.656481 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c29720ed0d4fa1afddf01203710826" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:06.661213 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82fd94e36f44a4ac1bdabc5f287867" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:06.661660 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fa13f278744c27810ecad0366b08f8" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:06.662949 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:06.663916 10627 raft_consensus.cc:2468] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
W20260709 13:01:06.665833 10665 leader_election.cc:343] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:06.666908 10665 leader_election.cc:343] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:06.667816 10665 leader_election.cc:343] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.669497 10665 leader_election.cc:304] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:06.682340 10764 raft_consensus.cc:493] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.683115 10764 raft_consensus.cc:515] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
W20260709 13:01:06.696441 10664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 147016us
W20260709 13:01:06.701709 10664 leader_election.cc:343] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.704871 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82fd94e36f44a4ac1bdabc5f287867" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:06.707129 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fa13f278744c27810ecad0366b08f8" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:06.709034 10768 raft_consensus.cc:493] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.709805 10768 raft_consensus.cc:515] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:06.721948 10763 raft_consensus.cc:2804] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.722661 10763 raft_consensus.cc:493] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.723142 10763 raft_consensus.cc:3060] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.732138 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
W20260709 13:01:06.734453 10665 leader_election.cc:343] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:06.737551 10664 leader_election.cc:343] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.738281 10664 leader_election.cc:304] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d; no voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:06.741263 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:06.741930 10741 tablet_bootstrap.cc:492] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:06.742249 10551 raft_consensus.cc:2468] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
I20260709 13:01:06.742705 10741 ts_tablet_manager.cc:1403] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.204s	user 0.020s	sys 0.068s
I20260709 13:01:06.752549 10764 leader_election.cc:290] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.753296 10764 raft_consensus.cc:2749] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.754097 10768 leader_election.cc:290] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.755553 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:06.756311 10627 raft_consensus.cc:2468] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
W20260709 13:01:06.757416 10664 leader_election.cc:343] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.757009 10741 raft_consensus.cc:359] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.758224 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:06.759078 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:06.765421 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:06.760902 10742 tablet_bootstrap.cc:492] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:06.763252 10516 leader_election.cc:304] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:06.764586 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:06.765749 10741 raft_consensus.cc:385] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.766055 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
W20260709 13:01:06.767761 10515 leader_election.cc:343] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.765471 10763 raft_consensus.cc:515] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.768332 10700 raft_consensus.cc:2468] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
W20260709 13:01:06.768570 10515 leader_election.cc:343] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:06.768836 10516 leader_election.cc:343] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.767642 10741 raft_consensus.cc:740] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.769377 10516 leader_election.cc:304] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0; no voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:06.770290 10744 raft_consensus.cc:2804] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.770741 10744 raft_consensus.cc:493] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.771035 10745 tablet_bootstrap.cc:492] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:06.771127 10744 raft_consensus.cc:3060] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.771229 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:06.771684 10745 ts_tablet_manager.cc:1403] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.270s	user 0.116s	sys 0.122s
I20260709 13:01:06.771994 10627 raft_consensus.cc:3060] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.770133 10741 consensus_queue.cc:260] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.775408 10745 raft_consensus.cc:359] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.776096 10745 raft_consensus.cc:385] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.776790 10768 raft_consensus.cc:2749] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.767146 10742 ts_tablet_manager.cc:1403] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.255s	user 0.106s	sys 0.135s
I20260709 13:01:06.779863 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:06.780794 10700 raft_consensus.cc:2393] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdb36daa5dfe484a984b2cb6ff5ff145 in current term 1: Already voted for candidate 2c1ca790591f42ecbb5522152122eb5d in this term.
W20260709 13:01:06.781076 10516 leader_election.cc:343] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.765769 10664 leader_election.cc:304] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d; no voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:06.781767 10515 leader_election.cc:304] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:06.782737 10747 raft_consensus.cc:515] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.783372 10768 raft_consensus.cc:2804] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.783703 10773 raft_consensus.cc:2749] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.782981 10664 leader_election.cc:304] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:06.780525 10742 raft_consensus.cc:359] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.785758 10742 raft_consensus.cc:385] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.785877 10773 raft_consensus.cc:2804] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.785976 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c29720ed0d4fa1afddf01203710826" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:06.786749 10773 raft_consensus.cc:493] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.784798 10763 leader_election.cc:290] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.776400 10745 raft_consensus.cc:740] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.780272 10627 raft_consensus.cc:2468] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 1.
I20260709 13:01:06.787315 10773 raft_consensus.cc:3060] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.787881 10745 consensus_queue.cc:260] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.788414 10665 leader_election.cc:304] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:06.790198 10745 ts_tablet_manager.cc:1434] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:01:06.790520 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:06.790943 10625 raft_consensus.cc:3060] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.791235 10745 tablet_bootstrap.cc:492] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:06.783849 10768 raft_consensus.cc:493] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.792301 10768 raft_consensus.cc:3060] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.784960 10747 leader_election.cc:290] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.786091 10742 raft_consensus.cc:740] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.797123 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c29720ed0d4fa1afddf01203710826" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:06.798144 10551 raft_consensus.cc:3060] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.798149 10742 consensus_queue.cc:260] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.800839 10745 tablet_bootstrap.cc:654] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.801017 10742 ts_tablet_manager.cc:1434] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:01:06.802340 10742 tablet_bootstrap.cc:492] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:06.805328 10764 raft_consensus.cc:493] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.805948 10764 raft_consensus.cc:515] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
W20260709 13:01:06.809448 10664 leader_election.cc:343] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.809877 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:06.810189 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:06.811090 10626 raft_consensus.cc:2468] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
I20260709 13:01:06.812008 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:06.812776 10665 leader_election.cc:304] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
W20260709 13:01:06.813145 10590 leader_election.cc:343] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.811403 10742 tablet_bootstrap.cc:654] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.813709 10590 leader_election.cc:304] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d
I20260709 13:01:06.814883 10751 raft_consensus.cc:2749] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.808538 10764 leader_election.cc:290] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.816825 10764 raft_consensus.cc:2804] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.817296 10764 raft_consensus.cc:493] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.817749 10764 raft_consensus.cc:3060] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.825702 10625 raft_consensus.cc:2468] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 1.
I20260709 13:01:06.797194 10747 raft_consensus.cc:2804] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.826977 10747 raft_consensus.cc:697] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Leader. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:06.833258 10747 consensus_queue.cc:237] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.842847 10741 ts_tablet_manager.cc:1434] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.100s	user 0.014s	sys 0.002s
I20260709 13:01:06.843976 10751 raft_consensus.cc:493] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.844726 10751 raft_consensus.cc:515] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.847625 10751 leader_election.cc:290] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:06.850808 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1bc8f3de24442fb7d7b37a6e002b00" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
W20260709 13:01:06.853278 10590 leader_election.cc:343] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.853554 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1bc8f3de24442fb7d7b37a6e002b00" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:06.854858 10741 tablet_bootstrap.cc:492] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
W20260709 13:01:06.855530 10590 leader_election.cc:343] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.856176 10590 leader_election.cc:304] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d
I20260709 13:01:06.857081 10551 raft_consensus.cc:2468] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 1.
I20260709 13:01:06.857223 10751 raft_consensus.cc:2749] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.859172 10664 leader_election.cc:304] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
W20260709 13:01:06.859313 10665 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37141, user_credentials={real_user=slave}} blocked reactor thread for 46681.1us
I20260709 13:01:06.859563 10744 raft_consensus.cc:515] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.861079 10552 raft_consensus.cc:2393] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c1ca790591f42ecbb5522152122eb5d in current term 1: Already voted for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in this term.
I20260709 13:01:06.861078 10778 raft_consensus.cc:2804] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.863377 10778 raft_consensus.cc:697] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Leader. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:06.865800 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:06.866611 10625 raft_consensus.cc:3060] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.865820 10778 consensus_queue.cc:237] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.867038 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:06.873159 10744 leader_election.cc:290] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:06.876334 10742 tablet_bootstrap.cc:492] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:06.876379 10745 tablet_bootstrap.cc:492] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:06.876924 10742 ts_tablet_manager.cc:1403] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.033s
I20260709 13:01:06.877389 10745 ts_tablet_manager.cc:1403] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.086s	user 0.030s	sys 0.040s
I20260709 13:01:06.876444 10764 raft_consensus.cc:515] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.878399 10773 raft_consensus.cc:515] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.879994 10742 raft_consensus.cc:359] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.882834 10742 raft_consensus.cc:385] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.880630 10773 leader_election.cc:290] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.881150 10741 tablet_bootstrap.cc:654] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.883173 10742 raft_consensus.cc:740] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.883191 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:06.875938 10768 raft_consensus.cc:515] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.889585 10700 raft_consensus.cc:2393] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 15c9c27062ce42f18cc2fd3e04e355a0 in current term 1: Already voted for candidate 2c1ca790591f42ecbb5522152122eb5d in this term.
I20260709 13:01:06.889699 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:06.891067 10552 raft_consensus.cc:2393] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c1ca790591f42ecbb5522152122eb5d in current term 1: Already voted for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in this term.
W20260709 13:01:06.892242 10665 leader_election.cc:343] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.895188 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
W20260709 13:01:06.896914 10516 leader_election.cc:343] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:06.900166 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:06.903898 10552 raft_consensus.cc:2393] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c1ca790591f42ecbb5522152122eb5d in current term 1: Already voted for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in this term.
I20260709 13:01:06.904038 10764 leader_election.cc:290] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:06.904245 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:06.883975 10742 consensus_queue.cc:260] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.905496 10664 leader_election.cc:304] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d; no voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:06.905843 10665 leader_election.cc:304] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d; no voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:06.902577 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:06.898811 10745 raft_consensus.cc:359] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:06.883313 10625 raft_consensus.cc:2468] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:06.907130 10700 raft_consensus.cc:2393] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 15c9c27062ce42f18cc2fd3e04e355a0 in current term 1: Already voted for candidate 2c1ca790591f42ecbb5522152122eb5d in this term.
I20260709 13:01:06.907630 10745 raft_consensus.cc:385] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.908291 10763 raft_consensus.cc:2749] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.908685 10745 raft_consensus.cc:740] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.909036 10516 leader_election.cc:304] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 2c1ca790591f42ecbb5522152122eb5d
I20260709 13:01:06.907686 10764 raft_consensus.cc:2749] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.907037 10742 ts_tablet_manager.cc:1434] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:01:06.914780 10742 tablet_bootstrap.cc:492] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:06.918816 10515 leader_election.cc:304] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0; no voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:06.919430 10744 raft_consensus.cc:2804] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:06.909511 10745 consensus_queue.cc:260] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:06.920622 10775 raft_consensus.cc:2749] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:06.922624 10745 ts_tablet_manager.cc:1434] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 13:01:06.923727 10745 tablet_bootstrap.cc:492] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:06.907178 10768 leader_election.cc:290] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:06.925168 10742 tablet_bootstrap.cc:654] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.936589 10745 tablet_bootstrap.cc:654] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.939142 10449 catalog_manager.cc:5697] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2c1ca790591f42ecbb5522152122eb5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.943889 10449 catalog_manager.cc:5697] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2c1ca790591f42ecbb5522152122eb5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.942147 10744 raft_consensus.cc:697] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:06.949813 10742 tablet_bootstrap.cc:492] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:06.950497 10742 ts_tablet_manager.cc:1403] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.016s
I20260709 13:01:06.950194 10744 consensus_queue.cc:237] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.954457 10742 raft_consensus.cc:359] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:06.955127 10742 raft_consensus.cc:385] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.955399 10742 raft_consensus.cc:740] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.955906 10741 tablet_bootstrap.cc:492] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:06.956107 10745 tablet_bootstrap.cc:492] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:06.956435 10741 ts_tablet_manager.cc:1403] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.009s
I20260709 13:01:06.956204 10742 consensus_queue.cc:260] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:06.956971 10745 ts_tablet_manager.cc:1403] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.008s
I20260709 13:01:06.958585 10742 ts_tablet_manager.cc:1434] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:06.959492 10742 tablet_bootstrap.cc:492] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:06.961031 10745 raft_consensus.cc:359] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.962112 10745 raft_consensus.cc:385] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.962581 10745 raft_consensus.cc:740] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.959857 10741 raft_consensus.cc:359] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.963591 10745 consensus_queue.cc:260] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.967150 10751 raft_consensus.cc:493] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.967850 10751 raft_consensus.cc:515] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:06.963615 10741 raft_consensus.cc:385] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:06.970418 10751 leader_election.cc:290] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831), 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839)
I20260709 13:01:06.970635 10745 ts_tablet_manager.cc:1434] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:01:06.971921 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:06.972103 10745 tablet_bootstrap.cc:492] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:06.972672 10700 raft_consensus.cc:2468] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:06.972895 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:06.973801 10552 raft_consensus.cc:2468] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:06.974011 10590 leader_election.cc:304] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:06.972920 10742 tablet_bootstrap.cc:654] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.975814 10751 raft_consensus.cc:2804] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:06.976282 10751 raft_consensus.cc:493] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.976677 10751 raft_consensus.cc:3060] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.979763 10745 tablet_bootstrap.cc:654] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:06.969664 10741 raft_consensus.cc:740] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:06.987293 10741 consensus_queue.cc:260] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:06.993641 10751 raft_consensus.cc:515] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:06.995765 10751 leader_election.cc:290] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Requested vote from peers 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831), 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839)
I20260709 13:01:06.997411 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:06.998224 10552 raft_consensus.cc:3060] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:06.990052 10447 catalog_manager.cc:5697] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.005692 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:07.006552 10700 raft_consensus.cc:3060] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.011410 10742 tablet_bootstrap.cc:492] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:07.012259 10742 ts_tablet_manager.cc:1403] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.016s
I20260709 13:01:07.014794 10745 tablet_bootstrap.cc:492] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:07.015364 10745 ts_tablet_manager.cc:1403] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.022s
I20260709 13:01:07.015463 10700 raft_consensus.cc:2468] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:07.016806 10590 leader_election.cc:304] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:07.017678 10751 raft_consensus.cc:2804] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:07.017776 10742 raft_consensus.cc:359] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.018730 10742 raft_consensus.cc:385] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.020828 10742 raft_consensus.cc:740] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.021700 10742 consensus_queue.cc:260] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.022357 10552 raft_consensus.cc:2468] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:07.023901 10742 ts_tablet_manager.cc:1434] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:01:07.024171 10741 ts_tablet_manager.cc:1434] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.002s
I20260709 13:01:07.025552 10741 tablet_bootstrap.cc:492] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:07.018522 10745 raft_consensus.cc:359] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.030609 10745 raft_consensus.cc:385] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.031016 10745 raft_consensus.cc:740] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.031780 10751 raft_consensus.cc:697] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:07.031838 10745 consensus_queue.cc:260] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.034093 10751 consensus_queue.cc:237] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:07.034772 10741 tablet_bootstrap.cc:654] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.040172 10745 ts_tablet_manager.cc:1434] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:01:07.041698 10745 tablet_bootstrap.cc:492] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:07.046670 10741 tablet_bootstrap.cc:492] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:07.047236 10741 ts_tablet_manager.cc:1403] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.002s
I20260709 13:01:07.048489 10745 tablet_bootstrap.cc:654] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.050231 10741 raft_consensus.cc:359] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.051152 10741 raft_consensus.cc:385] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.050196 10447 catalog_manager.cc:5697] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.051460 10741 raft_consensus.cc:740] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.052263 10741 consensus_queue.cc:260] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.052874 10745 tablet_bootstrap.cc:492] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:07.053381 10745 ts_tablet_manager.cc:1403] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:01:07.054602 10741 ts_tablet_manager.cc:1434] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:07.056185 10741 tablet_bootstrap.cc:492] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:07.056097 10745 raft_consensus.cc:359] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.056923 10745 raft_consensus.cc:385] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.057240 10744 raft_consensus.cc:493] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.057749 10744 raft_consensus.cc:515] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.059937 10744 leader_election.cc:290] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:07.057219 10745 raft_consensus.cc:740] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.061657 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fa13f278744c27810ecad0366b08f8" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:07.062299 10745 consensus_queue.cc:260] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.062685 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fa13f278744c27810ecad0366b08f8" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:07.063385 10700 raft_consensus.cc:2468] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
I20260709 13:01:07.063694 10741 tablet_bootstrap.cc:654] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.064819 10515 leader_election.cc:304] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:07.065786 10625 raft_consensus.cc:2468] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
I20260709 13:01:07.067490 10745 ts_tablet_manager.cc:1434] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:01:07.068499 10745 tablet_bootstrap.cc:492] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:07.068655 10744 raft_consensus.cc:2804] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:07.069240 10744 raft_consensus.cc:493] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.069674 10744 raft_consensus.cc:3060] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.074988 10745 tablet_bootstrap.cc:654] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.080370 10744 raft_consensus.cc:515] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.084127 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fa13f278744c27810ecad0366b08f8" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:07.084898 10625 raft_consensus.cc:3060] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.089519 10744 leader_election.cc:290] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:07.090865 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fa13f278744c27810ecad0366b08f8" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:07.091436 10700 raft_consensus.cc:3060] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.093181 10741 tablet_bootstrap.cc:492] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:07.093763 10741 ts_tablet_manager.cc:1403] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.038s	user 0.026s	sys 0.009s
I20260709 13:01:07.094058 10745 tablet_bootstrap.cc:492] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:07.094578 10745 ts_tablet_manager.cc:1403] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 13:01:07.096766 10741 raft_consensus.cc:359] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.097110 10625 raft_consensus.cc:2468] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:07.097605 10741 raft_consensus.cc:385] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.097321 10745 raft_consensus.cc:359] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.098016 10741 raft_consensus.cc:740] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.098202 10745 raft_consensus.cc:385] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.098539 10745 raft_consensus.cc:740] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.098451 10516 leader_election.cc:304] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:07.098852 10741 consensus_queue.cc:260] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.099227 10700 raft_consensus.cc:2468] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:07.099330 10744 raft_consensus.cc:2804] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:07.099748 10745 consensus_queue.cc:260] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.100255 10744 raft_consensus.cc:697] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:07.101156 10741 ts_tablet_manager.cc:1434] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:07.101202 10744 consensus_queue.cc:237] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.102294 10741 tablet_bootstrap.cc:492] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:07.103760 10745 ts_tablet_manager.cc:1434] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:01:07.116240 10741 tablet_bootstrap.cc:654] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.116313 10448 catalog_manager.cc:5697] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.121455 10792 raft_consensus.cc:493] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.122046 10792 raft_consensus.cc:515] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.125200 10792 leader_election.cc:290] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:07.126367 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82fd94e36f44a4ac1bdabc5f287867" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:07.126358 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82fd94e36f44a4ac1bdabc5f287867" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:07.127321 10741 tablet_bootstrap.cc:492] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:07.127228 10552 raft_consensus.cc:2468] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:07.127792 10700 raft_consensus.cc:2468] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:07.128624 10590 leader_election.cc:304] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:07.129467 10792 raft_consensus.cc:2804] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:07.129908 10792 raft_consensus.cc:493] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.130415 10792 raft_consensus.cc:3060] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.131482 10741 ts_tablet_manager.cc:1403] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.002s
I20260709 13:01:07.134271 10741 raft_consensus.cc:359] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.134930 10741 raft_consensus.cc:385] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.135202 10741 raft_consensus.cc:740] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.135951 10741 consensus_queue.cc:260] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.138059 10741 ts_tablet_manager.cc:1434] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:07.139178 10792 raft_consensus.cc:515] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.142282 10792 leader_election.cc:290] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:07.142933 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82fd94e36f44a4ac1bdabc5f287867" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:07.143700 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82fd94e36f44a4ac1bdabc5f287867" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:07.144483 10552 raft_consensus.cc:3060] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.144507 10700 raft_consensus.cc:3060] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.151857 10552 raft_consensus.cc:2468] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:07.151857 10700 raft_consensus.cc:2468] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:07.153090 10590 leader_election.cc:304] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:07.153710 10792 raft_consensus.cc:2804] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:07.154196 10792 raft_consensus.cc:697] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:07.154917 10792 consensus_queue.cc:237] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.161634 10448 catalog_manager.cc:5697] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.274678 10552 raft_consensus.cc:3060] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.281160 10747 consensus_queue.cc:1048] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.282534 10747 consensus_queue.cc:1048] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.285598 10744 raft_consensus.cc:493] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.286142 10744 raft_consensus.cc:515] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.289142 10744 leader_election.cc:290] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:07.290067 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1bc8f3de24442fb7d7b37a6e002b00" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:07.290827 10700 raft_consensus.cc:2468] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
I20260709 13:01:07.290941 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1bc8f3de24442fb7d7b37a6e002b00" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:07.291611 10625 raft_consensus.cc:2468] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
I20260709 13:01:07.292157 10515 leader_election.cc:304] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:07.293063 10744 raft_consensus.cc:2804] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:07.293430 10744 raft_consensus.cc:493] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.293751 10744 raft_consensus.cc:3060] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.296051 10768 raft_consensus.cc:493] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.296440 10792 raft_consensus.cc:493] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.296773 10768 raft_consensus.cc:515] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.297044 10792 raft_consensus.cc:515] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.299959 10792 leader_election.cc:290] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:07.300467 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:07.306779 10625 raft_consensus.cc:2468] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
I20260709 13:01:07.306779 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:07.307440 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:07.307925 10701 raft_consensus.cc:2468] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
I20260709 13:01:07.308156 10700 raft_consensus.cc:2393] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdb36daa5dfe484a984b2cb6ff5ff145 in current term 1: Already voted for candidate 2c1ca790591f42ecbb5522152122eb5d in this term.
I20260709 13:01:07.301716 10768 leader_election.cc:290] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:07.304606 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:07.309494 10551 raft_consensus.cc:2393] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdb36daa5dfe484a984b2cb6ff5ff145 in current term 1: Already voted for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in this term.
I20260709 13:01:07.309880 10515 leader_election.cc:304] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:07.310943 10782 raft_consensus.cc:2804] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:07.311345 10782 raft_consensus.cc:493] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.311661 10782 raft_consensus.cc:3060] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.313637 10778 consensus_queue.cc:1048] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.313985 10590 leader_election.cc:304] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d
I20260709 13:01:07.305832 10744 raft_consensus.cc:515] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.315218 10792 raft_consensus.cc:3060] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.323154 10782 raft_consensus.cc:515] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.323469 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1bc8f3de24442fb7d7b37a6e002b00" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:07.324366 10627 raft_consensus.cc:3060] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.326246 10782 leader_election.cc:290] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:07.329187 10744 leader_election.cc:290] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:07.331023 10764 consensus_queue.cc:1048] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.333292 10627 raft_consensus.cc:2468] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:07.334578 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:07.335177 10626 raft_consensus.cc:3060] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.335476 10516 leader_election.cc:304] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:07.337857 10744 raft_consensus.cc:2804] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:07.338335 10744 raft_consensus.cc:697] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:07.339143 10744 consensus_queue.cc:237] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.342805 10626 raft_consensus.cc:2468] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:07.343681 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1bc8f3de24442fb7d7b37a6e002b00" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:07.344328 10701 raft_consensus.cc:3060] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.347338 10516 leader_election.cc:304] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:07.348754 10768 raft_consensus.cc:2804] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:07.348999 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:07.349390 10768 raft_consensus.cc:697] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:07.349697 10700 raft_consensus.cc:3060] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.350564 10768 consensus_queue.cc:237] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:07.353125 10701 raft_consensus.cc:2468] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:07.358013 10792 raft_consensus.cc:2749] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:07.363026 10700 raft_consensus.cc:2468] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:07.373960 10447 catalog_manager.cc:5697] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.375710 10447 catalog_manager.cc:5697] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.412544 10768 consensus_queue.cc:1048] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.423049 10782 consensus_queue.cc:1048] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.526804 10792 consensus_queue.cc:1048] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.537434 10751 consensus_queue.cc:1048] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:07.553601 10498 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:07.574648 10782 consensus_queue.cc:1048] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.585246 10744 consensus_queue.cc:1048] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.664156 10751 consensus_queue.cc:1048] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.676525 10751 consensus_queue.cc:1048] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.743790 10744 consensus_queue.cc:1048] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.753995 10775 consensus_queue.cc:1048] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.770187 10775 consensus_queue.cc:1048] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:07.780375 10744 consensus_queue.cc:1048] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:08.560180 10498 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:08.655100 10744 raft_consensus.cc:493] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.655725 10744 raft_consensus.cc:515] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:08.657567 10744 leader_election.cc:290] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:08.658458 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:08.658736 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:08.659168 10624 raft_consensus.cc:2468] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:08.659379 10700 raft_consensus.cc:2468] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:08.660619 10515 leader_election.cc:304] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:08.661355 10744 raft_consensus.cc:2804] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:08.661659 10744 raft_consensus.cc:493] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.661931 10744 raft_consensus.cc:3060] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.667153 10744 raft_consensus.cc:515] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:08.668622 10744 leader_election.cc:290] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:08.669417 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:08.669535 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:08.669996 10624 raft_consensus.cc:3060] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.670109 10700 raft_consensus.cc:3060] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.675191 10624 raft_consensus.cc:2468] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:08.675590 10700 raft_consensus.cc:2468] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:08.676337 10516 leader_election.cc:304] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:08.677114 10744 raft_consensus.cc:2804] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:08.677543 10744 raft_consensus.cc:697] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:08.678259 10744 consensus_queue.cc:237] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:08.684599 10448 catalog_manager.cc:5697] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 0 to 2, leader changed from <none> to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:08.766109 10624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
mode: GRACEFUL
new_leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:53232
I20260709 13:01:08.766671 10624 raft_consensus.cc:606] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Received request to transfer leadership to TS 15c9c27062ce42f18cc2fd3e04e355a0
I20260709 13:01:08.783591 10700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e"
dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
mode: GRACEFUL
new_leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:01:08.784111 10700 raft_consensus.cc:606] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Received request to transfer leadership to TS 15c9c27062ce42f18cc2fd3e04e355a0
I20260709 13:01:08.796861 10551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
mode: GRACEFUL
new_leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:38024
I20260709 13:01:08.797322 10551 raft_consensus.cc:606] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Received request to transfer leadership to TS cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:08.801599 10551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
mode: GRACEFUL
new_leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:38024
I20260709 13:01:08.801994 10551 raft_consensus.cc:606] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Received request to transfer leadership to TS cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:08.806502 10700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c29720ed0d4fa1afddf01203710826"
dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
mode: GRACEFUL
new_leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:01:08.807087 10700 raft_consensus.cc:606] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Received request to transfer leadership to TS cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:08.808559 10782 raft_consensus.cc:993] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0: : Instructing follower cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:08.809163 10744 raft_consensus.cc:1081] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Signalling peer cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:08.810626 10624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:53222
I20260709 13:01:08.811126 10624 raft_consensus.cc:493] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:08.811440 10624 raft_consensus.cc:3060] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.814536 10551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
mode: GRACEFUL
new_leader_uuid: "2c1ca790591f42ecbb5522152122eb5d"
 from {username='slave'} at 127.0.0.1:38024
I20260709 13:01:08.815171 10551 raft_consensus.cc:606] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Received request to transfer leadership to TS 2c1ca790591f42ecbb5522152122eb5d
I20260709 13:01:08.817418 10624 raft_consensus.cc:515] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:08.819028 10624 leader_election.cc:290] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:08.819721 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:08.820071 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d47b175de44c19b4eea8c34e264733" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:08.820299 10551 raft_consensus.cc:3055] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:08.820629 10700 raft_consensus.cc:3060] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.820716 10551 raft_consensus.cc:740] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:08.821658 10551 consensus_queue.cc:260] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:08.822613 10551 raft_consensus.cc:3060] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.825695 10700 raft_consensus.cc:2468] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:08.826799 10590 leader_election.cc:304] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:08.827668 10819 raft_consensus.cc:2804] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:08.828249 10551 raft_consensus.cc:2468] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:08.828750 10819 raft_consensus.cc:697] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:08.829540 10819 consensus_queue.cc:237] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:08.836598 10448 catalog_manager.cc:5697] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 1 to 2, leader changed from 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193) to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.044126 10834 raft_consensus.cc:993] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145: : Instructing follower 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:09.044605 10819 raft_consensus.cc:1081] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Signalling peer 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:09.046097 10551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:38016
I20260709 13:01:09.046590 10551 raft_consensus.cc:493] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:09.046905 10551 raft_consensus.cc:3060] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.051927 10551 raft_consensus.cc:515] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:09.053490 10551 leader_election.cc:290] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Requested vote from peers 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:09.054317 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:09.054554 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:09.055042 10701 raft_consensus.cc:3060] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.055111 10624 raft_consensus.cc:3055] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:09.055558 10624 raft_consensus.cc:740] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:09.056403 10624 consensus_queue.cc:260] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:09.057683 10624 raft_consensus.cc:3060] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.062311 10701 raft_consensus.cc:2468] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:09.063573 10515 leader_election.cc:304] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:09.064617 10744 raft_consensus.cc:2804] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:09.064999 10624 raft_consensus.cc:2468] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:09.065160 10744 raft_consensus.cc:697] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:09.066131 10744 consensus_queue.cc:237] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:09.075280 10448 catalog_manager.cc:5697] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 1 to 2, leader changed from cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194) to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.154999 10624 raft_consensus.cc:1275] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:09.156085 10744 consensus_queue.cc:1048] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:09.166299 10701 raft_consensus.cc:1275] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:09.168635 10744 consensus_queue.cc:1048] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:09.177100 10782 raft_consensus.cc:993] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0: : Instructing follower 2c1ca790591f42ecbb5522152122eb5d to start an election
I20260709 13:01:09.177551 10744 raft_consensus.cc:1081] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Signalling peer 2c1ca790591f42ecbb5522152122eb5d to start an election
I20260709 13:01:09.178962 10701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305"
dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
 from {username='slave'} at 127.0.0.1:58358
I20260709 13:01:09.179418 10701 raft_consensus.cc:493] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:09.179718 10701 raft_consensus.cc:3060] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.184902 10701 raft_consensus.cc:515] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.186523 10701 leader_election.cc:290] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 3 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:09.187490 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:09.188175 10551 raft_consensus.cc:3055] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:09.187624 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fee234e8a894122a7ce2ce36cccb305" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:09.188621 10551 raft_consensus.cc:740] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:09.188869 10624 raft_consensus.cc:3060] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.189509 10551 consensus_queue.cc:260] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.190817 10551 raft_consensus.cc:3060] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.196174 10624 raft_consensus.cc:2468] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 3.
I20260709 13:01:09.196758 10551 raft_consensus.cc:2468] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 3.
I20260709 13:01:09.197343 10665 leader_election.cc:304] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:09.198177 10778 raft_consensus.cc:2804] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:09.199420 10778 raft_consensus.cc:697] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 3 LEADER]: Becoming Leader. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:09.200158 10778 consensus_queue.cc:237] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.205790 10447 catalog_manager.cc:5697] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d reported cstate change: term changed from 2 to 3, leader changed from 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193) to 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2c1ca790591f42ecbb5522152122eb5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.255957 10782 raft_consensus.cc:993] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0: : Instructing follower cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:09.256448 10744 raft_consensus.cc:1081] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Signalling peer cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:09.258080 10624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:53222
I20260709 13:01:09.258556 10624 raft_consensus.cc:493] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:09.258865 10624 raft_consensus.cc:3060] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.264010 10624 raft_consensus.cc:515] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.265529 10624 leader_election.cc:290] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:09.266312 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:09.267249 10551 raft_consensus.cc:3055] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:09.267050 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:09.267956 10551 raft_consensus.cc:740] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:09.268256 10701 raft_consensus.cc:3060] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.269397 10551 consensus_queue.cc:260] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.271302 10551 raft_consensus.cc:3060] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.275642 10701 raft_consensus.cc:2468] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:09.276701 10590 leader_election.cc:304] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:09.276752 10551 raft_consensus.cc:2468] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:09.277449 10834 raft_consensus.cc:2804] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:09.277917 10834 raft_consensus.cc:697] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:09.278620 10834 consensus_queue.cc:237] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.285632 10447 catalog_manager.cc:5697] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 1 to 2, leader changed from 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193) to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.313535 10842 raft_consensus.cc:993] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d: : Instructing follower cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:09.314023 10778 raft_consensus.cc:1081] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Signalling peer cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:09.315337 10624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46c29720ed0d4fa1afddf01203710826"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:53216
I20260709 13:01:09.315761 10624 raft_consensus.cc:493] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:09.315999 10624 raft_consensus.cc:3060] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.321080 10624 raft_consensus.cc:515] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.322544 10624 leader_election.cc:290] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:09.323292 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c29720ed0d4fa1afddf01203710826" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:09.323515 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c29720ed0d4fa1afddf01203710826" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:09.323890 10551 raft_consensus.cc:3060] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.324105 10701 raft_consensus.cc:3055] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:09.324469 10701 raft_consensus.cc:740] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:09.325158 10701 consensus_queue.cc:260] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.326087 10701 raft_consensus.cc:3060] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.329068 10551 raft_consensus.cc:2468] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:09.330080 10590 leader_election.cc:304] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:09.330801 10834 raft_consensus.cc:2804] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:09.331225 10834 raft_consensus.cc:697] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:09.331419 10701 raft_consensus.cc:2468] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:09.332020 10834 consensus_queue.cc:237] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.339104 10447 catalog_manager.cc:5697] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 1 to 2, leader changed from 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195) to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.359143 10551 raft_consensus.cc:1275] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.360343 10834 consensus_queue.cc:1048] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.369771 10701 raft_consensus.cc:1275] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.371560 10819 consensus_queue.cc:1048] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.375401 10778 raft_consensus.cc:993] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d: : Instructing follower 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:09.375846 10778 raft_consensus.cc:1081] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Signalling peer 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:09.378660 10551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:38004
I20260709 13:01:09.379205 10551 raft_consensus.cc:493] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:09.379562 10551 raft_consensus.cc:3060] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.385037 10551 raft_consensus.cc:515] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.386792 10551 leader_election.cc:290] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:09.387486 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:09.387830 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27ffb93016c42b28364b40602cbf58e" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:09.388127 10624 raft_consensus.cc:3060] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.388422 10701 raft_consensus.cc:3055] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:09.388767 10701 raft_consensus.cc:740] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:09.389405 10701 consensus_queue.cc:260] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.390326 10701 raft_consensus.cc:3060] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.393278 10624 raft_consensus.cc:2468] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:09.394244 10516 leader_election.cc:304] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:09.394922 10744 raft_consensus.cc:2804] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:09.395395 10744 raft_consensus.cc:697] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:09.395646 10701 raft_consensus.cc:2468] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:09.396255 10744 consensus_queue.cc:237] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:09.404153 10448 catalog_manager.cc:5697] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 1 to 2, leader changed from 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195) to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.495776 10624 raft_consensus.cc:1275] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.497422 10744 consensus_queue.cc:1048] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.506402 10701 raft_consensus.cc:1275] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.507910 10850 consensus_queue.cc:1048] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.632722 10624 raft_consensus.cc:1275] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Refusing update from remote peer 2c1ca790591f42ecbb5522152122eb5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:09.633986 10778 consensus_queue.cc:1048] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.641412 10551 raft_consensus.cc:1275] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Refusing update from remote peer 2c1ca790591f42ecbb5522152122eb5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:09.644132 10778 consensus_queue.cc:1048] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.780560 10701 raft_consensus.cc:1275] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.781838 10819 consensus_queue.cc:1048] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.790153 10551 raft_consensus.cc:1275] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.791774 10846 consensus_queue.cc:1048] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.810118 10624 raft_consensus.cc:1275] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.811596 10850 consensus_queue.cc:1048] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.820089 10701 raft_consensus.cc:1275] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.822151 10782 consensus_queue.cc:1048] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.851429 10701 raft_consensus.cc:1275] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.852829 10846 consensus_queue.cc:1048] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.861325 10551 raft_consensus.cc:1275] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:09.863123 10834 consensus_queue.cc:1048] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:11.849120 10448 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50240:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:11.851115 10448 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:11.897280 10539 tablet_service.cc:1511] Processing CreateTablet for tablet 50dc273217804d8eb9a6a680caae410c (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:11.898620 10539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50dc273217804d8eb9a6a680caae410c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.898407 10612 tablet_service.cc:1511] Processing CreateTablet for tablet 50dc273217804d8eb9a6a680caae410c (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:11.899718 10612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50dc273217804d8eb9a6a680caae410c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.899969 10686 tablet_service.cc:1511] Processing CreateTablet for tablet 50dc273217804d8eb9a6a680caae410c (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:11.901154 10535 tablet_service.cc:1511] Processing CreateTablet for tablet b1023cdd02a8480db22322769db53fdd (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:11.902379 10535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1023cdd02a8480db22322769db53fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.903043 10613 tablet_service.cc:1511] Processing CreateTablet for tablet b1023cdd02a8480db22322769db53fdd (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:11.904254 10613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1023cdd02a8480db22322769db53fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.901202 10686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50dc273217804d8eb9a6a680caae410c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.915561 10691 tablet_service.cc:1511] Processing CreateTablet for tablet b1023cdd02a8480db22322769db53fdd (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:11.916914 10691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1023cdd02a8480db22322769db53fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.921909 10609 tablet_service.cc:1511] Processing CreateTablet for tablet 6848622d50e540b8a5493b25953022a2 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:11.923214 10609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6848622d50e540b8a5493b25953022a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.925806 10690 tablet_service.cc:1511] Processing CreateTablet for tablet 6848622d50e540b8a5493b25953022a2 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:11.927076 10690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6848622d50e540b8a5493b25953022a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.932157 10541 tablet_service.cc:1511] Processing CreateTablet for tablet c689f809a7a643f599d79d46304cdb4a (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:11.933492 10541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c689f809a7a643f599d79d46304cdb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.935096 10617 tablet_service.cc:1511] Processing CreateTablet for tablet c689f809a7a643f599d79d46304cdb4a (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:11.936404 10617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c689f809a7a643f599d79d46304cdb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.937100 10687 tablet_service.cc:1511] Processing CreateTablet for tablet c689f809a7a643f599d79d46304cdb4a (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:11.937731 10537 tablet_service.cc:1511] Processing CreateTablet for tablet 6848622d50e540b8a5493b25953022a2 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:11.938356 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c689f809a7a643f599d79d46304cdb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.939007 10537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6848622d50e540b8a5493b25953022a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.941670 10540 tablet_service.cc:1511] Processing CreateTablet for tablet 05f52d5fc1414f08b52ca7859f0c9b73 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:11.943066 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f52d5fc1414f08b52ca7859f0c9b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.941599 10615 tablet_service.cc:1511] Processing CreateTablet for tablet 05f52d5fc1414f08b52ca7859f0c9b73 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:11.946457 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f52d5fc1414f08b52ca7859f0c9b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.943238 10873 tablet_bootstrap.cc:492] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:11.946776 10688 tablet_service.cc:1511] Processing CreateTablet for tablet 05f52d5fc1414f08b52ca7859f0c9b73 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:11.948253 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f52d5fc1414f08b52ca7859f0c9b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.950224 10613 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd5c02c502b42818f2be56c72fde0ad (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:11.951467 10613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd5c02c502b42818f2be56c72fde0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.953373 10542 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd5c02c502b42818f2be56c72fde0ad (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:11.954623 10542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd5c02c502b42818f2be56c72fde0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.966455 10685 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd5c02c502b42818f2be56c72fde0ad (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:11.967829 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd5c02c502b42818f2be56c72fde0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.969662 10538 tablet_service.cc:1511] Processing CreateTablet for tablet 89efb476fccc486bbe2439bc55a5b32a (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:11.970952 10538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89efb476fccc486bbe2439bc55a5b32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.974613 10609 tablet_service.cc:1511] Processing CreateTablet for tablet 89efb476fccc486bbe2439bc55a5b32a (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:11.978536 10609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89efb476fccc486bbe2439bc55a5b32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.979182 10873 tablet_bootstrap.cc:654] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.982578 10536 tablet_service.cc:1511] Processing CreateTablet for tablet acb7c116fb024aba8140f07c0fbd1ff9 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:11.983799 10536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb7c116fb024aba8140f07c0fbd1ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.980352 10689 tablet_service.cc:1511] Processing CreateTablet for tablet 89efb476fccc486bbe2439bc55a5b32a (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:11.985783 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89efb476fccc486bbe2439bc55a5b32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.992347 10617 tablet_service.cc:1511] Processing CreateTablet for tablet acb7c116fb024aba8140f07c0fbd1ff9 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:11.993741 10617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb7c116fb024aba8140f07c0fbd1ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.993623 10684 tablet_service.cc:1511] Processing CreateTablet for tablet acb7c116fb024aba8140f07c0fbd1ff9 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:11.994961 10684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb7c116fb024aba8140f07c0fbd1ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:11.999931 10534 tablet_service.cc:1511] Processing CreateTablet for tablet 184eb284dc9a42d193e881faf4d29490 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:12.001257 10534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184eb284dc9a42d193e881faf4d29490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.002620 10683 tablet_service.cc:1511] Processing CreateTablet for tablet 184eb284dc9a42d193e881faf4d29490 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:12.003881 10683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184eb284dc9a42d193e881faf4d29490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.005087 10612 tablet_service.cc:1511] Processing CreateTablet for tablet 184eb284dc9a42d193e881faf4d29490 (DEFAULT_TABLE table=soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:12.006330 10612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184eb284dc9a42d193e881faf4d29490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.032895 10872 tablet_bootstrap.cc:492] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:12.076918 10873 tablet_bootstrap.cc:492] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:12.077543 10873 ts_tablet_manager.cc:1403] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.135s	user 0.006s	sys 0.006s
I20260709 13:01:12.081344 10873 raft_consensus.cc:359] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.082926 10873 raft_consensus.cc:385] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.083470 10875 tablet_bootstrap.cc:492] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:12.083274 10873 raft_consensus.cc:740] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.086733 10873 consensus_queue.cc:260] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.090633 10875 tablet_bootstrap.cc:654] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.092427 10872 tablet_bootstrap.cc:654] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.095631 10873 ts_tablet_manager.cc:1434] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:01:12.103755 10873 tablet_bootstrap.cc:492] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:12.112382 10873 tablet_bootstrap.cc:654] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.114326 10872 tablet_bootstrap.cc:492] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:12.114799 10872 ts_tablet_manager.cc:1403] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.004s
I20260709 13:01:12.117364 10872 raft_consensus.cc:359] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.118147 10872 raft_consensus.cc:385] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.118403 10872 raft_consensus.cc:740] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.118854 10875 tablet_bootstrap.cc:492] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:12.119267 10873 tablet_bootstrap.cc:492] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:12.119397 10875 ts_tablet_manager.cc:1403] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.020s
I20260709 13:01:12.119117 10872 consensus_queue.cc:260] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.119920 10873 ts_tablet_manager.cc:1403] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 13:01:12.121434 10872 ts_tablet_manager.cc:1434] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:12.122517 10872 tablet_bootstrap.cc:492] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:12.123063 10873 raft_consensus.cc:359] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.123829 10873 raft_consensus.cc:385] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.124185 10873 raft_consensus.cc:740] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.125003 10873 consensus_queue.cc:260] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
W20260709 13:01:12.126519 10653 tablet.cc:2406] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:12.129690 10872 tablet_bootstrap.cc:654] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.129712 10875 raft_consensus.cc:359] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.130712 10875 raft_consensus.cc:385] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.131047 10875 raft_consensus.cc:740] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.132040 10873 ts_tablet_manager.cc:1434] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:01:12.131844 10875 consensus_queue.cc:260] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.133201 10873 tablet_bootstrap.cc:492] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:12.134131 10875 ts_tablet_manager.cc:1434] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:01:12.135262 10875 tablet_bootstrap.cc:492] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:12.143237 10875 tablet_bootstrap.cc:654] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.143525 10873 tablet_bootstrap.cc:654] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.151551 10875 tablet_bootstrap.cc:492] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:12.152273 10875 ts_tablet_manager.cc:1403] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:01:12.156292 10875 raft_consensus.cc:359] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.157306 10875 raft_consensus.cc:385] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.157717 10875 raft_consensus.cc:740] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.158648 10875 consensus_queue.cc:260] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.162101 10875 ts_tablet_manager.cc:1434] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:01:12.163291 10875 tablet_bootstrap.cc:492] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:12.173365 10875 tablet_bootstrap.cc:654] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.181784 10872 tablet_bootstrap.cc:492] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:12.182579 10872 ts_tablet_manager.cc:1403] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.060s	user 0.034s	sys 0.016s
I20260709 13:01:12.189324 10873 tablet_bootstrap.cc:492] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:12.189999 10873 ts_tablet_manager.cc:1403] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.032s
I20260709 13:01:12.191697 10875 tablet_bootstrap.cc:492] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:12.188938 10872 raft_consensus.cc:359] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.192257 10875 ts_tablet_manager.cc:1403] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.013s
I20260709 13:01:12.192201 10872 raft_consensus.cc:385] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.192749 10872 raft_consensus.cc:740] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.192797 10873 raft_consensus.cc:359] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.193557 10873 raft_consensus.cc:385] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.193841 10873 raft_consensus.cc:740] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.194491 10873 consensus_queue.cc:260] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.193585 10872 consensus_queue.cc:260] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.195441 10875 raft_consensus.cc:359] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.196331 10875 raft_consensus.cc:385] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.196533 10873 ts_tablet_manager.cc:1434] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:01:12.196729 10875 raft_consensus.cc:740] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.197789 10873 tablet_bootstrap.cc:492] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:12.197754 10875 consensus_queue.cc:260] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.200086 10872 ts_tablet_manager.cc:1434] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:01:12.201179 10872 tablet_bootstrap.cc:492] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:12.202770 10875 ts_tablet_manager.cc:1434] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:12.203791 10875 tablet_bootstrap.cc:492] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:12.205229 10873 tablet_bootstrap.cc:654] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.207819 10872 tablet_bootstrap.cc:654] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.210337 10875 tablet_bootstrap.cc:654] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.214490 10861 raft_consensus.cc:493] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.215041 10861 raft_consensus.cc:515] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.217057 10873 tablet_bootstrap.cc:492] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:12.217308 10861 leader_election.cc:290] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.217562 10873 ts_tablet_manager.cc:1403] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:01:12.218124 10782 raft_consensus.cc:493] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.218640 10782 raft_consensus.cc:515] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.218725 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
W20260709 13:01:12.220803 10590 leader_election.cc:343] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.220825 10873 raft_consensus.cc:359] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.221858 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc273217804d8eb9a6a680caae410c" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:12.221892 10873 raft_consensus.cc:385] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.222354 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:12.222518 10873 raft_consensus.cc:740] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.222549 10624 raft_consensus.cc:2468] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
I20260709 13:01:12.223654 10873 consensus_queue.cc:260] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
W20260709 13:01:12.223990 10590 leader_election.cc:343] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.224802 10590 leader_election.cc:304] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d
I20260709 13:01:12.225376 10516 leader_election.cc:304] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.226076 10873 ts_tablet_manager.cc:1434] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:12.226969 10782 leader_election.cc:290] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.227279 10873 tablet_bootstrap.cc:492] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:12.227623 10782 raft_consensus.cc:2804] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.228003 10782 raft_consensus.cc:493] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.228358 10782 raft_consensus.cc:3060] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.236475 10886 raft_consensus.cc:2749] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.237591 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc273217804d8eb9a6a680caae410c" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:12.240047 10873 tablet_bootstrap.cc:654] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:12.244665 10515 leader_election.cc:343] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.245800 10875 tablet_bootstrap.cc:492] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:12.246373 10875 ts_tablet_manager.cc:1403] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.023s
I20260709 13:01:12.242857 10872 tablet_bootstrap.cc:492] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:12.247332 10872 ts_tablet_manager.cc:1403] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.010s
I20260709 13:01:12.249823 10875 raft_consensus.cc:359] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.250526 10875 raft_consensus.cc:385] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.251042 10875 raft_consensus.cc:740] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.251820 10875 consensus_queue.cc:260] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.253304 10873 tablet_bootstrap.cc:492] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:12.253899 10873 ts_tablet_manager.cc:1403] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.009s
I20260709 13:01:12.253964 10875 ts_tablet_manager.cc:1434] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:01:12.255024 10875 tablet_bootstrap.cc:492] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:12.256151 10782 raft_consensus.cc:515] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.257030 10873 raft_consensus.cc:359] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.257800 10873 raft_consensus.cc:385] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.258131 10873 raft_consensus.cc:740] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.250496 10872 raft_consensus.cc:359] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.259037 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc273217804d8eb9a6a680caae410c" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:12.258904 10873 consensus_queue.cc:260] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.259538 10872 raft_consensus.cc:385] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.259618 10624 raft_consensus.cc:3060] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.260006 10872 raft_consensus.cc:740] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.260393 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc273217804d8eb9a6a680caae410c" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:12.260994 10701 raft_consensus.cc:3060] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.260891 10872 consensus_queue.cc:260] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.263296 10872 ts_tablet_manager.cc:1434] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:01:12.264537 10872 tablet_bootstrap.cc:492] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:12.268560 10624 raft_consensus.cc:2468] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:12.270009 10516 leader_election.cc:304] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.271042 10872 tablet_bootstrap.cc:654] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.271308 10875 tablet_bootstrap.cc:654] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.273012 10887 raft_consensus.cc:2804] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.269244 10701 raft_consensus.cc:2468] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:12.279450 10873 ts_tablet_manager.cc:1434] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 13:01:12.285679 10872 tablet_bootstrap.cc:492] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:12.285733 10782 leader_election.cc:290] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.285910 10873 tablet_bootstrap.cc:492] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:12.286438 10872 ts_tablet_manager.cc:1403] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:01:12.289713 10875 tablet_bootstrap.cc:492] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:12.289759 10872 raft_consensus.cc:359] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.290648 10887 raft_consensus.cc:697] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:12.290807 10875 ts_tablet_manager.cc:1403] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.014s
I20260709 13:01:12.291738 10887 consensus_queue.cc:237] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.290802 10872 raft_consensus.cc:385] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.294363 10872 raft_consensus.cc:740] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.295390 10873 tablet_bootstrap.cc:654] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.295157 10872 consensus_queue.cc:260] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.297709 10872 ts_tablet_manager.cc:1434] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:01:12.298794 10872 tablet_bootstrap.cc:492] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:12.302205 10447 catalog_manager.cc:5697] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.304788 10875 raft_consensus.cc:359] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.305814 10875 raft_consensus.cc:385] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.306181 10875 raft_consensus.cc:740] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.306943 10875 consensus_queue.cc:260] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.310145 10875 ts_tablet_manager.cc:1434] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:01:12.311384 10875 tablet_bootstrap.cc:492] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:12.322046 10872 tablet_bootstrap.cc:654] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.324766 10873 tablet_bootstrap.cc:492] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:12.325328 10873 ts_tablet_manager.cc:1403] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.014s
I20260709 13:01:12.325567 10875 tablet_bootstrap.cc:654] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.327970 10872 tablet_bootstrap.cc:492] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:12.328511 10872 ts_tablet_manager.cc:1403] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.004s
I20260709 13:01:12.328503 10873 raft_consensus.cc:359] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.329550 10873 raft_consensus.cc:385] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.329857 10873 raft_consensus.cc:740] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.330885 10875 tablet_bootstrap.cc:492] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:12.330585 10873 consensus_queue.cc:260] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.331413 10875 ts_tablet_manager.cc:1403] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 13:01:12.331861 10872 raft_consensus.cc:359] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.332631 10872 raft_consensus.cc:385] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.333012 10872 raft_consensus.cc:740] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.333091 10873 ts_tablet_manager.cc:1434] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:01:12.334271 10873 tablet_bootstrap.cc:492] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:12.333850 10872 consensus_queue.cc:260] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.334391 10875 raft_consensus.cc:359] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.335366 10875 raft_consensus.cc:385] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.335690 10875 raft_consensus.cc:740] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.336534 10872 ts_tablet_manager.cc:1434] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:01:12.336445 10875 consensus_queue.cc:260] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.338883 10875 ts_tablet_manager.cc:1434] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:01:12.340479 10872 tablet_bootstrap.cc:492] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:12.342676 10873 tablet_bootstrap.cc:654] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.339932 10875 tablet_bootstrap.cc:492] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:12.348531 10860 raft_consensus.cc:493] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.349239 10860 raft_consensus.cc:515] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.352916 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd5c02c502b42818f2be56c72fde0ad" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:12.353749 10551 raft_consensus.cc:2468] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
I20260709 13:01:12.355429 10664 leader_election.cc:304] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:12.356983 10875 tablet_bootstrap.cc:654] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.357261 10898 raft_consensus.cc:2804] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.358062 10860 leader_election.cc:290] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:12.358420 10898 raft_consensus.cc:493] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.358412 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd5c02c502b42818f2be56c72fde0ad" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:12.359606 10624 raft_consensus.cc:2468] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
I20260709 13:01:12.360440 10898 raft_consensus.cc:3060] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.362023 10872 tablet_bootstrap.cc:654] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.369972 10875 tablet_bootstrap.cc:492] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:12.370220 10872 tablet_bootstrap.cc:492] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:12.370481 10875 ts_tablet_manager.cc:1403] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.010s
I20260709 13:01:12.370756 10872 ts_tablet_manager.cc:1403] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.006s
I20260709 13:01:12.370965 10873 tablet_bootstrap.cc:492] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:12.371559 10873 ts_tablet_manager.cc:1403] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.010s
I20260709 13:01:12.373499 10872 raft_consensus.cc:359] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.374202 10872 raft_consensus.cc:385] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.373940 10875 raft_consensus.cc:359] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.374532 10872 raft_consensus.cc:740] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.374801 10875 raft_consensus.cc:385] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.374604 10873 raft_consensus.cc:359] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.375253 10875 raft_consensus.cc:740] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.375463 10873 raft_consensus.cc:385] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.375317 10872 consensus_queue.cc:260] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.375913 10873 raft_consensus.cc:740] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.376132 10875 consensus_queue.cc:260] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.376919 10873 consensus_queue.cc:260] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.377657 10898 raft_consensus.cc:515] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.380348 10872 ts_tablet_manager.cc:1434] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:12.380697 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd5c02c502b42818f2be56c72fde0ad" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:12.388505 10551 raft_consensus.cc:3060] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.381454 10875 ts_tablet_manager.cc:1434] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:01:12.391279 10872 tablet_bootstrap.cc:492] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:12.392117 10875 tablet_bootstrap.cc:492] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:12.382064 10898 leader_election.cc:290] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:12.382601 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd5c02c502b42818f2be56c72fde0ad" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:12.397282 10624 raft_consensus.cc:3060] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.385118 10873 ts_tablet_manager.cc:1434] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:01:12.398653 10873 tablet_bootstrap.cc:492] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:12.401116 10872 tablet_bootstrap.cc:654] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.405053 10873 tablet_bootstrap.cc:654] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.409392 10886 raft_consensus.cc:493] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.401110 10875 tablet_bootstrap.cc:654] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.409932 10886 raft_consensus.cc:515] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.411880 10624 raft_consensus.cc:2468] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 1.
I20260709 13:01:12.412086 10886 leader_election.cc:290] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.412972 10665 leader_election.cc:304] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.413846 10898 raft_consensus.cc:2804] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.414058 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6848622d50e540b8a5493b25953022a2" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:12.414575 10898 raft_consensus.cc:697] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Leader. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:12.414803 10552 raft_consensus.cc:2468] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:12.416116 10590 leader_election.cc:304] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.415735 10898 consensus_queue.cc:237] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.417287 10551 raft_consensus.cc:2468] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 1.
I20260709 13:01:12.417567 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6848622d50e540b8a5493b25953022a2" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:12.418205 10701 raft_consensus.cc:2468] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:12.419353 10861 raft_consensus.cc:2804] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.419800 10861 raft_consensus.cc:493] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.420122 10861 raft_consensus.cc:3060] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.420604 10886 raft_consensus.cc:493] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.421401 10886 raft_consensus.cc:515] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.424180 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689f809a7a643f599d79d46304cdb4a" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:12.424786 10551 raft_consensus.cc:2468] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:12.425519 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689f809a7a643f599d79d46304cdb4a" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:12.426010 10590 leader_election.cc:304] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.426174 10701 raft_consensus.cc:2468] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:12.427340 10886 leader_election.cc:290] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.427942 10886 raft_consensus.cc:2804] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.428328 10886 raft_consensus.cc:493] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.428754 10886 raft_consensus.cc:3060] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.431794 10861 raft_consensus.cc:515] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.435326 10873 tablet_bootstrap.cc:492] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:12.436033 10873 ts_tablet_manager.cc:1403] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.012s
I20260709 13:01:12.439873 10873 raft_consensus.cc:359] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.441007 10872 tablet_bootstrap.cc:492] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:12.441372 10873 raft_consensus.cc:385] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.441890 10873 raft_consensus.cc:740] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.442909 10886 raft_consensus.cc:515] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.441708 10872 ts_tablet_manager.cc:1403] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.003s
I20260709 13:01:12.442929 10873 consensus_queue.cc:260] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.444126 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6848622d50e540b8a5493b25953022a2" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:12.444906 10551 raft_consensus.cc:3060] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.446630 10872 raft_consensus.cc:359] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.447069 10873 ts_tablet_manager.cc:1434] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 13:01:12.451011 10872 raft_consensus.cc:385] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.451390 10872 raft_consensus.cc:740] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.452245 10873 tablet_bootstrap.cc:492] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145: Bootstrap starting.
I20260709 13:01:12.452144 10872 consensus_queue.cc:260] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.455148 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6848622d50e540b8a5493b25953022a2" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:12.455757 10701 raft_consensus.cc:3060] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.461189 10873 tablet_bootstrap.cc:654] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.462947 10886 leader_election.cc:290] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.463042 10701 raft_consensus.cc:2468] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:12.466007 10875 tablet_bootstrap.cc:492] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:12.466128 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689f809a7a643f599d79d46304cdb4a" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:12.466516 10875 ts_tablet_manager.cc:1403] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.025s
I20260709 13:01:12.466543 10872 ts_tablet_manager.cc:1434] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:01:12.466945 10552 raft_consensus.cc:3060] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.467836 10872 tablet_bootstrap.cc:492] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:12.469511 10875 raft_consensus.cc:359] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.472553 10875 raft_consensus.cc:385] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.473217 10875 raft_consensus.cc:740] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.474196 10875 consensus_queue.cc:260] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.475634 10872 tablet_bootstrap.cc:654] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.476083 10552 raft_consensus.cc:2468] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:12.478588 10551 raft_consensus.cc:2468] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:12.479671 10590 leader_election.cc:304] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.480371 10875 ts_tablet_manager.cc:1434] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:01:12.480945 10886 raft_consensus.cc:2804] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.481436 10875 tablet_bootstrap.cc:492] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d: Bootstrap starting.
I20260709 13:01:12.481443 10886 raft_consensus.cc:697] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:12.482693 10872 tablet_bootstrap.cc:492] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:12.483176 10872 ts_tablet_manager.cc:1403] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.002s
I20260709 13:01:12.483062 10886 consensus_queue.cc:237] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.486073 10872 raft_consensus.cc:359] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.486776 10872 raft_consensus.cc:385] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.480021 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689f809a7a643f599d79d46304cdb4a" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:12.487111 10872 raft_consensus.cc:740] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.487599 10701 raft_consensus.cc:3060] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.488061 10872 consensus_queue.cc:260] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.488621 10875 tablet_bootstrap.cc:654] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.490935 10872 ts_tablet_manager.cc:1434] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:12.499620 10701 raft_consensus.cc:2468] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:12.500202 10872 tablet_bootstrap.cc:492] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0: Bootstrap starting.
I20260709 13:01:12.504422 10590 leader_election.cc:304] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.509950 10875 tablet_bootstrap.cc:492] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d: No bootstrap required, opened a new log
I20260709 13:01:12.510486 10875 ts_tablet_manager.cc:1403] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 13:01:12.511847 10886 raft_consensus.cc:2804] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.437836 10861 leader_election.cc:290] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.513388 10875 raft_consensus.cc:359] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.514160 10875 raft_consensus.cc:385] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.514424 10875 raft_consensus.cc:740] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.515987 10875 consensus_queue.cc:260] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.507256 10450 catalog_manager.cc:5697] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.516328 10872 tablet_bootstrap.cc:654] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.517508 10886 raft_consensus.cc:697] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:12.518504 10886 consensus_queue.cc:237] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.519119 10875 ts_tablet_manager.cc:1434] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:12.516438 10873 tablet_bootstrap.cc:492] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145: No bootstrap required, opened a new log
I20260709 13:01:12.520035 10873 ts_tablet_manager.cc:1403] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.007s
I20260709 13:01:12.513814 10448 catalog_manager.cc:5697] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2c1ca790591f42ecbb5522152122eb5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.523810 10873 raft_consensus.cc:359] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.536556 10873 raft_consensus.cc:385] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.536703 10905 raft_consensus.cc:493] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.537078 10873 raft_consensus.cc:740] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.537650 10905 raft_consensus.cc:515] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.542361 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184eb284dc9a42d193e881faf4d29490" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
W20260709 13:01:12.544330 10590 leader_election.cc:343] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.547235 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184eb284dc9a42d193e881faf4d29490" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:12.548044 10701 raft_consensus.cc:2468] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:12.538327 10873 consensus_queue.cc:260] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.549576 10590 leader_election.cc:304] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 15c9c27062ce42f18cc2fd3e04e355a0
I20260709 13:01:12.550849 10911 raft_consensus.cc:2804] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.550957 10905 leader_election.cc:290] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.551342 10911 raft_consensus.cc:493] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.551872 10911 raft_consensus.cc:3060] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.558109 10892 raft_consensus.cc:493] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.558817 10892 raft_consensus.cc:515] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.566483 10872 tablet_bootstrap.cc:492] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0: No bootstrap required, opened a new log
I20260709 13:01:12.566649 10892 leader_election.cc:290] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.567035 10872 ts_tablet_manager.cc:1403] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.035s
I20260709 13:01:12.569685 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f52d5fc1414f08b52ca7859f0c9b73" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:12.569974 10872 raft_consensus.cc:359] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.570319 10624 raft_consensus.cc:2468] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
I20260709 13:01:12.570638 10872 raft_consensus.cc:385] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.570974 10873 ts_tablet_manager.cc:1434] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:01:12.571035 10872 raft_consensus.cc:740] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.571297 10448 catalog_manager.cc:5697] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.572001 10872 consensus_queue.cc:260] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.572968 10516 leader_election.cc:304] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.572235 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f52d5fc1414f08b52ca7859f0c9b73" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:12.573894 10892 raft_consensus.cc:2804] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.574148 10872 ts_tablet_manager.cc:1434] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:12.574069 10701 raft_consensus.cc:2468] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 0.
I20260709 13:01:12.576786 10892 raft_consensus.cc:493] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.577124 10892 raft_consensus.cc:3060] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.579465 10911 raft_consensus.cc:515] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.581588 10911 leader_election.cc:290] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.582816 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184eb284dc9a42d193e881faf4d29490" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:12.583400 10701 raft_consensus.cc:3060] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.583576 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184eb284dc9a42d193e881faf4d29490" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:12.584159 10551 raft_consensus.cc:3060] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.584472 10892 raft_consensus.cc:515] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.587069 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f52d5fc1414f08b52ca7859f0c9b73" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:12.587625 10624 raft_consensus.cc:3060] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.587736 10892 leader_election.cc:290] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.588285 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f52d5fc1414f08b52ca7859f0c9b73" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:12.588896 10700 raft_consensus.cc:3060] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.592103 10551 raft_consensus.cc:2468] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:12.593264 10590 leader_election.cc:304] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.594126 10911 raft_consensus.cc:2804] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.594157 10701 raft_consensus.cc:2468] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:12.594915 10911 raft_consensus.cc:697] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:12.595901 10911 consensus_queue.cc:237] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
W20260709 13:01:12.598066 10498 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:12.598153 10700 raft_consensus.cc:2468] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:12.599514 10624 raft_consensus.cc:2468] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 1.
I20260709 13:01:12.599439 10515 leader_election.cc:304] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:12.600931 10892 raft_consensus.cc:2804] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.601586 10892 raft_consensus.cc:697] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:12.602650 10892 consensus_queue.cc:237] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.609412 10448 catalog_manager.cc:5697] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.611403 10898 raft_consensus.cc:493] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.611917 10898 raft_consensus.cc:515] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.611965 10450 catalog_manager.cc:5697] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.614101 10898 leader_election.cc:290] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:12.614805 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:12.615459 10551 raft_consensus.cc:2468] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
I20260709 13:01:12.615650 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:12.616271 10624 raft_consensus.cc:2468] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
I20260709 13:01:12.616673 10664 leader_election.cc:304] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:12.617941 10898 raft_consensus.cc:2804] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.618304 10898 raft_consensus.cc:493] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.618664 10898 raft_consensus.cc:3060] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.624280 10898 raft_consensus.cc:515] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.626351 10898 leader_election.cc:290] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:12.626717 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:12.626909 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:12.627242 10551 raft_consensus.cc:3060] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.627460 10624 raft_consensus.cc:3060] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.630285 10911 raft_consensus.cc:493] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.630785 10911 raft_consensus.cc:515] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.632570 10551 raft_consensus.cc:2468] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 1.
I20260709 13:01:12.633450 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89efb476fccc486bbe2439bc55a5b32a" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:12.633623 10911 leader_election.cc:290] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.633754 10664 leader_election.cc:304] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:12.634124 10552 raft_consensus.cc:2468] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:12.634693 10898 raft_consensus.cc:2804] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.635116 10624 raft_consensus.cc:2468] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 1.
I20260709 13:01:12.635195 10590 leader_election.cc:304] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.636029 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89efb476fccc486bbe2439bc55a5b32a" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d" is_pre_election: true
I20260709 13:01:12.636829 10700 raft_consensus.cc:2468] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 0.
I20260709 13:01:12.636108 10898 raft_consensus.cc:697] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Leader. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:12.637699 10911 raft_consensus.cc:2804] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.638096 10911 raft_consensus.cc:493] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.638453 10911 raft_consensus.cc:3060] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.638437 10898 consensus_queue.cc:237] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.646091 10911 raft_consensus.cc:515] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.647977 10911 leader_election.cc:290] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:12.647861 10450 catalog_manager.cc:5697] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2c1ca790591f42ecbb5522152122eb5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.649003 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89efb476fccc486bbe2439bc55a5b32a" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:12.649039 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89efb476fccc486bbe2439bc55a5b32a" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:12.649708 10551 raft_consensus.cc:3060] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.649849 10700 raft_consensus.cc:3060] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.655019 10551 raft_consensus.cc:2468] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:12.656083 10590 leader_election.cc:304] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:12.657032 10700 raft_consensus.cc:2468] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 1.
I20260709 13:01:12.657086 10911 raft_consensus.cc:2804] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.657804 10911 raft_consensus.cc:697] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:12.658655 10911 consensus_queue.cc:237] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.666321 10450 catalog_manager.cc:5697] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.769258 10892 consensus_queue.cc:1048] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.780347 10892 consensus_queue.cc:1048] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.812134 10898 raft_consensus.cc:493] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.812636 10898 raft_consensus.cc:515] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.814553 10898 leader_election.cc:290] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:12.815323 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb7c116fb024aba8140f07c0fbd1ff9" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" is_pre_election: true
I20260709 13:01:12.815531 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb7c116fb024aba8140f07c0fbd1ff9" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" is_pre_election: true
I20260709 13:01:12.816038 10551 raft_consensus.cc:2468] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
I20260709 13:01:12.816071 10624 raft_consensus.cc:2468] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 0.
I20260709 13:01:12.817154 10664 leader_election.cc:304] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:12.817806 10898 raft_consensus.cc:2804] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.818168 10898 raft_consensus.cc:493] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.818388 10898 raft_consensus.cc:3060] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.824458 10898 raft_consensus.cc:515] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.826167 10898 leader_election.cc:290] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:12.826995 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb7c116fb024aba8140f07c0fbd1ff9" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:12.827234 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb7c116fb024aba8140f07c0fbd1ff9" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:12.827574 10551 raft_consensus.cc:3060] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.827867 10624 raft_consensus.cc:3060] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.832564 10551 raft_consensus.cc:2468] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 1.
I20260709 13:01:12.832899 10624 raft_consensus.cc:2468] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 1.
I20260709 13:01:12.833762 10664 leader_election.cc:304] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:12.834563 10898 raft_consensus.cc:2804] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.835078 10898 raft_consensus.cc:697] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Leader. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:12.835842 10898 consensus_queue.cc:237] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:12.843289 10450 catalog_manager.cc:5697] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2c1ca790591f42ecbb5522152122eb5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.889745 10911 consensus_queue.cc:1048] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.900772 10911 consensus_queue.cc:1048] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.913777 10898 consensus_queue.cc:1048] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.928972 10927 consensus_queue.cc:1048] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:12.939917 10911 consensus_queue.cc:1048] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.952486 10886 consensus_queue.cc:1048] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.014957 10892 consensus_queue.cc:1048] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.025637 10889 consensus_queue.cc:1048] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.064112 10700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd"
dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
mode: GRACEFUL
new_leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:01:13.064687 10700 raft_consensus.cc:606] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Received request to transfer leadership to TS 15c9c27062ce42f18cc2fd3e04e355a0
I20260709 13:01:13.065614 10886 consensus_queue.cc:1048] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.070214 10624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6848622d50e540b8a5493b25953022a2"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
mode: GRACEFUL
new_leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:53232
I20260709 13:01:13.070778 10624 raft_consensus.cc:606] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Received request to transfer leadership to TS 15c9c27062ce42f18cc2fd3e04e355a0
I20260709 13:01:13.078588 10624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c689f809a7a643f599d79d46304cdb4a"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
mode: GRACEFUL
new_leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:53232
I20260709 13:01:13.079214 10624 raft_consensus.cc:606] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Received request to transfer leadership to TS 15c9c27062ce42f18cc2fd3e04e355a0
I20260709 13:01:13.079922 10905 consensus_queue.cc:1048] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.085230 10551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f52d5fc1414f08b52ca7859f0c9b73"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
mode: GRACEFUL
new_leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:38024
I20260709 13:01:13.085742 10551 raft_consensus.cc:606] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Received request to transfer leadership to TS cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:13.091486 10700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fd5c02c502b42818f2be56c72fde0ad"
dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
mode: GRACEFUL
new_leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:01:13.092097 10700 raft_consensus.cc:606] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Received request to transfer leadership to TS cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:13.092654 10860 consensus_queue.cc:1048] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.100860 10927 raft_consensus.cc:993] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d: : Instructing follower 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:13.101307 10927 raft_consensus.cc:1081] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Signalling peer 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:13.104347 10552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:38004
I20260709 13:01:13.104458 10700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acb7c116fb024aba8140f07c0fbd1ff9"
dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
mode: GRACEFUL
new_leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:01:13.105093 10700 raft_consensus.cc:606] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Received request to transfer leadership to TS cdb36daa5dfe484a984b2cb6ff5ff145
I20260709 13:01:13.108850 10552 raft_consensus.cc:493] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.109331 10552 raft_consensus.cc:3060] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.109213 10927 consensus_queue.cc:1048] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:13.120069 10552 raft_consensus.cc:515] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.122188 10624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "184eb284dc9a42d193e881faf4d29490"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
mode: GRACEFUL
new_leader_uuid: "2c1ca790591f42ecbb5522152122eb5d"
 from {username='slave'} at 127.0.0.1:53232
I20260709 13:01:13.122579 10552 leader_election.cc:290] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:13.122813 10624 raft_consensus.cc:606] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Received request to transfer leadership to TS 2c1ca790591f42ecbb5522152122eb5d
I20260709 13:01:13.122898 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:13.123560 10625 raft_consensus.cc:3060] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.125752 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1023cdd02a8480db22322769db53fdd" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:13.126379 10700 raft_consensus.cc:3055] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:13.126735 10700 raft_consensus.cc:740] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:13.127597 10700 consensus_queue.cc:260] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.128870 10700 raft_consensus.cc:3060] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.130510 10625 raft_consensus.cc:2468] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:13.131500 10516 leader_election.cc:304] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:13.132197 10889 raft_consensus.cc:2804] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:13.132751 10889 raft_consensus.cc:697] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:13.133399 10889 consensus_queue.cc:237] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.135277 10700 raft_consensus.cc:2468] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:13.139971 10448 catalog_manager.cc:5697] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 1 to 2, leader changed from 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195) to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.157167 10911 consensus_queue.cc:1048] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.167816 10911 consensus_queue.cc:1048] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.174513 10911 raft_consensus.cc:993] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145: : Instructing follower 2c1ca790591f42ecbb5522152122eb5d to start an election
I20260709 13:01:13.174970 10911 raft_consensus.cc:1081] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Signalling peer 2c1ca790591f42ecbb5522152122eb5d to start an election
I20260709 13:01:13.176388 10700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "184eb284dc9a42d193e881faf4d29490"
dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
 from {username='slave'} at 127.0.0.1:58374
I20260709 13:01:13.176927 10700 raft_consensus.cc:493] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.177249 10700 raft_consensus.cc:3060] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.182479 10700 raft_consensus.cc:515] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.184062 10700 leader_election.cc:290] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 2 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:13.184885 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184eb284dc9a42d193e881faf4d29490" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:13.185546 10551 raft_consensus.cc:3060] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.185998 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184eb284dc9a42d193e881faf4d29490" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:13.186561 10625 raft_consensus.cc:3055] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:13.186812 10625 raft_consensus.cc:740] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:13.187521 10625 consensus_queue.cc:260] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.188446 10625 raft_consensus.cc:3060] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.191337 10551 raft_consensus.cc:2468] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 2.
I20260709 13:01:13.192320 10664 leader_election.cc:304] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:13.193032 10927 raft_consensus.cc:2804] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:13.193516 10927 raft_consensus.cc:697] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 2 LEADER]: Becoming Leader. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:13.193964 10625 raft_consensus.cc:2468] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 2.
I20260709 13:01:13.194355 10927 consensus_queue.cc:237] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.200690 10448 catalog_manager.cc:5697] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d reported cstate change: term changed from 1 to 2, leader changed from cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194) to 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2c1ca790591f42ecbb5522152122eb5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:13.293181 10927 consensus_queue.cc:1048] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.303640 10927 consensus_queue.cc:1048] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.313493 10860 raft_consensus.cc:993] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d: : Instructing follower cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:13.313992 10927 raft_consensus.cc:1081] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Signalling peer cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:13.315601 10625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acb7c116fb024aba8140f07c0fbd1ff9"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:53216
I20260709 13:01:13.316259 10625 raft_consensus.cc:493] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.316697 10625 raft_consensus.cc:3060] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.322067 10625 raft_consensus.cc:515] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.323859 10625 leader_election.cc:290] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:13.324412 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb7c116fb024aba8140f07c0fbd1ff9" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:13.324787 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb7c116fb024aba8140f07c0fbd1ff9" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:13.325055 10551 raft_consensus.cc:3060] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.325409 10700 raft_consensus.cc:3055] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:13.325749 10700 raft_consensus.cc:740] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:13.326454 10700 consensus_queue.cc:260] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.327404 10700 raft_consensus.cc:3060] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.331039 10551 raft_consensus.cc:2468] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:13.332140 10590 leader_election.cc:304] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:13.332317 10700 raft_consensus.cc:2468] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:13.332962 10911 raft_consensus.cc:2804] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:13.333395 10911 raft_consensus.cc:697] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:13.334098 10911 consensus_queue.cc:237] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.340528 10447 catalog_manager.cc:5697] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 1 to 2, leader changed from 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195) to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.367053 10929 raft_consensus.cc:993] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d: : Instructing follower cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:13.367506 10927 raft_consensus.cc:1081] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Signalling peer cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:13.368808 10625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fd5c02c502b42818f2be56c72fde0ad"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:53216
I20260709 13:01:13.369364 10625 raft_consensus.cc:493] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.369710 10625 raft_consensus.cc:3060] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.374920 10625 raft_consensus.cc:515] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.376490 10625 leader_election.cc:290] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:13.377192 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd5c02c502b42818f2be56c72fde0ad" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:13.377393 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd5c02c502b42818f2be56c72fde0ad" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:13.377801 10551 raft_consensus.cc:3060] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.377895 10700 raft_consensus.cc:3055] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:13.378283 10700 raft_consensus.cc:740] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:13.379045 10700 consensus_queue.cc:260] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.380195 10700 raft_consensus.cc:3060] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.384171 10551 raft_consensus.cc:2468] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:13.385243 10590 leader_election.cc:304] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:13.386004 10886 raft_consensus.cc:2804] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:13.386502 10886 raft_consensus.cc:697] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:13.387362 10886 consensus_queue.cc:237] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.388192 10700 raft_consensus.cc:2468] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:13.395332 10448 catalog_manager.cc:5697] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 1 to 2, leader changed from 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195) to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.402632 10944 raft_consensus.cc:993] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145: : Instructing follower 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:13.403231 10944 raft_consensus.cc:1081] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Signalling peer 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:13.404660 10552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c689f809a7a643f599d79d46304cdb4a"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:38016
I20260709 13:01:13.405196 10552 raft_consensus.cc:493] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.405519 10552 raft_consensus.cc:3060] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.410534 10552 raft_consensus.cc:515] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.412572 10552 leader_election.cc:290] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:13.412987 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689f809a7a643f599d79d46304cdb4a" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:13.413237 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689f809a7a643f599d79d46304cdb4a" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:13.413895 10700 raft_consensus.cc:3060] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.415155 10625 raft_consensus.cc:3055] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:13.415544 10625 raft_consensus.cc:740] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:13.417347 10625 consensus_queue.cc:260] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.418669 10625 raft_consensus.cc:3060] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.419754 10886 raft_consensus.cc:993] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145: : Instructing follower 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:13.420326 10944 raft_consensus.cc:1081] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Signalling peer 15c9c27062ce42f18cc2fd3e04e355a0 to start an election
I20260709 13:01:13.421100 10700 raft_consensus.cc:2468] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:13.422086 10552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6848622d50e540b8a5493b25953022a2"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
 from {username='slave'} at 127.0.0.1:38016
I20260709 13:01:13.422348 10515 leader_election.cc:304] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:13.422709 10552 raft_consensus.cc:493] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.423096 10552 raft_consensus.cc:3060] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.423209 10887 raft_consensus.cc:2804] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:13.423781 10887 raft_consensus.cc:697] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:13.424603 10887 consensus_queue.cc:237] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.426789 10625 raft_consensus.cc:2468] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:13.430202 10552 raft_consensus.cc:515] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.432240 10552 leader_election.cc:290] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:13.432269 10448 catalog_manager.cc:5697] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 1 to 2, leader changed from cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194) to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.433291 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6848622d50e540b8a5493b25953022a2" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:13.433605 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6848622d50e540b8a5493b25953022a2" candidate_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:13.433923 10625 raft_consensus.cc:3055] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:13.434187 10700 raft_consensus.cc:3060] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.434296 10625 raft_consensus.cc:740] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:13.435251 10625 consensus_queue.cc:260] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.436184 10625 raft_consensus.cc:3060] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.440001 10700 raft_consensus.cc:2468] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:13.441304 10515 leader_election.cc:304] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:13.442188 10887 raft_consensus.cc:2804] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:13.442571 10887 raft_consensus.cc:697] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Becoming Leader. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:13.443171 10887 consensus_queue.cc:237] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.443442 10625 raft_consensus.cc:2468] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15c9c27062ce42f18cc2fd3e04e355a0 in term 2.
I20260709 13:01:13.449527 10448 catalog_manager.cc:5697] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 reported cstate change: term changed from 1 to 2, leader changed from cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194) to 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.489122 10892 raft_consensus.cc:993] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0: : Instructing follower cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:13.489655 10887 raft_consensus.cc:1081] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Signalling peer cdb36daa5dfe484a984b2cb6ff5ff145 to start an election
I20260709 13:01:13.491199 10625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05f52d5fc1414f08b52ca7859f0c9b73"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
 from {username='slave'} at 127.0.0.1:53222
I20260709 13:01:13.491761 10625 raft_consensus.cc:493] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.492133 10625 raft_consensus.cc:3060] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.497522 10625 raft_consensus.cc:515] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.499058 10625 leader_election.cc:290] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195:39831)
I20260709 13:01:13.499804 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f52d5fc1414f08b52ca7859f0c9b73" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:13.499979 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f52d5fc1414f08b52ca7859f0c9b73" candidate_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
I20260709 13:01:13.500568 10552 raft_consensus.cc:3055] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:13.500591 10700 raft_consensus.cc:3060] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.501080 10552 raft_consensus.cc:740] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:13.501892 10552 consensus_queue.cc:260] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.503103 10552 raft_consensus.cc:3060] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.507411 10700 raft_consensus.cc:2468] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:13.508472 10590 leader_election.cc:304] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:13.509214 10944 raft_consensus.cc:2804] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:13.509707 10944 raft_consensus.cc:697] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Becoming Leader. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:13.509841 10552 raft_consensus.cc:2468] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb36daa5dfe484a984b2cb6ff5ff145 in term 2.
I20260709 13:01:13.510560 10944 consensus_queue.cc:237] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:13.518383 10448 catalog_manager.cc:5697] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 reported cstate change: term changed from 1 to 2, leader changed from 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193) to cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.559509 10625 raft_consensus.cc:1275] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.560799 10887 consensus_queue.cc:1048] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.570652 10700 raft_consensus.cc:1275] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.572319 10889 consensus_queue.cc:1048] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.617400 10552 raft_consensus.cc:1275] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Refusing update from remote peer 2c1ca790591f42ecbb5522152122eb5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.618567 10927 consensus_queue.cc:1048] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.626070 10625 raft_consensus.cc:1275] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Refusing update from remote peer 2c1ca790591f42ecbb5522152122eb5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.627673 10927 consensus_queue.cc:1048] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.785461 10700 raft_consensus.cc:1275] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.786871 10944 consensus_queue.cc:1048] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.794893 10552 raft_consensus.cc:1275] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.796450 10905 consensus_queue.cc:1048] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.809263 10552 raft_consensus.cc:1275] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.810547 10905 consensus_queue.cc:1048] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.817935 10700 raft_consensus.cc:1275] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.821604 10944 consensus_queue.cc:1048] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.930083 10552 raft_consensus.cc:1275] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.931516 10944 consensus_queue.cc:1048] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.940898 10700 raft_consensus.cc:1275] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer cdb36daa5dfe484a984b2cb6ff5ff145: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.942173 10944 consensus_queue.cc:1048] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.963353 10624 raft_consensus.cc:1275] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.964613 10892 consensus_queue.cc:1048] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.965132 10700 raft_consensus.cc:1275] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.966393 10892 consensus_queue.cc:1048] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.974962 10700 raft_consensus.cc:1275] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.976441 10892 consensus_queue.cc:1048] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.985791 10625 raft_consensus.cc:1275] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Refusing update from remote peer 15c9c27062ce42f18cc2fd3e04e355a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.987546 10889 consensus_queue.cc:1048] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:16.126492 10450 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50240:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:01:16.149938 10450 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50240:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:01:16.214138   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:16.352159 10990 tablet.cc:1724] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.496097 11004 tablet.cc:1724] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.497334 10998 tablet.cc:1724] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.509210 10999 tablet.cc:1724] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:01:16.635725 10515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:39831, user_credentials={real_user=slave}} blocked reactor thread for 79124.7us
I20260709 13:01:16.692997 11009 tablet.cc:1724] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:01:16.707485 11007 log.cc:927] Time spent T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:01:16.711692 11010 tablet.cc:1724] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.718446 10990 tablet.cc:1724] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:01:16.720286 10590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 57323.1us
I20260709 13:01:16.742839 10549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253"
dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
mode: GRACEFUL
new_leader_uuid: "2c1ca790591f42ecbb5522152122eb5d"
 from {username='slave'} at 127.0.0.1:44712
I20260709 13:01:16.749953 10549 raft_consensus.cc:606] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Received request to transfer leadership to TS 2c1ca790591f42ecbb5522152122eb5d
I20260709 13:01:16.749666 11021 tablet.cc:1724] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.693048 11008 tablet.cc:1724] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.759444 11018 raft_consensus.cc:993] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0: : Instructing follower 2c1ca790591f42ecbb5522152122eb5d to start an election
I20260709 13:01:16.760087 11018 raft_consensus.cc:1081] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Signalling peer 2c1ca790591f42ecbb5522152122eb5d to start an election
I20260709 13:01:16.763303 10698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253"
dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
 from {username='slave'} at 127.0.0.1:58358
I20260709 13:01:16.700042 11013 tablet.cc:1724] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.764003 10698 raft_consensus.cc:493] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:16.776945 10698 raft_consensus.cc:3060] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:16.784243 10450 catalog_manager.cc:5789] TS 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839) does not have the latest schema for tablet 6848622d50e540b8a5493b25953022a2 (table soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]). Expected version 1 got 0
I20260709 13:01:16.802276 10450 catalog_manager.cc:5789] TS 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839) does not have the latest schema for tablet b1023cdd02a8480db22322769db53fdd (table soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]). Expected version 1 got 0
I20260709 13:01:16.806442 10998 tablet.cc:1724] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.747859 11019 tablet.cc:1724] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.834544 10698 raft_consensus.cc:515] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:16.826136 11024 tablet.cc:1724] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.843221 11025 tablet.cc:1724] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.846877 10549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:16.847561 10698 leader_election.cc:290] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 3 election: Requested vote from peers cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141), 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839)
I20260709 13:01:16.850451 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6272cc1c4708433eb1f5b67046edb253" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:16.851841 10998 tablet.cc:1724] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.859503 10549 raft_consensus.cc:3055] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:16.859874 10549 raft_consensus.cc:740] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15c9c27062ce42f18cc2fd3e04e355a0, State: Running, Role: LEADER
I20260709 13:01:16.860018 10447 catalog_manager.cc:5789] TS cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141) does not have the latest schema for tablet 89efb476fccc486bbe2439bc55a5b32a (table soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]). Expected version 1 got 0
I20260709 13:01:16.860924 10549 consensus_queue.cc:260] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:16.862375 10549 raft_consensus.cc:3060] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:16.864817 10627 raft_consensus.cc:3060] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:16.866161 11008 tablet.cc:1724] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.860931 10447 catalog_manager.cc:5789] TS cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141) does not have the latest schema for tablet acb7c116fb024aba8140f07c0fbd1ff9 (table soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]). Expected version 1 got 0
I20260709 13:01:16.869729 10447 catalog_manager.cc:5789] TS cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141) does not have the latest schema for tablet 7fd5c02c502b42818f2be56c72fde0ad (table soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca]). Expected version 1 got 0
I20260709 13:01:16.876672 11009 tablet.cc:1724] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.876708 10623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8"
dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
mode: GRACEFUL
new_leader_uuid: "2c1ca790591f42ecbb5522152122eb5d"
 from {username='slave'} at 127.0.0.1:43388
I20260709 13:01:16.878755 10623 raft_consensus.cc:606] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Received request to transfer leadership to TS 2c1ca790591f42ecbb5522152122eb5d
I20260709 13:01:16.879438 10990 tablet.cc:1724] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.881003   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:16.881708   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:16.883816 11013 tablet.cc:1724] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.901494 11019 tablet.cc:1724] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.902432 10627 raft_consensus.cc:2468] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 3.
I20260709 13:01:16.909600 10665 leader_election.cc:304] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1ca790591f42ecbb5522152122eb5d, cdb36daa5dfe484a984b2cb6ff5ff145; no voters: 
I20260709 13:01:16.910605 10989 raft_consensus.cc:2804] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:16.911063 10989 raft_consensus.cc:697] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 3 LEADER]: Becoming Leader. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:16.912083 10989 consensus_queue.cc:237] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } }
I20260709 13:01:16.890807 10999 tablet.cc:1724] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.886952 11004 tablet.cc:1724] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.918715 11019 tablet.cc:1724] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.908166 10549 raft_consensus.cc:2468] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 3.
I20260709 13:01:16.914989 11010 tablet.cc:1724] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.943202 11004 tablet.cc:1724] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.958459 11010 tablet.cc:1724] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.959662 11025 tablet.cc:1724] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:01:16.972566 10449 catalog_manager.cc:5697] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d reported cstate change: term changed from 2 to 3, leader changed from 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193) to 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2c1ca790591f42ecbb5522152122eb5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.000790 10450 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691: soft_deleted_table [id=e79b2ac005404f1fa9652d03ec27daca] alter complete (version 1)
I20260709 13:01:17.195727 10905 raft_consensus.cc:993] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145: : Instructing follower 2c1ca790591f42ecbb5522152122eb5d to start an election
I20260709 13:01:17.196328 11020 raft_consensus.cc:1081] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Signalling peer 2c1ca790591f42ecbb5522152122eb5d to start an election
I20260709 13:01:17.197777 10698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8"
dest_uuid: "2c1ca790591f42ecbb5522152122eb5d"
 from {username='slave'} at 127.0.0.1:58374
I20260709 13:01:17.198288 10698 raft_consensus.cc:493] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:17.198586 10698 raft_consensus.cc:3060] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.203931 10698 raft_consensus.cc:515] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:17.205570 10698 leader_election.cc:290] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 3 election: Requested vote from peers 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839), cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141)
I20260709 13:01:17.206316 10548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15c9c27062ce42f18cc2fd3e04e355a0"
I20260709 13:01:17.206643 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f8a422c5394e80b0c9aea3145a71e8" candidate_uuid: "2c1ca790591f42ecbb5522152122eb5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145"
I20260709 13:01:17.206972 10548 raft_consensus.cc:3060] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.207300 10627 raft_consensus.cc:3055] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:17.207623 10627 raft_consensus.cc:740] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cdb36daa5dfe484a984b2cb6ff5ff145, State: Running, Role: LEADER
I20260709 13:01:17.208302 10627 consensus_queue.cc:260] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:17.209556 10627 raft_consensus.cc:3060] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.213629 10548 raft_consensus.cc:2468] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 3.
I20260709 13:01:17.214794 10664 leader_election.cc:304] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c9c27062ce42f18cc2fd3e04e355a0, 2c1ca790591f42ecbb5522152122eb5d; no voters: 
I20260709 13:01:17.215152 10627 raft_consensus.cc:2468] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1ca790591f42ecbb5522152122eb5d in term 3.
I20260709 13:01:17.215481 10989 raft_consensus.cc:2804] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:17.216059 10989 raft_consensus.cc:697] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 3 LEADER]: Becoming Leader. State: Replica: 2c1ca790591f42ecbb5522152122eb5d, State: Running, Role: LEADER
I20260709 13:01:17.216958 10989 consensus_queue.cc:237] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } }
I20260709 13:01:17.223778 10448 catalog_manager.cc:5697] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d reported cstate change: term changed from 2 to 3, leader changed from cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194) to 2c1ca790591f42ecbb5522152122eb5d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2c1ca790591f42ecbb5522152122eb5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1ca790591f42ecbb5522152122eb5d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39831 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.347038 10627 raft_consensus.cc:1275] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Refusing update from remote peer 2c1ca790591f42ecbb5522152122eb5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:17.348147 10989 consensus_queue.cc:1048] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.357954 10548 raft_consensus.cc:1275] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Refusing update from remote peer 2c1ca790591f42ecbb5522152122eb5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:17.359416 10989 consensus_queue.cc:1048] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.750996 10548 raft_consensus.cc:1275] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Refusing update from remote peer 2c1ca790591f42ecbb5522152122eb5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:17.752162 10623 raft_consensus.cc:1275] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Refusing update from remote peer 2c1ca790591f42ecbb5522152122eb5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:17.752424 10989 consensus_queue.cc:1048] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c9c27062ce42f18cc2fd3e04e355a0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.753721 10986 consensus_queue.cc:1048] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb36daa5dfe484a984b2cb6ff5ff145" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.935670   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:01:17.970788   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:17.971505   431 tablet_replica.cc:333] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:17.972163   431 raft_consensus.cc:2243] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.972716   431 raft_consensus.cc:2272] T 184eb284dc9a42d193e881faf4d29490 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.974881   431 tablet_replica.cc:333] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:17.975986   431 raft_consensus.cc:2243] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.976498   431 raft_consensus.cc:2272] T 89efb476fccc486bbe2439bc55a5b32a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.979782   431 tablet_replica.cc:333] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:17.980512   431 raft_consensus.cc:2243] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:17.981297   431 raft_consensus.cc:2272] T 6848622d50e540b8a5493b25953022a2 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:17.983817 10664 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:01:17.984409   431 tablet_replica.cc:333] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:17.985270   431 raft_consensus.cc:2243] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:17.986325   431 raft_consensus.cc:2272] T c689f809a7a643f599d79d46304cdb4a P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:17.986912 10664 consensus_peers.cc:597] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d -> Peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Couldn't send request to peer 15c9c27062ce42f18cc2fd3e04e355a0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:17.988571   431 tablet_replica.cc:333] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:17.989270   431 raft_consensus.cc:2243] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:17.989982   431 raft_consensus.cc:2272] T b1023cdd02a8480db22322769db53fdd P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.991875   431 tablet_replica.cc:333] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:17.992380   431 raft_consensus.cc:2243] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.992808   431 raft_consensus.cc:2272] T acb7c116fb024aba8140f07c0fbd1ff9 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.995146   431 tablet_replica.cc:333] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:17.995682   431 raft_consensus.cc:2243] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.996189   431 raft_consensus.cc:2272] T 7fd5c02c502b42818f2be56c72fde0ad P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:17.998301 10590 consensus_peers.cc:597] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 -> Peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Couldn't send request to peer 15c9c27062ce42f18cc2fd3e04e355a0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:17.998767   431 tablet_replica.cc:333] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:17.999394   431 raft_consensus.cc:2243] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.999854   431 raft_consensus.cc:2272] T 46c29720ed0d4fa1afddf01203710826 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.002017   431 tablet_replica.cc:333] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:18.002605   431 raft_consensus.cc:2243] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.003345   431 raft_consensus.cc:2272] T 50dc273217804d8eb9a6a680caae410c P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.005434   431 tablet_replica.cc:333] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:18.005957   431 raft_consensus.cc:2243] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.006424   431 raft_consensus.cc:2272] T 4fee234e8a894122a7ce2ce36cccb305 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.008548   431 tablet_replica.cc:333] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:18.009100   431 raft_consensus.cc:2243] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.009462   431 raft_consensus.cc:2272] T 3e82fd94e36f44a4ac1bdabc5f287867 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.011579   431 tablet_replica.cc:333] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:18.012066   431 raft_consensus.cc:2243] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.012441   431 raft_consensus.cc:2272] T 05f52d5fc1414f08b52ca7859f0c9b73 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.014420   431 tablet_replica.cc:333] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:18.014915   431 raft_consensus.cc:2243] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.015808   431 raft_consensus.cc:2272] T a27ffb93016c42b28364b40602cbf58e P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.018326   431 tablet_replica.cc:333] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:18.019084   431 raft_consensus.cc:2243] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.019927   431 raft_consensus.cc:2272] T bd1bc8f3de24442fb7d7b37a6e002b00 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.022298   431 tablet_replica.cc:333] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:18.023129   431 raft_consensus.cc:2243] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.023651   431 raft_consensus.cc:2272] T 84f8a422c5394e80b0c9aea3145a71e8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.026247   431 tablet_replica.cc:333] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
W20260709 13:01:18.026528 10590 consensus_peers.cc:597] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 -> Peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Couldn't send request to peer 15c9c27062ce42f18cc2fd3e04e355a0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:18.026775   431 raft_consensus.cc:2243] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.027678   431 raft_consensus.cc:2272] T c4fa13f278744c27810ecad0366b08f8 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.029799   431 tablet_replica.cc:333] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:18.030323   431 raft_consensus.cc:2243] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.030820   431 raft_consensus.cc:2272] T 83d47b175de44c19b4eea8c34e264733 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.032938   431 tablet_replica.cc:333] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0: stopping tablet replica
I20260709 13:01:18.033385   431 raft_consensus.cc:2243] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.033787   431 raft_consensus.cc:2272] T 6272cc1c4708433eb1f5b67046edb253 P 15c9c27062ce42f18cc2fd3e04e355a0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.077018   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:18.078174 10664 consensus_peers.cc:597] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d -> Peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Couldn't send request to peer 15c9c27062ce42f18cc2fd3e04e355a0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:18.111529   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:01:18.145721   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:18.146498   431 tablet_replica.cc:333] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.147585   431 raft_consensus.cc:2243] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.148250   431 raft_consensus.cc:2272] T 184eb284dc9a42d193e881faf4d29490 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.150324   431 tablet_replica.cc:333] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.150890   431 raft_consensus.cc:2243] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.151633   431 raft_consensus.cc:2272] T 89efb476fccc486bbe2439bc55a5b32a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.154126   431 tablet_replica.cc:333] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.154719   431 raft_consensus.cc:2243] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.155437   431 raft_consensus.cc:2272] T acb7c116fb024aba8140f07c0fbd1ff9 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.157380   431 tablet_replica.cc:333] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.157933   431 raft_consensus.cc:2243] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:01:18.158541 10591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.158625   431 raft_consensus.cc:2272] T 7fd5c02c502b42818f2be56c72fde0ad P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.160781   431 tablet_replica.cc:333] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.161335   431 raft_consensus.cc:2243] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.161792   431 raft_consensus.cc:2272] T 6848622d50e540b8a5493b25953022a2 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.164198   431 tablet_replica.cc:333] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.164814   431 raft_consensus.cc:2243] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.165876   431 raft_consensus.cc:2272] T 46c29720ed0d4fa1afddf01203710826 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:18.165963 10664 consensus_peers.cc:597] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d -> Peer 15c9c27062ce42f18cc2fd3e04e355a0 (127.0.107.193:35839): Couldn't send request to peer 15c9c27062ce42f18cc2fd3e04e355a0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:18.168083   431 tablet_replica.cc:333] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.168777   431 raft_consensus.cc:2243] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.169203   431 raft_consensus.cc:2272] T 50dc273217804d8eb9a6a680caae410c P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.171056   431 tablet_replica.cc:333] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.171619   431 raft_consensus.cc:2243] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.172060   431 raft_consensus.cc:2272] T c689f809a7a643f599d79d46304cdb4a P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.173950   431 tablet_replica.cc:333] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.174485   431 raft_consensus.cc:2243] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.174908   431 raft_consensus.cc:2272] T b1023cdd02a8480db22322769db53fdd P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.176887   431 tablet_replica.cc:333] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.177392   431 raft_consensus.cc:2243] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.177819   431 raft_consensus.cc:2272] T bd1bc8f3de24442fb7d7b37a6e002b00 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.179767   431 tablet_replica.cc:333] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.180325   431 raft_consensus.cc:2243] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.180778   431 raft_consensus.cc:2272] T 84f8a422c5394e80b0c9aea3145a71e8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.183079   431 tablet_replica.cc:333] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.183599   431 raft_consensus.cc:2243] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.184029   431 raft_consensus.cc:2272] T c4fa13f278744c27810ecad0366b08f8 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.186041   431 tablet_replica.cc:333] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.186514   431 raft_consensus.cc:2243] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.187268   431 raft_consensus.cc:2272] T 05f52d5fc1414f08b52ca7859f0c9b73 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.189136   431 tablet_replica.cc:333] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.189653   431 raft_consensus.cc:2243] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.190423   431 raft_consensus.cc:2272] T 3e82fd94e36f44a4ac1bdabc5f287867 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.192322   431 tablet_replica.cc:333] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.192899   431 raft_consensus.cc:2243] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.193332   431 raft_consensus.cc:2272] T 4fee234e8a894122a7ce2ce36cccb305 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.195736   431 tablet_replica.cc:333] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.196264   431 raft_consensus.cc:2243] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.196775   431 raft_consensus.cc:2272] T 6272cc1c4708433eb1f5b67046edb253 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:18.198029 10665 consensus_peers.cc:597] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d -> Peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Couldn't send request to peer cdb36daa5dfe484a984b2cb6ff5ff145. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:18.199371   431 tablet_replica.cc:333] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.199941   431 raft_consensus.cc:2243] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.200768   431 raft_consensus.cc:2272] T 83d47b175de44c19b4eea8c34e264733 P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.202702   431 tablet_replica.cc:333] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145: stopping tablet replica
I20260709 13:01:18.203159   431 raft_consensus.cc:2243] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.203598   431 raft_consensus.cc:2272] T a27ffb93016c42b28364b40602cbf58e P cdb36daa5dfe484a984b2cb6ff5ff145 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.241997   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:01:18.276670   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:01:18.303829   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:18.304631   431 tablet_replica.cc:333] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.305377   431 raft_consensus.cc:2243] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.305886   431 raft_consensus.cc:2272] T 89efb476fccc486bbe2439bc55a5b32a P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.307936   431 tablet_replica.cc:333] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.308562   431 raft_consensus.cc:2243] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.309405   431 raft_consensus.cc:2272] T 184eb284dc9a42d193e881faf4d29490 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.311586   431 tablet_replica.cc:333] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.312202   431 raft_consensus.cc:2243] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.312700   431 raft_consensus.cc:2272] T 6848622d50e540b8a5493b25953022a2 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:18.313467 10665 consensus_peers.cc:597] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d -> Peer cdb36daa5dfe484a984b2cb6ff5ff145 (127.0.107.194:37141): Couldn't send request to peer cdb36daa5dfe484a984b2cb6ff5ff145. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37141: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:18.314792   431 tablet_replica.cc:333] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.315475   431 raft_consensus.cc:2243] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.315949   431 raft_consensus.cc:2272] T b1023cdd02a8480db22322769db53fdd P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.317924   431 tablet_replica.cc:333] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.318501   431 raft_consensus.cc:2243] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.318933   431 raft_consensus.cc:2272] T c689f809a7a643f599d79d46304cdb4a P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.321053   431 tablet_replica.cc:333] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.321673   431 raft_consensus.cc:2243] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.322417   431 raft_consensus.cc:2272] T 6272cc1c4708433eb1f5b67046edb253 P 2c1ca790591f42ecbb5522152122eb5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.324625   431 tablet_replica.cc:333] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.325239   431 raft_consensus.cc:2243] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.325973   431 raft_consensus.cc:2272] T 84f8a422c5394e80b0c9aea3145a71e8 P 2c1ca790591f42ecbb5522152122eb5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.328250   431 tablet_replica.cc:333] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.328866   431 raft_consensus.cc:2243] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.329280   431 raft_consensus.cc:2272] T bd1bc8f3de24442fb7d7b37a6e002b00 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.331066   431 tablet_replica.cc:333] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.331585   431 raft_consensus.cc:2243] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.332038   431 raft_consensus.cc:2272] T 83d47b175de44c19b4eea8c34e264733 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.334033   431 tablet_replica.cc:333] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.334594   431 raft_consensus.cc:2243] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.335012   431 raft_consensus.cc:2272] T 05f52d5fc1414f08b52ca7859f0c9b73 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.336938   431 tablet_replica.cc:333] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.337476   431 raft_consensus.cc:2243] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.338279   431 raft_consensus.cc:2272] T 4fee234e8a894122a7ce2ce36cccb305 P 2c1ca790591f42ecbb5522152122eb5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.340257   431 tablet_replica.cc:333] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.340864   431 raft_consensus.cc:2243] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.341279   431 raft_consensus.cc:2272] T 3e82fd94e36f44a4ac1bdabc5f287867 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.343081   431 tablet_replica.cc:333] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.343576   431 raft_consensus.cc:2243] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.344017   431 raft_consensus.cc:2272] T acb7c116fb024aba8140f07c0fbd1ff9 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.345865   431 tablet_replica.cc:333] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.346383   431 raft_consensus.cc:2243] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.346820   431 raft_consensus.cc:2272] T 7fd5c02c502b42818f2be56c72fde0ad P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.348713   431 tablet_replica.cc:333] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.349192   431 raft_consensus.cc:2243] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.349571   431 raft_consensus.cc:2272] T c4fa13f278744c27810ecad0366b08f8 P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.351498   431 tablet_replica.cc:333] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.351974   431 raft_consensus.cc:2243] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.352392   431 raft_consensus.cc:2272] T 50dc273217804d8eb9a6a680caae410c P 2c1ca790591f42ecbb5522152122eb5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.354246   431 tablet_replica.cc:333] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.354709   431 raft_consensus.cc:2243] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.355111   431 raft_consensus.cc:2272] T 46c29720ed0d4fa1afddf01203710826 P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.357020   431 tablet_replica.cc:333] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d: stopping tablet replica
I20260709 13:01:18.357781   431 raft_consensus.cc:2243] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.358381   431 raft_consensus.cc:2272] T a27ffb93016c42b28364b40602cbf58e P 2c1ca790591f42ecbb5522152122eb5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.395885   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:01:18.431178   431 master.cc:562] Master@127.0.107.254:39243 shutting down...
I20260709 13:01:18.454996   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:18.455629   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.456017   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 81cb2c3e0eca4e8b8883a584093db691: stopping tablet replica
I20260709 13:01:18.476897   431 master.cc:584] Master@127.0.107.254:39243 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (13115 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25894 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (312049 ms total)
[  PASSED  ] 8 tests.
I20260709 13:01:18.532291   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 416 messages since previous log ~496 seconds ago
I20260709 13:01:18.532533   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 416 messages since previous log ~496 seconds ago
I20260709 13:01:18.532912   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 415 messages since previous log ~496 seconds ago
I20260709 13:01:18.533134   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:01:18.533337   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:01:18.533540   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 2 messages since previous log ~173 seconds ago
I20260709 13:01:18.533740   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~133 seconds ago
I20260709 13:01:18.533948   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 8 messages since previous log ~189 seconds ago
I20260709 13:01:18.534159   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 8 messages since previous log ~189 seconds ago
I20260709 13:01:18.534363   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~75 seconds ago
I20260709 13:01:18.534629   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:01:18.534826   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
